LET-REMA-LCEX21
Multimodal Language and Cognition: Gesture and Sign
Course infoSchedule
Course moduleLET-REMA-LCEX21
Credits (ECTS)6
Category-
Language of instructionEnglish
Offered byRadboud University; Faculty of Arts; Graduate School;
Lecturer(s)
Lecturer
dr. J.A.M. Holler
Other course modules lecturer
Examiner
prof. dr. H.A. Ozyurek
Other course modules lecturer
Lecturer
prof. dr. H.A. Ozyurek
Other course modules lecturer
Coordinator
prof. dr. H.A. Ozyurek
Other course modules lecturer
Contactperson for the course
prof. dr. H.A. Ozyurek
Other course modules lecturer
Academic year2021
Period
PER 3-PER 4  (31/01/2022 to 30/08/2022)
Starting block
PER 3
Course mode
full-time
Remarks-
Registration using OSIRISYes
Course open to students from other facultiesYes
Pre-registrationNo
Waiting listNo
Placement procedure-
Aims
Most research on language takes speech as the main domain of investigation. However, in face to face communication we use language in a visual world. Speakers use not only speech but also meaningful hand movements called 'gestures' when they speak (pointing, iconic gestures etc). Furthermore, deaf communities use sign languages that are produced and perceived only in the visual-spatial modality. This course aims to give an interdisciplinary and state of the art overview of the role of the body and visual expression in the structuring, functioning and the development of the human language faculty. As such it offers a new window into our assumptions of language and its workings. The course will be presented in relation to discussions on embodied cognition and semantics, situated use of language, the links between language, action, space, memory, social cognition/interaction and their neural correlates.
Content
The course consists of several modules as described below:

Gestures in spoken language:
  • Introduction to gesture basics - definitions; structure; theories
  • The role of gestures in processing of language - production and comprehension
  • The role of gestures in cognition (social, memory, imagery)
  • The role of gestures in language acquisition and development (first, second, bilingual)
  • The role of gestures in interaction (dialogue, common ground)
  • Gestures and the brain
Sign Language:
  • Introduction to sign language grammar
  • Sign language processing/comparison with speech processing
  • Acquisition of sign language (first, second, bimodal bilingual)
  • Sign language and the brain
  • Emerging language systems (in the wild/laboratory)
  • The role of gesture or sign in language evolution
Broader significance:
  • Situated language use
  • Language development
  • Embodied cognition
  • Relations between action, space, cognition and language
Lectures; student presentations; practical exercises on how to analyze language as a multimodal phenomenon, project proposal writing, written exam (might be optional if project proposal is conducted as a small scale study with data collection and analysis).
Level

Presumed foreknowledge

Test information

Specifics

Recommended materials
Book
Title:Selected chapters to be announced.
Articles
Title:Selected articles to be announced.

Instructional modes
Lecture

Tests
paper presentation
Test weight25
Test typeOral exam
OpportunitiesBlock PER 4, Block PER 4

Minimum grade
5,5

research proposal
Test weight75
Test typeProject
OpportunitiesBlock PER 4, Block PER 4

Minimum grade
5,5