Most research on language takes speech as the main domain of investigation. However, in face to face communication we use language in a visual world. Speakers use not only speech but also meaningful hand movements called 'gestures' when they speak (pointing, iconic gestures etc). Furthermore, deaf communities use sign languages that are produced and perceived only in the visual-spatial modality. This course aims to give an interdisciplinary and state of the art overview of the role of the body and visual expression in the structuring, functioning and the development of the human language faculty. As such it offers a new window into our assumptions of language and its workings. The course will be presented in relation to discussions on embodied cognition and semantics, situated use of language, the links between language, action, space, memory, social cognition/interaction and their neural correlates. |
|
The course consists of several modules as described below:
Gestures in spoken language:
- Introduction to gesture basics - definitions; structure; theories
- The role of gestures in processing of language - production and comprehension
- The role of gestures in cognition (social, memory, imagery)
- The role of gestures in language acquisition and development (first, second, bilingual)
- The role of gestures in interaction (dialogue, common ground)
- Gestures and the brain
Sign Language:
- Introduction to sign language grammar
- Sign language processing/comparison with speech processing
- Acquisition of sign language (first, second, bimodal bilingual)
- Sign language and the brain
- Emerging language systems (in the wild/laboratory)
- The role of gesture or sign in language evolution
Broader significance:
- Situated language use
- Language development
- Embodied cognition
- Relations between action, space, cognition and language
Lectures; student presentations; practical exercises on how to analyze language as a multimodal phenomenon, project proposal writing, written exam (might be optional if project proposal is conducted as a small scale study with data collection and analysis).
|
|
|