LET-TWM411
Research Methods for Multimodal Language in Sign and Gesture
Course infoSchedule
Course moduleLET-TWM411
Credits (ECTS)5
Category-
Language of instructionEnglish
Offered byRadboud University; Faculty of Arts; Linguistics;
Lecturer(s)
Coordinator
prof. dr. H.A. Ozyurek
Other course modules lecturer
Lecturer
prof. dr. H.A. Ozyurek
Other course modules lecturer
Contactperson for the course
prof. dr. H.A. Ozyurek
Other course modules lecturer
Examiner
prof. dr. H.A. Ozyurek
Other course modules lecturer
Academic year2020
Period
PER 3-PER 4  (25/01/2021 to 31/08/2021)
Starting block
PER 3
Course mode
full-time
RemarksAccessible to exchange students.
Registration using OSIRISYes
Course open to students from other facultiesYes
Pre-registrationNo
Waiting listNo
Placement procedure-
Aims
This course will provide a hands-on introduction to the empirical study of multimodal communication. Using real data from experienced researchers in the field, the student will learn the different techniques and methodologies for the empirical and quantitative study of multimodal communication while keeping a strong theoretical framework. More specifically, the student will get training on the analysis of behavioural and naturalistic tasks in the realm of (i) multimodal language processing, (ii) sign language acquisition (L1/L2), and (iii) the relationship between language and cognition (iv) automatic recognition of bodily movements and speech. in real and virtual environments (e.g., Zoom)  This course complements the course Introduction to Multimodal Analysis and will give an additional set of skills that can be implemented in other language-related disciplines such as first and second language acquisition, language processing, language production and perception, amongst others.
Content
The last decades have seen an important shift in the study of language in that rather than focusing on speech only, scholars generally accept that human communication is multimodal in nature. Speakers consistently make use of bodily communicative actions that encode important information not present in speech -which are critical in fluid natural conversation- and play a critical role in first and second language acquisition. Also when looking at the sign languages of deaf communities, it is clear that the body is the main channel of communication with the same expressive power as spoken languages. Given these important theoretical advancements in the study of language, researchers have to develop the right methodological skills to overcome the challenges intrinsic to the study of sign and gesture in real and virtual environments.  How can we identify and segment different types of visual communication in naturalistic interactions in an objective way ? What are the state of the art automatic recognition techniques of multimodal language?  What are the statistical tools for sign and gesture research? What ethical considerations must be made to study multimodal communication in special populations (deaf signers, children, children with language impairments)? At the end of the course, students will have developed the skills to carry out a research project on one aspect of multimodal communication. More specifically they will be able to state a research question, carry out data collection, perform quantitative and statistical analysis, and interpret conclusions based on the data.
Level

Presumed foreknowledge

Test information

Specifics

Assumed previous knowledge
Only with permission from the coordinator of this course

Note for exchange students: you cannot take this course if your English proficiency level is not at least C1 (TOEFL, IELTS, TOEIC or Cambridge). A statement from your home university won't be accepted.

Required materials
Articles
Articles will be provided.

Instructional modes
Seminar

Tests
Research project
Test weight50
Test typeProject
OpportunitiesBlock PER 4, Block PER 4

Minimum grade
5,5

Oral presentation
Test weight20
Test typeOral exam
OpportunitiesBlock PER 4, Block PER 4

Minimum grade
5,5

Research proposal
Test weight20
Test typeProject
OpportunitiesBlock PER 4

Minimum grade
5,5

Participation
Test weight10
Test typeParticipation
OpportunitiesBlock PER 4

Minimum grade
0