Suppose you want to order a drink in a busy pub or you are trying to explain something on a noisy train. You cannot always do this by just talking. Brouwer’s research has already shown that background speech influences intelligibility. Drijvers has also concluded in earlier research that iconic gestures - gestures that carry meaning and where the shape of the gesture indicates what you are talking about - are useful for making yourself clear in noisy environments.
Wilms combined these findings in a new experiment. She recorded 180 videos in which an actress says a short sentence in Dutch, such as ‘He is ready to pray’, or ‘She is very good at swimming’. “The last word was always an action verb; this verb was sometimes spoken by itself, or combined with an iconic gesture. The Dutch participants saw various videos with and without gestures. In the background, you could hear people speaking in Dutch or French, or nothing at all.”
Listener benefits
Wilms wanted to test the extent to which gestures actually help with understanding words and sentences while conversations are taking place in the background, and whether it makes a difference whether the mother tongue (Dutch) or a foreign language (French) is heard in the background. “Participants understood the verbs better when they were combined with a gesture than when no gesture was shown,” says Wilms. “Furthermore, participants found words easier to understand when there were French conversations in the background, rather than Dutch ones.” That is because the participants were familiar with Dutch and because the Dutch sentences and Dutch background noise are very similar. That is not the case with Dutch sentences and French background noise.
In cafés, restaurants, shops or at the market. There are a lot of situations in which this knowledge is useful. “Both speakers and listeners can benefit from this: speakers by gesticulating and listeners from paying attention to their interlocutor’s hands, particularly where conversations taking place in the background are in your mother tongue.”
Publication
‘The Effects of Iconic Gestures and Babble Language on Word Intelligibility in Sentence Context’, Veerle Wilms, Linda Drijvers en Susanne Brouwer, Journal of Speech, Language, and Hearing Research.
https://pubs.asha.org/doi/epdf/10.1044/2022_JSLHR-21-00387(verwijst naar een andere website)
For more information, please contact:
- Veerle Wilms, veerle.wilms [at] mpi.nl
- Science Communication at Radboud University, media [at] ru.nl (media[at]ru[dot]nl), +31 (0)24 361 6000