Numerous studies have explored the benefit of iconic gestures in speech comprehension. However, only few studies have investigated how visual attention was allocated to these gestures in the context of clear versus degraded speech and the way information is extracted for enhancing comprehension. This study aimed to explore the effect of iconic gestures on comprehension and whether fixating the gesture is required for information extraction. Four types of gestures (i.e., semantically and syntactically incongruent iconic gestures, meaningless configurations, and congruent iconic gestures) were presented in a sentence context in three different listening conditions (i.e., clear, partly degraded or fully degraded speech). Using eye tracking technology, participants' gaze was recorded, while they watched video clips after which they were invited to answer simple comprehension questions. Results first showed that different types of gestures differently attract attention and that the more speech was degraded, the less participants would pay attention to gestures. Furthermore, semantically incongruent gestures appeared to particularly impair comprehension although not being fixated while congruent gestures appeared to improve comprehension despite also not being fixated. These results suggest that covert attention is sufficient to convey information that will be processed by the listener.
Download full-text PDF |
Source |
---|---|
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8669744 | PMC |
http://dx.doi.org/10.3389/fpsyg.2021.776867 | DOI Listing |
J Acoust Soc Am
January 2025
Department of Apparel and Space Design, Kyoto Women's University, Kyoto, Kyoto 605-8501, Japan.
Ever since de Saussure [Course in General Lingustics (Columbia University Press, 1916)], theorists of language have assumed that the relation between form and meaning of words is arbitrary. However, recently, a body of empirical research has established that language is embodied and contains iconicity. Sound symbolism, an intrinsic link language users perceive between word sound and properties of referents, is a representative example of iconicity in language and has offered profound insights into theories of language pertaining to language processing, language acquisition, and evolution.
View Article and Find Full Text PDFClin Linguist Phon
January 2025
BKV, Linköping University, Linköping, Sweden.
Gestures are essential in early language development. We investigate the use of gestures in children with cochlear implants (CIs), with a particular focus on deictic, iconic, and conventional gestures. The aim is to understand how the use of gestures in everyday interactions relates to age, vocabulary testing results, and language development reported by parents.
View Article and Find Full Text PDFInfancy
December 2024
Centre de Recherche en Psychologie et Neurosciences (CRPN), CNRS, Aix-Marseille Université, Marseille, France.
Speech and co-speech gestures always go hand in hand. Whether we find the precursors of these co-speech gestures in infants before they master their native language still remains an open question. Except for deictic gestures, there is little agreement on the existence of iconic, non-referential and conventional gestures before children start producing their first words.
View Article and Find Full Text PDFFront Hum Neurosci
November 2024
Department of Speech, Language and Hearing Sciences, Indiana University Bloomington, Bloomington, IN, United States.
Disabil Rehabil Assist Technol
October 2024
Chung Shan Medical University, Taichung, Taiwan.
. Unaided (e.g.
View Article and Find Full Text PDFEnter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!