Gesture and speech integration: an exploratory study of a man with aphasia.

Int J Lang Commun Disord

Language and Communication Science, City University, London, UK.

Published: May 2010

Background: In order to comprehend fully a speaker's intention in everyday communication, information is integrated from multiple sources, including gesture and speech. There are no published studies that have explored the impact of aphasia on iconic co-speech gesture and speech integration.

Aims: To explore the impact of aphasia on co-speech gesture and speech integration in one participant with aphasia and 20 age-matched control participants.

Methods & Procedures: The participant with aphasia and 20 control participants watched video vignettes of people producing 21 verb phrases in three different conditions, verbal only (V), gesture only (G), and verbal gesture combined (VG). Participants were required to select a corresponding picture from one of four alternatives: integration target, a verbal-only match, a gesture-only match, and an unrelated foil. The probability of choosing the integration target in the VG that goes beyond what is expected from the probabilities of choosing the integration target in V and G was referred to as multi-modal gain (MMG).

Outcomes & Results: The participant with aphasia obtained a significantly lower multi-modal gain score than the control participants (p<0.05). Error analysis indicated that in speech and gesture integration tasks, the participant with aphasia relied on gesture in order to decode the message, whereas the control participants relied on speech in order to decode the message. Further analysis of the speech-only and gesture-only tasks indicated that the participant with aphasia had intact gesture comprehension but impaired spoken word comprehension.

Conclusions & Implications: The results confirm findings by Records ( 1994 ) that reported that impaired verbal comprehension leads to a greater reliance on gesture to decode messages. Moreover, multi-modal integration of information from speech and iconic gesture can be impaired in aphasia. The findings highlight the need for further exploration of the impact of aphasia on gesture and speech integration.

Download full-text PDF

Source
http://dx.doi.org/10.1080/13682820802256965DOI Listing

Publication Analysis

Top Keywords

gesture speech
16
participant aphasia
12
integration target
12
speech integration
8
impact aphasia
8
co-speech gesture
8
control participants
8
verbal gesture
8
choosing integration
8
multi-modal gain
8

Similar Publications

Value Added by Assessing Nonspoken Vocabulary in Minimally Speaking Autistic Children.

Am J Speech Lang Pathol

January 2025

School of Communication Sciences and Disorders, McGill University, Montreal, Quebec, Canada.

Purpose: There is a scarcity of language assessment tools properly adapted for use with minimally speaking autistic children. As these children often use nonspoken methods of communication (i.e.

View Article and Find Full Text PDF

Syllable as a Synchronization Mechanism That Makes Human Speech Possible.

Brain Sci

December 2024

Department of Speech, Hearing and Phonetic Sciences, Division of Psychology and Language Sciences, University College London, Chandler House 2 Wakefield Street, London WC1N 1PF, UK.

Speech is a highly skilled motor activity that shares a core problem with other motor skills: how to reduce the massive degrees of freedom (DOF) to the extent that the central nervous control and learning of complex motor movements become possible. It is hypothesized in this paper that a key solution to the DOF problem is to eliminate most of the temporal degrees of freedom by synchronizing concurrent movements, and that this is performed in speech through the syllable-a mechanism that synchronizes consonantal, vocalic, and laryngeal gestures. Under this hypothesis, syllable articulation is enabled by three basic mechanisms: target approximation, edge-synchronization, and tactile anchoring.

View Article and Find Full Text PDF

The dataset represents a significant advancement in Bengali lip-reading and visual speech recognition research, poised to drive future applications and technological progress. Despite Bengali's global status as the seventh most spoken language with approximately 265 million speakers, linguistically rich and widely spoken languages like Bengali have been largely overlooked by the research community. fills this gap by offering a pioneering dataset tailored for Bengali lip-reading, comprising visual data from 150 speakers across 54 classes, encompassing Bengali phonemes, alphabets, and symbols.

View Article and Find Full Text PDF

Examining Concurrent Associations Between Gesture Use, Developmental Domains, and Autistic Traits in Toddlers With Down Syndrome.

J Speech Lang Hear Res

January 2025

Down Syndrome Program, Division of Developmental Medicine, Department of Pediatrics, Boston Children's Hospital, Harvard Medical School, MA.

Purpose: Toddlers with Down syndrome (DS) showcase comparable or higher rates of gestures than chronological age- and language-matched toddlers without DS. Little is known about how gesture use in toddlers with DS relates to multiple domains of development, including motor, pragmatics, language, and visual reception (VR) skills. Unexplored is whether gesture use is a good marker of social communication skills in DS or if gesture development might be more reliably a marker of motor, language, pragmatics, or VR skills.

View Article and Find Full Text PDF

Despite increased attempts to express equality in speech, biases often leak out through subtle linguistic cues. For example, the subject-complement statement (SCS, "Girls are as good as boys at math") is used to advocate for equality but often reinforces gender stereotypes (boys are the standard against which girls are judged). We ask whether stereotypes conveyed by SCS can be counteracted by gesture.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!