Introduction: Temporal co-ordination between speech and gestures has been thoroughly studied in natural production. In most cases gesture strokes precede or coincide with the stressed syllable in words that they are semantically associated with.
Methods: To understand whether processing of speech and gestures is attuned to such temporal coordination, we investigated the effect of delaying, preposing or eliminating individual gestures on the memory for words in an experimental study in which 83 participants watched video sequences of naturalistic 3D-animated speakers generated based on motion capture data.
Digitally animated characters are promising tools in research studying how we integrate information from speech and visual sources such as gestures because they allow specific gesture features to be manipulated in isolation. We present an approach combining motion capture and 3D-animated characters that allows us to manipulate natural individual gesture strokes for experimental purposes, for example to temporally shift and present gestures in ecologically valid sequences. We exemplify how such stimuli can be used in an experiment investigating implicit detection of speech-gesture (a) synchrony, and discuss the general applicability of the workflow for research in this domain.
View Article and Find Full Text PDFAim: Seeing a speaker's face facilitates speech recognition, particularly under noisy conditions. Evidence for how it might affect comprehension of the content of the speech is more sparse. We investigated how children's listening comprehension is affected by multi-talker babble noise, with or without presentation of a digitally animated virtual speaker, and whether successful comprehension is related to performance on a test of executive functioning.
View Article and Find Full Text PDFThe present study aims at exploring the influence of voice quality on listening effort in children performing a language comprehension test with sentences of increasing difficulty. Listening effort is explored in relation to gender ( = cisgender). The study has a between-groups design.
View Article and Find Full Text PDFObjective: Previous studies suggest that dysphonic voices are perceived more negatively than typical voices, and it is possible that vocal perception influences academic achievement and comprehension. This study assessed children's subjective ratings and opinions of a typical and dysphonic voice after performing a language comprehension task in background noise. It also explored if subjective ratings were related to performance in the comprehension task.
View Article and Find Full Text PDFPurpose: This study aimed to explore if dysphonic voice quality affects children's performance on a language comprehension test, the Test for Reception of Grammar-2 (TROG-2), performed in simultaneous background noise (non-semantic babble). A further aim was to investigate the role of Working Memory Capacity (WMC) and Executive Functioning (EF) in coping with the voice against a background of babble conditions.
Method: Ninety-three mainstreamed 8 year old children with typical language development were tested for WMC and EF.
Purpose: A small number of studies have explored children's perception of speakers' voice quality and its possible influence on language comprehension. The aim of this explorative study was to investigate the relationship between the examiner's voice quality, the child's performance on a digital version of a language comprehension test, the Test for Reception of Grammar (TROG-2), and two measures of cognitive functioning.
Method: The participants were (n = 86) mainstreamed 8-year old children with typical language development.
The aim of this study was to examine the effects of speech rate on children's performance on a widely used language comprehension test, the Test for Reception of Grammar, version 2 (TROG'2), and to explore how test performance interacts with task difficulty and with the child's working memory capacity. Participants were 102 typically-developing Swedish-speaking children randomly assigned to one of the three conditions; the TROG'2 sentences spoken by a speech-language pathologist with slow, normal or fast speech rate. Results showed that the fast speech rate had a negative effect on the TROG'2 scores and that slow rate was more beneficial in general.
View Article and Find Full Text PDF