Reduced efficiency of audiovisual integration for nonnative speech.

J Acoust Soc Am

Department of Communication Sciences & Disorders, The University of Texas at Austin, 2504A Whitis Avenue (A1100), Austin, Texas 78712

Published: November 2013

AI Article Synopsis

  • The study explores how visual cues affect native English speakers' understanding of speech from nonnative Korean speakers.
  • It finds that native listeners perceive Korean-accented speech as more accented when visual cues are present, compared to when they only hear the audio.
  • The research suggests that visual biases among listeners can hinder their ability to integrate audiovisual information effectively, particularly with nonnative accents.

Article Abstract

The role of visual cues in native listeners' perception of speech produced by nonnative speakers has not been extensively studied. Native perception of English sentences produced by native English and Korean speakers in audio-only and audiovisual conditions was examined. Korean speakers were rated as more accented in audiovisual than in the audio-only condition. Visual cues enhanced word intelligibility for native English speech but less so for Korean-accented speech. Reduced intelligibility of Korean-accented audiovisual speech was associated with implicit visual biases, suggesting that listener-related factors partially influence the efficiency of audiovisual integration for nonnative speech perception.

Download full-text PDF

Source
http://dx.doi.org/10.1121/1.4822320DOI Listing

Publication Analysis

Top Keywords

efficiency audiovisual
8
audiovisual integration
8
integration nonnative
8
nonnative speech
8
visual cues
8
native english
8
korean speakers
8
speech
6
audiovisual
5
reduced efficiency
4

Similar Publications

Audiovisual Breathing Guidance for Improved Image Quality and Scan Efficiency of T2- and Diffusion-Weighted Liver MRI.

Invest Radiol

January 2025

From the Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Bonn, Germany (N.M., A.I., A.L., L.B., T.D., D. Kravchenko, D. Kuetting, C.C.P., J.A.L.); Quantitative Imaging Lab Bonn (QILaB), Bonn, Germany (N.M., A.I., L.B., D. Kravchenko, D. Kuetting, J.A.L.); Philips Healthcare, Hamburg, Germany (C.K.); Philips Medical Systems, Eindhoven, the Netherlands (A.H.-M.); and Department of Diagnostic and Interventional Radiology, University Hospital Aachen, Aachen, Germany (C.Y.).

Objectives: Impaired image quality and long scan times frequently occur in respiratory-triggered sequences in liver magnetic resonance imaging (MRI). We evaluated the impact of an in-bore active breathing guidance (BG) application on image quality and scan time of respiratory-triggered T2-weighted (T2) and diffusion-weighted imaging (DWI) by comparing sequences with standard triggering (T2S and DWIS) and with BG (T2BG and DWIBG).

Materials And Methods: In this prospective study, random patients with clinical indications for liver MRI underwent 3 T MRI with standard and BG acquisitions.

View Article and Find Full Text PDF

Task-irrelevant sounds that are semantically congruent with the target can facilitate performance in visual search tasks, resulting in faster search times. In three experiments, we tested the underlying processes of this effect. Participants were presented with auditory primes that were semantically congruent, neutral, or incongruent to the visual search target, and importantly, we varied the set size of the search displays.

View Article and Find Full Text PDF

The power of sound: Exploring the auditory influence on visual search efficiency.

Cognition

December 2024

School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian 116029, China; School of Foreign Languages, Ningbo University of Technology, Ningbo 315211, China. Electronic address:

In a dynamic visual search environment, a synchronous and meaningless auditory signal (pip) that corresponds with a change in a visual target promotes the efficiency of visual search (pop out), which is known as the pip-and-pop effect. We conducted three experiments to investigate the mechanism of the pip-and-pop effect. Using the eye movement technique, we manipulated the interval rhythm (Exp.

View Article and Find Full Text PDF

While the pig industry is crucial in global meat consumption, accounting for 34% of total consumption, respiratory diseases in pigs can cause substantial economic losses to pig farms. To alleviate this issue, we propose an advanced audio-visual monitoring system for the early detection of coughing, a key symptom of respiratory diseases in pigs, that will enhance disease management and animal welfare. The proposed system is structured into three key modules: the cough sound detection (CSD) module, which detects coughing sounds using audio data; the pig object detection (POD) module, which identifies individual pigs in video footage; and the coughing pig detection (CPD) module, which pinpoints which pigs are coughing among the detected pigs.

View Article and Find Full Text PDF

In recent times, characterized by the rapid advancement of science and technology, the educational system has continuously evolved. Within this modern educational landscape, Science, Technology, Engineering, Arts, and Mathematics (STEAM) education has emerged as a prominent pedagogical paradigm, gaining substantial popularity in college-level instruction and capturing widespread societal attention. Notably, the cultivation of audio-visual aesthetic proficiency occupies a central role within this educational approach, prioritizing the enhancement of aesthetic sensibilities.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!