EEG-based auditory attention decoding with audiovisual speech for hearing-impaired listeners.

Cereb Cortex

Speech and Hearing Research Center, Key Laboratory of Machine Perception (Ministry of Education), School of Intelligence Science and Technology, Peking University, Beijing 100871, China.

Published: November 2023

Auditory attention decoding (AAD) was used to determine the attended speaker during an auditory selective attention task. However, the auditory factors modulating AAD remained unclear for hearing-impaired (HI) listeners. In this study, scalp electroencephalogram (EEG) was recorded with an auditory selective attention paradigm, in which HI listeners were instructed to attend one of the two simultaneous speech streams with or without congruent visual input (articulation movements), and at a high or low target-to-masker ratio (TMR). Meanwhile, behavioral hearing tests (i.e. audiogram, speech reception threshold, temporal modulation transfer function) were used to assess listeners' individual auditory abilities. The results showed that both visual input and increasing TMR could significantly enhance the cortical tracking of the attended speech and AAD accuracy. Further analysis revealed that the audiovisual (AV) gain in attended speech cortical tracking was significantly correlated with listeners' auditory amplitude modulation (AM) sensitivity, and the TMR gain in attended speech cortical tracking was significantly correlated with listeners' hearing thresholds. Temporal response function analysis revealed that subjects with higher AM sensitivity demonstrated more AV gain over the right occipitotemporal and bilateral frontocentral scalp electrodes.

Download full-text PDF

Source
http://dx.doi.org/10.1093/cercor/bhad325DOI Listing

Publication Analysis

Top Keywords

cortical tracking
12
attended speech
12
auditory attention
8
attention decoding
8
hearing-impaired listeners
8
auditory selective
8
selective attention
8
visual input
8
analysis revealed
8
gain attended
8

Similar Publications

Historically, electrophysiological correlates of scene processing have been studied with experiments using static stimuli presented for discrete timescales where participants maintain a fixed eye position. Gaps remain in generalizing these findings to real-world conditions where eye movements are made to select new visual information and where the environment remains stable but changes with our position and orientation in space, driving dynamic visual stimulation. Co-recording of eye movements and electroencephalography (EEG) is an approach to leverage fixations as time-locking events in the EEG recording under free-viewing conditions to create fixation-related potentials (FRPs), providing a neural snapshot in which to study visual processing under naturalistic conditions.

View Article and Find Full Text PDF

Background: Biomarkers are needed to track progression in MS trials. Neurofilament heavy chain (NfH) has been underutilized due to assay limitations.

Objective: To investigate the added value of cerebrospinal fluid (CSF) NfH in secondary progressive multiple sclerosis (SPMS) using contemporary immunoassays.

View Article and Find Full Text PDF

Amplitude compression is an indispensable feature of contemporary audio production and especially relevant in modern hearing aids. The cortical fate of amplitude-compressed speech signals is not well-studied, however, and may yield undesired side effects: We hypothesize that compressing the amplitude envelope of continuous speech reduces neural tracking. Yet, leveraging such a 'compression side effect' on unwanted, distracting sounds could potentially support attentive listening if effectively reducing their neural tracking.

View Article and Find Full Text PDF

A Descriptive Analysis of the Seasonal Patterns of Bone Stress Injury Incidence in Division I Collegiate Distance Runners.

Am J Sports Med

January 2025

Department of Orthopaedic Surgery, Division of Physical Medicine and Rehabilitation, Stanford University, Stanford, California, USA.

Background: A bone stress injury (BSI) is a common overuse injury in collegiate athletes, particularly cross-country and track and field runners. Limited work describes the seasonality of BSIs or the differences in rates and anatomic locations of BSIs in collegiate runners.

Purpose: To describe seasonally related trends in anatomic locations of BSIs in National Collegiate Athletic Association (NCAA) Division I male and female middle- and long-distance runners.

View Article and Find Full Text PDF

Human cerebral organoids serve as a quintessential model for deciphering the complexities of brain development in a three-dimensional milieu. However, imaging these organoids, particularly when they exceed several millimeters in size, has been curtailed by the technical impediments such as phototoxicity, slow imaging speeds, and inadequate resolution and imaging depth. Addressing these pivotal challenges, our study has pioneered a high-speed scanning microscope, synergistically coupled with advanced computational image processing.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!