Human EEG and Recurrent Neural Networks Exhibit Common Temporal Dynamics During Speech Recognition.

Recent deep-learning artificial neural networks have shown remarkable success in recognizing natural human speech, however the reasons for their success are not entirely understood. Success of these methods might be because state-of-the-art networks use recurrent layers or dilated convolutional layers that enable the network to use a time-dependent feature space. The importance of time-dependent features in human cortical mechanisms of speech perception, measured by electroencephalography (EEG) and magnetoencephalography (MEG), have also been of particular recent interest.

Brain electrical dynamics in speech segmentation depends upon prior experience with the language.

It remains unclear whether the process of speech tracking, which facilitates speech segmentation, reflects top-down mechanisms related to prior linguistic models or stimulus-driven mechanisms, or possibly both. To address this, we recorded electroencephalography (EEG) responses from native and non-native speakers of English that had different prior experience with the English language but heard acoustically identical stimuli. Despite a significant difference in the ability to segment and perceive speech, our EEG results showed that theta-band tracking of the speech envelope did not depend significantly on prior experience with language.

Speech Interaction to Control a Hands-Free Delivery Robot for High-Risk Health Care Scenarios.

The Covid-19 pandemic has had a widespread effect across the globe. The major effect on health-care workers and the vulnerable populations they serve has been of particular concern. Near-complete lockdown has been a common strategy to reduce the spread of the pandemic in environments such as live-in care facilities.

Phase of electroencephalography theta oscillation during stimulus encoding affects accuracy of memory recall.

Oscillatory activity is a ubiquitous property of brain signals, and yet relatively few studies have investigated how the phase of such ongoing oscillations affects our cognition. One of the main findings in this field is that the phase of electroencephalography (EEG) in the alpha band can affect perception of milliseconds-long stimuli. However, the importance of the phase of EEG for processing more naturalistic stimuli, which have a much longer duration, is still not clear.

The effects of distractor set-size on neural tracking of attended speech.

Attention is crucial to speech comprehension in real-world, noisy environments. Selective phase-tracking between low-frequency brain dynamics and the envelope of target speech is a proposed mechanism to reject competing distractors. Studies have supported this theory in the case of a single distractor, but have not considered how tracking is systematically affected by varying distractor set sizes.

The effects of periodic interruptions on cortical entrainment to speech.

Speech is perceived as a continuous stream of words despite consisting of a discontinuous, quasi-periodic signal of interleaved sounds and silences. Speech perception is surprisingly robust to interference by interruption, however speech that is replaced by gaps of silence is difficult to understand. When those silences are filled with noise, the speech is once again perceived as continuous even when the underlying speech sounds are removed completely.

Rendering visual events as sounds: Spatial attention capture by auditory augmented reality.

Many salient visual events tend to coincide with auditory events, such as seeing and hearing a car pass by. Information from the visual and auditory senses can be used to create a stable percept of the stimulus. Having access to related coincident visual and auditory information can help for spatial tasks such as localization.

Implicit Valuation of the Near-Miss is Dependent on Outcome Context.

Gambling studies have described a "near-miss effect" wherein the experience of almost winning increases gambling persistence. The near-miss has been proposed to inflate the value of preceding actions through its perceptual similarity to wins. We demonstrate here, however, that it acts as a conditioned stimulus to positively or negatively influence valuation, dependent on reward expectation and cognitive engagement.

Theta-band phase tracking in the two-talker problem.

It is usually easy to understand speech, but when several people are talking at once it becomes difficult. The brain must select one speech stream and ignore distracting streams. We tested a theory about the neural and computational mechanisms of attentional selection.

Brain dynamics encode the spectrotemporal boundaries of auditory objects.

Perception of objects in the scene around us is effortless and intuitive, yet entails profound computational challenges. Progress has been made in understanding some mechanisms by which the brain encodes the boundaries and surfaces of visual objects. However, in the auditory domain, these mechanisms are poorly understood.

Mental rotational ability is correlated with spatial but not verbal working memory performance and P300 amplitude in males.

This study investigated how both sex and individual differences in a mental rotation test (MRT) influence performance on working memory (WM). To identify the neural substrate supporting these differences, brain electrical activity was measured using the event-related potential technique. No significant sex differences were observed in a test of verbal WM, however males were significantly faster than females to respond to probe stimuli in a test of spatial WM.

Dynamics of distraction: competition among auditory streams modulates gain and disrupts inter-trial phase coherence in the human electroencephalogram.

Auditory distraction is a failure to maintain focus on a stream of sounds. We investigated the neural correlates of distraction in a selective-listening pitch-discrimination task with high (competing speech) or low (white noise) distraction. High-distraction impaired performance and reduced the N1 peak of the auditory Event-Related Potential evoked by probe tones.

Temporal variability of the N2pc during efficient and inefficient visual search.

Efficient and inefficient visual search are characterized by the difference in the time required to find the target. Efficient "popout" search time is relatively unaffected by increases in the number of search items, whereas inefficient "non-popout" search time requires more time increases in duration. Electrophysiological investigations of the neural correlates of visual search have revealed a component of the event-related potential (ERP) known as the N2pc.

Neural correlates of auditory distraction revealed in θ-band EEG.

Selective attention involves the exclusion of irrelevant information in order to optimize perception of a single source of sensory input; failure to do so often results in the familiar phenomenon of distraction. The term 'distraction' broadly refers to a perceptual phenomenon. In the present study we attempted to find the electrophysiological correlates of distraction using an auditory discrimination task.

Problem gamblers exhibit reward hypersensitivity in medial frontal cortex during gambling.

Problem gambling (PG) is increasingly conceptualized as an addiction akin to substance abuse, rather than an impulse control disorder, however the mechanism of addiction remains unclear. Neuroimaging investigations have supported a "reward deficiency" hypothesis for PG by suggesting a blunted response to gambling, particularly in the striatum. Here we describe electrophysiological evidence of a hypersensitive response to gambling feedback in problem gamblers.

A lateralized auditory evoked potential elicited when auditory objects are defined by spatial motion.

Scene analysis involves the process of segmenting a field of overlapping objects from each other and from the background. It is a fundamental stage of perception in both vision and hearing. The auditory system encodes complex cues that allow listeners to find boundaries between sequential objects, even when no gap of silence exists between them.

Selective attention modulates electrical responses to reversals of optic-flow direction.

Attended stimuli typically evoke larger event-related potentials (ERPs) than unattended stimuli. We previously reported an exception when an optic-flow pattern is interleaved with stationary dots. Reversals of motion direction evoked a larger N200 peak when attention was directed to the stationary dots.

Right frontal cortex generates reward-related theta-band oscillatory activity.

When participants in a gambling game are given feedback as to whether they won or lost the previous bet, a series of stereotypical brain electrical responses can be observed in the electroencephalogram (EEG) and the stimulus-locked Event-Related Potential (ERP). These include the Feedback-Related Mediofrontal Negativity (FRN), a posterior P300, and a feedback-induced increase in power at the theta (4 to 8 Hz) band over frontal scalp. Although the generators of the FRN and P300 have been studied previously, little is known about the generator of feedback-induced theta.

Attention modulates responses to motion reversals in human visual cortex.

Selective attention modulates brain responses in visual cortex. A common finding, using functional magnetic resonance imaging or event-related potentials, is that responses to attended relative to unattended stimuli are potentiated. We report an exceptional circumstance in a motion-processing paradigm.

Early phase of spatial mismatch negativity is localized to a posterior "where" auditory pathway.

The auditory mismatch negativity (MMN) is an event-related potential that reflects early processing of changes in acoustic stimulus features. Although the MMN has been well characterized by previous work, the number, roles, and anatomical locations of its cortical generators remain unresolved. Here, we report that the MMN elicited by occasional deviations in sound location is comprised of two temporally and anatomically distinct phases: an early phase with a generator posterior to auditory cortex and contralateral to the deviant stimulus, and a later phase with generators that are more frontal and bilaterally symmetric.

Spatial attention modulates activity in a posterior "where" auditory pathway.

Selectively listening to a single location in space modulates both the behavioral and electrophysiological responses to auditory stimuli presented at that location. Transient attention oriented in cue-target or target-target paradigms results in several modulations of the auditory event-related potential known as the Nd1, Nd2, and Nd3. By employing electrical source analysis we tested the hypothesis that the earliest component (the Nd1) reflects modulation of neurons in parietal rather than auditory cortex.

Event-related potential evidence for attentional inhibition of return in audition.

Orienting attention to a spatial location facilitates responding to a subsequent target at that location, but inhibits the response if attention is oriented away from that location before the target appears there. This inhibitory effect of attention re-orienting, called inhibition of return (IOR), occurs in vision, hearing, touch, and cross-modally, and has been well studied behaviorally. However, little is known about its underlying neural mechanism(s).

Attend to it now or lose it forever: selective attention, metacontrast masking, and object substitution.

Metacontrast masking occurs when the visibility of a brief target stimulus is decreased by the subsequent appearance of another nearby visual stimulus. Early explanations of the phenomenon involved low-level mechanisms, but subsequent studies have suggested a role for selective attention. The results of three experiments presented here extend previous findings to the metacontrast paradigm.