Deep Multimodal Representations and Classification of First-Episode Psychosis via Live Face Processing.

Schizophrenia is a severe psychiatric disorder associated with a wide range of cognitive and neurophysiological dysfunctions and long-term social difficulties. In this paper, we test the hypothesis that integration of multiple simultaneous acquisitions of neuroimaging, behavioral, and clinical information will be better for prediction of early psychosis than unimodal recordings. We propose a novel framework to investigate the neural underpinnings of the early psychosis symptoms (that can develop into Schizophrenia with age) using multimodal acquisitions of neural and behavioral recordings including functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG), and facial features.

Support vector machine prediction of individual Autism Diagnostic Observation Schedule (ADOS) scores based on neural responses during live eye-to-eye contact.

Social difficulties during interactions with others are central to autism spectrum disorder (ASD). Understanding the links between these social difficulties and their underlying neural processes is a primary aim focused on improved diagnosis and treatment. In keeping with this goal, we have developed a multivariate classification method based on neural data acquired by functional near infrared spectroscopy, fNIRS, during live eye-to-eye contact with adults who were either typically developed (TD) or individuals with ASD.

Activation in Right Dorsolateral Prefrontal Cortex Underlies Stuttering Anticipation.

People who stutter learn to anticipate many of their overt stuttering events. Despite the critical role of anticipation, particularly how responses to anticipation shape stuttering behaviors, the neural bases associated with anticipation are unknown. We used a novel approach to identify anticipated and unanticipated words, which were produced by 22 adult stutterers in a delayed-response task while hemodynamic activity was measured using functional near infrared spectroscopy (fNIRS).

Neural mechanisms for emotional contagion and spontaneous mimicry of live facial expressions.

Viewing a live facial expression typically elicits a similar expression by the observer (facial mimicry) that is associated with a concordant emotional experience (emotional contagion). The model of embodied emotion proposes that emotional contagion and facial mimicry are functionally linked although the neural underpinnings are not known. To address this knowledge gap, we employed a live two-person paradigm ( = 20 dyads) using functional near-infrared spectroscopy during live emotive face-processing while also measuring eye-tracking, facial classifications and ratings of emotion.

Rejection Distress Suppresses Medial Prefrontal Cortex in Borderline Personality Disorder.

Background: Borderline personality disorder (BPD) is characterized by an elevated distress response to social exclusion (i.e., rejection distress), the neural mechanisms of which remain unclear.

Neural and visual processing of social gaze cueing in typical and ASD adults.

Unlabelled: Atypical eye gaze in joint attention is a clinical characteristic of autism spectrum disorder (ASD). Despite this documented symptom, neural processing of joint attention tasks in real-life social interactions is not understood. To address this knowledge gap, functional-near infrared spectroscopy (fNIRS) and eye-tracking data were acquired simultaneously as ASD and typically developed (TD) individuals engaged in a gaze-directed joint attention task with a live human and robot partner.

Volume of subcortical brain regions in social anxiety disorder: mega-analytic results from 37 samples in the ENIGMA-Anxiety Working Group.

There is limited convergence in neuroimaging investigations into volumes of subcortical brain regions in social anxiety disorder (SAD). The inconsistent findings may arise from variations in methodological approaches across studies, including sample selection based on age and clinical characteristics. The ENIGMA-Anxiety Working Group initiated a global mega-analysis to determine whether differences in subcortical volumes can be detected in adults and adolescents with SAD relative to healthy controls.

Neural correlates of eye contact and social function in autism spectrum disorder.

Reluctance to make eye contact during natural interactions is a central diagnostic criterion for autism spectrum disorder (ASD). However, the underlying neural correlates for eye contacts in ASD are unknown, and diagnostic biomarkers are active areas of investigation. Here, neuroimaging, eye-tracking, and pupillometry data were acquired simultaneously using two-person functional near-infrared spectroscopy (fNIRS) during live "in-person" eye-to-eye contact and eye-gaze at a video face for typically-developed (TD) and participants with ASD to identify the neural correlates of live eye-to-eye contact in both groups.

Optical imaging and spectroscopy for the study of the human brain: status report.

This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.

Investigation of functional near-infrared spectroscopy signal quality and development of the hemodynamic phase correlation signal.

There is a longstanding recommendation within the field of fNIRS to use oxygenated ( ) and deoxygenated (HHb) hemoglobin when analyzing and interpreting results. Despite this, many fNIRS studies do focus on only. Previous work has shown that on its own is susceptible to systemic interference and results may mostly reflect that rather than functional activation.

Decreased Exercise-Induced Changes in Prefrontal Cortex Hemodynamics Are Associated With Depressive Symptoms.

People with a depressed mood tend to perform poorly on executive function tasks, which require much of the prefrontal cortex (PFC), an area of the brain which has also been shown to be hypo-active in this population. Recent research has suggested that these aspects of cognition might be improved through physical activity and cognitive training. However, whether the acute effects of exercise on PFC activation during executive function tasks vary with depressive symptoms remains unclear.

An Approach to Neuroimaging Interpersonal Interactions in Mental Health Interventions.

Background: Conventional paradigms in clinical neuroscience tend to be constrained in terms of ecological validity, raising several challenges to studying the mechanisms mediating treatments and outcomes in clinical settings. Addressing these issues requires real-world neuroimaging techniques that are capable of continuously collecting data during free-flowing interpersonal interactions and that allow for experimental designs that are representative of the clinical situations in which they occur.

Methods: In this work, we developed a paradigm that fractionates the major components of human-to-human verbal interactions occurring in clinical situations and used functional near-infrared spectroscopy to assess the brain systems underlying clinician-client discourse (N = 30).

Bidirectional Connectivity Between Broca's Area and Wernicke's Area During Interactive Verbal Communication.

This investigation aims to advance the understanding of neural dynamics that underlies live and natural interactions during spoken dialogue between two individuals. The underlying hypothesis is that functional connectivity between canonical speech areas in the human brain will be modulated by social interaction. Granger causality was applied to compare directional connectivity across Broca's and Wernicke's areas during verbal conditions consisting of interactive and noninteractive communication.

Comparison of short-channel separation and spatial domain filtering for removal of non-neural components in functional near-infrared spectroscopy signals.

With the increasing popularity of functional near-infrared spectroscopy (fNIRS), the need to determine localization of the source and nature of the signals has grown. We compare strategies for removal of non-neural signals for a finger-thumb tapping task, which shows responses in contralateral motor cortex and a visual checkerboard viewing task that produces activity within the occipital lobe. We compare temporal regression strategies using short-channel separation to a spatial principal component (PC) filter that removes global signals present in all channels.

Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot.

Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen.

Interpersonal Agreement and Disagreement During Face-to-Face Dialogue: An fNIRS Investigation.

Although the neural systems that underlie spoken language are well-known, how they adapt to evolving social cues during natural conversations remains an unanswered question. In this work we investigate the neural correlates of face-to-face conversations between two individuals using functional near infrared spectroscopy (fNIRS) and acoustical analyses of concurrent audio recordings. Nineteen pairs of healthy adults engaged in live discussions on two controversial topics where their opinions were either in agreement or disagreement.

Facial and neural mechanisms during interactive disclosure of biographical information.

Pairs of participants mutually communicated (or not) biographical information to each other. By combining simultaneous eye-tracking, face-tracking and functional near-infrared spectroscopy, we examined how this mutual sharing of information modulates social signalling and brain activity. When biographical information was disclosed, participants directed more eye gaze to the face of the partner and presented more facial displays.

Neural processes for live pro-social dialogue between dyads with socioeconomic disparity.

An emerging theoretical framework suggests that neural functions associated with stereotyping and prejudice are associated with frontal lobe networks. Using a novel neuroimaging technique, functional near-infrared spectroscopy (fNIRS), during a face-to-face live communication paradigm, we explore an extension of this model to include live dynamic interactions. Neural activations were compared for dyads of similar and dissimilar socioeconomic backgrounds.

Joint Attention During Live Person-to-Person Contact Activates rTPJ, Including a Sub-Component Associated With Spontaneous Eye-to-Eye Contact.

Eye-to-eye contact is a spontaneous behavior between interacting partners that occurs naturally during social interactions. However, individuals differ with respect to eye gaze behaviors such as frequency of eye-to-eye contacts, and these variations may reflect underlying differences in social behavior in the population. While the use of eye signaling to indicate a shared object of attention in joint attention tasks has been well-studied, the effects of the natural variation in establishing eye contact during joint attention have not been isolated.

Optimization of wavelet coherence analysis as a measure of neural synchrony during hyperscanning using functional near-infrared spectroscopy.

The expanding field of human social interaction is enabled by functional near-infrared spectroscopy (fNIRS) that acquires hemodynamic signals during live two-person interactions. These advances call for development of methods to quantify interactive processes. Wavelet coherence analysis has been applied to cross-brain neural coupling.

Real-Time Eye-to-Eye Contact Is Associated With Cross-Brain Neural Coupling in Angular Gyrus.

Direct eye contact between two individuals is a salient social behavior known to initiate and promote interpersonal interaction. However, the neural processes that underlie these live interactive behaviors and eye-to-eye contact are not well understood. The Dynamic Neural Coupling Hypothesis presents a general theoretical framework proposing that shared interactive behaviors are represented by cross-brain signal coherence.

Co-localization of theta-band activity and hemodynamic responses during face perception: simultaneous electroencephalography and functional near-infrared spectroscopy recordings.

Face-specific neural processes in the human brain have been localized to multiple anatomical structures and associated with diverse and dynamic social functions. The question of how various face-related systems and functions may be bound together remains an active area of investigation. We hypothesize that face processing may be associated with specific frequency band oscillations that serve to integrate distributed face processing systems.

Remote photonic sensing of cerebral hemodynamic changes via temporal spatial analysis of acoustic vibrations.

A novel photonic method for remote monitoring of task-related hemodynamic changes in human brain activation is presented. Physiological processes associated with neural activity, such as nano-vibrations due to blood flow and tissue oxygenation in the brain, are detected by remote sensing of nano-acoustic vibrations using temporal spatial analysis of defocused self-interference random patterns. Temporal nanometric changes of the speckle pattern due to visual task-induced hemodynamic responses were tracked by this method.

A Review on the Use of Wearable Functional Near-Infrared Spectroscopy in Naturalistic Environments.

The development of novel miniaturized wireless and wearable functional Near-Infrared Spectroscopy (fNIRS) devices have paved the way to new functional brain imaging that can revolutionize the cognitive research fields. Over the past few decades, several studies have been conducted with conventional fNIRS systems that have demonstrated the suitability of this technology for a wide variety of populations and applications, to investigate both the healthy brain and the diseased brain. However, what makes wearable fNIRS even more appealing is its capability to allow measurements in everyday life scenarios that are not possible with other gold-standard neuroimaging modalities, such as functional Magnetic Resonance Imaging.