We hypothesize that brain activity can be used to control future information retrieval systems. To this end, we conducted a feasibility study on predicting the relevance of visual objects from brain activity. We analyze both magnetoencephalographic (MEG) and gaze signals from nine subjects who were viewing image collages, a subset of which was relevant to a predetermined task. We report three findings: i) the relevance of an image a subject looks at can be decoded from MEG signals with performance significantly better than chance, ii) fusion of gaze-based and MEG-based classifiers significantly improves the prediction performance compared to using either signal alone, and iii) non-linear classification of the MEG signals using Gaussian process classifiers outperforms linear classification. These findings break new ground for building brain-activity-based interactive image retrieval systems, as well as for systems utilizing feedback both from brain activity and eye movements.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.neuroimage.2014.12.079 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Human cortical high-gamma power scales with movement rate in healthy participants and stroke survivors.
J Physiol
January 2025
Department of Neurology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
Motor cortical high-gamma oscillations (60-90 Hz) occur at movement onset and are spatially focused over the contralateral primary motor cortex. Although high-gamma oscillations are widely recognized for their significance in human motor control, their precise function on a cortical level remains elusive. Importantly, their relevance in human stroke pathophysiology is unknown.
View Article and Find Full Text PDFRepairbads: An automatic and adaptive method to repair bad channels and segments for OPM-MEG.
Neuroimage
January 2025
Key Laboratory of Ultra-Weak Magnetic Field Measurement Technology, Ministry of Education, School of Instrumentation and Optoelectronic Engineering, Beihang University, 100191, Beijing, China; Hangzhou Institute of Extremely-Weak Magnetic Field Major National Science and Technology Infrastructure, Hangzhou, 310051, China; State Key Laboratory of Traditional Chinese Medicine Syndrome/Health Construction Center, The Second Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, 510120, China; Hefei National Laboratory, Hefei, 230088, China. Electronic address:
The optically pumped magnetometer (OPM) based magnetoencephalography (MEG) system offers advantages such as flexible layout and wearability. However, the position instability or jitter of OPM sensors can result in bad channels and segments, which significantly impede subsequent preprocessing and analysis. Most common methods directly reject or interpolate to repair these bad channels and segments.
View Article and Find Full Text PDFCost-Reference Particle Filter-Based Method for Constructing Effective Brain Networks: Application in Optically Pumped Magnetometer Magnetoencephalography.
Bioengineering (Basel)
December 2024
Key Laboratory of Ultra-Weak Magnetic Field Measurement Technology, Ministry of Education, School of Instrumentation and Optoelectronic Engineering, Beihang University, 37 Xueyuan Rd., Haidian District, Beijing 100083, China.
Optically pumped magnetometer magnetoencephalography (OPM-MEG) represents a novel method for recording neural signals in the brain, offering the potential to measure critical neuroimaging characteristics such as effective brain networks. Effective brain networks describe the causal relationships and information flow between brain regions. In constructing effective brain networks using Granger causality, the noise in the multivariate autoregressive model (MVAR) is typically assumed to follow a Gaussian distribution.
View Article and Find Full Text PDFExtended homogeneous field correction method based on oblique projection in OPM-MEG.
Neuroimage
January 2025
Key Laboratory of Ultra-Weak Magnetic Field Measurement Technology, Ministry of Education, School of Instrumentation and Optoelectronic Engineering, Beihang University, 100191, Beijing, China; Hangzhou Institute of Extremely-Weak Magnetic Field Major National Science and Technology Infrastructure, Hangzhou, 310051, China; State Key Laboratory of Traditional Chinese Medicine Syndrome/Health Construction Center, The Second Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, 510120, China; Hefei National Laboratory, Hefei, 230088, China. Electronic address:
Article Synopsis
- OPM-MEG is a new non-invasive imaging technique that improves sensor flexibility but requires better noise suppression due to environmental factors.
- Existing methods like homogeneous field correction (HFC) and spatiotemporal extended HFC (teHFC) have limitations in dealing with complex noise.
- The proposed oblique projection method (opHFC) enhances noise suppression by accommodating non-orthogonal signal and noise subspaces, leading to improved signal quality in OPM-MEG applications.
Time Course of Orientation Ensemble Representation in the Human Brain.
J Neurosci
January 2025
School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, People's Republic of China
Natural scenes are filled with groups of similar items. Humans employ ensemble coding to extract the summary statistical information of the environment, thereby enhancing the efficiency of information processing, something particularly useful when observing natural scenes. However, the neural mechanisms underlying the representation of ensemble information in the brain remain elusive.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!