People's everyday lives offer plenty of situations where complex processing of information takes place, in which information needs to transfer across modalities to achieve a behavioral goal. The study examined the differential effects on object detection by a visual, verbal, or auditory cue held in working memory (WM), and the role of concurrent cognitive task-load on the final detection of that cue. Three experiments, all using same stimuli set but in different modalities, subjects held in memory a representation of a novel cue for a speeded detection in a search display at the end of each trial. The cue stimulus could be an image (visual), the name (verbal) or the sound (auditory) of a common animal or object. A mental arithmetic task was interleaved between the cue presentation and the cue detection. The results showed that information held in WM, either in verbal or auditory form, can efficiently transfer across modalities to complete a visual detection task for a representation of the initial WM-cue. The speed of detection was not affected by the cross-modal transfer of cue information but there was some detrimental effect on detection that could distinctively be attributed to the cognitive task-load. Together, these findings may provide some evidence for the role of the episodic buffer component of WM in integrating multimodal information originated from different sources, hence supporting the notion of the supramodal nature of WM. The results have been discussed in light of Baddeley's and Cowan's theoretical WM frameworks. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1037/xlm0000715 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Unsupervised Sim-to-Real Adaptation of Soft Robot Proprioception Using a Dual Cross-Modal Autoencoder.
Soft Robot
January 2025
Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Republic of Korea.
Data-driven calibration methods have shown promising results for accurate proprioception in soft robotics. This process can be greatly benefited by adopting numerical simulation for computational efficiency. However, the gap between the simulated and real domains limits the accurate, generalized application of the approach.
View Article and Find Full Text PDFA foundation model with weak experiential guidance in detecting muscle invasive bladder cancer on MRI.
Cancer Lett
January 2025
Department of Radiology, The First Affiliated Hospital of Nanjing Medical University, Nanjing, Jiangsu Province, 210029, PR China; The Affiliated Suqian First People's Hospital of Nanjing Medical University, Suqian, Jiangsu Province, PR China. Electronic address:
Preoperative detection of muscle-invasive bladder cancer (MIBC) remains a great challenge in practice. We aimed to develop and validate a deep Vesical Imaging Network (ViNet) model for the detection of MIBC using high-resolution Tweighted MR imaging (hrTWI) in a multicenter cohort. ViNet was designed using a modified 3D ResNet, in which, the encoder layers were pretrained using a self-supervised foundation model on over 40,000 cross-modal imaging datasets for transfer learning, and the classification modules were weakly supervised by an experiential knowledge-domain mask indicated by a nnUNet segmentation model.
View Article and Find Full Text PDFMulti-modal cross-domain self-supervised pre-training for fMRI and EEG fusion.
Neural Netw
December 2024
Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA 18015, USA; Department of Bioengineering, Lehigh University, Bethlehem, PA 18015, USA. Electronic address:
Neuroimaging techniques including functional magnetic resonance imaging (fMRI) and electroencephalogram (EEG) have shown promise in detecting functional abnormalities in various brain disorders. However, existing studies often focus on a single domain or modality, neglecting the valuable complementary information offered by multiple domains from both fMRI and EEG, which is crucial for a comprehensive representation of disorder pathology. This limitation poses a challenge in effectively leveraging the synergistic information derived from these modalities.
View Article and Find Full Text PDFL2G: Repurposing Language Models for Genomics Tasks.
bioRxiv
December 2024
Machine Learning Department, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA.
Pre-trained language models have transformed the field of natural language processing (NLP), and their success has inspired efforts in genomics to develop domain-specific foundation models (FMs). However, creating high-quality genomic FMs from scratch is resource-intensive, requiring significant computational power and high-quality pre-training data. The success of large language models (LLMs) in NLP has largely been driven by industrial-scale efforts leveraging vast, diverse corpora and massive computing infrastructure.
View Article and Find Full Text PDFDelayed knowledge transfer: Cross-modal knowledge transfer from delayed stimulus to EEG for continuous attention detection based on spike-represented EEG signals.
Neural Netw
March 2025
WAVES Research Group, Department of Information Technology, Ghent University, Gent, Belgium. Electronic address:
Decoding visual and auditory stimuli from brain activities, such as electroencephalography (EEG), offers promising advancements for enhancing machine-to-human interaction. However, effectively representing EEG signals remains a significant challenge. In this paper, we introduce a novel Delayed Knowledge Transfer (DKT) framework that employs spiking neurons for attention detection, using our experimental EEG dataset.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!