Recent evidence suggests that imagined auditory and visual sensory stimuli can be integrated with real sensory information from a different sensory modality to change the perception of external events via cross-modal multisensory integration mechanisms. Here, we explored whether imagined voluntary movements can integrate visual and proprioceptive cues to change how we perceive our own limbs in space. Participants viewed a robotic hand wearing a glove repetitively moving its right index finger up and down at a frequency of 1 Hz, while they imagined executing the corresponding movements synchronously or asynchronously (kinesthetic-motor imagery); electromyography (EMG) from the participants' right index flexor muscle confirmed that the participants kept their hand relaxed while imagining the movements.
View Article and Find Full Text PDFIEEE Trans Haptics
June 2020
In the real world, our bodies influence how we perceive ourselves and how others perceive us. Our body can also affect estimations of object sizes and distances. But how does our body affect our haptic experience? Here, we examined the modulation of a visuo-haptic illusion of touch on a virtual stick in virtual reality, when participants were embodied in an avatar and when they were not.
View Article and Find Full Text PDFDuring teleoperation and virtual reality experiences, enhanced haptic feedback incongruent with other sensory cues can reduce subjective realism, producing an uncanny valley of haptics.
View Article and Find Full Text PDFCan what we imagine in our minds change how we perceive the world in the future? A continuous process of multisensory integration and recalibration is responsible for maintaining a correspondence between the senses (e.g., vision, touch, audition) and, ultimately, a stable and coherent perception of our environment.
View Article and Find Full Text PDFAuditory spatial localization in humans is performed using a combination of interaural time differences, interaural level differences, as well as spectral cues provided by the geometry of the ear. To render spatialized sounds within a virtual reality (VR) headset, either individualized or generic Head Related Transfer Functions (HRTFs) are usually employed. The former require arduous calibrations, but enable accurate auditory source localization, which may lead to a heightened sense of presence within VR.
View Article and Find Full Text PDFConceptual self-awareness is a mental state in which the content of one's consciousness refers to a particular aspect of semantic knowledge about oneself. This form of consciousness plays a crucial role in shaping human behavior; however, little is known about its neural basis. Here, we use functional magnetic resonance imaging (fMRI) and a visual masked priming paradigm to dissociate the neural responses related to the awareness of semantic autobiographical information (one's own name, surname, etc.
View Article and Find Full Text PDFCan what we imagine hearing change what we see? Whether imagined sensory stimuli are integrated with external sensory stimuli to shape our perception of the world has only recently begun to come under scrutiny. Here, we made use of the cross-bounce illusion in which an auditory stimulus presented at the moment two passing objects meet promotes the perception that the objects bounce off rather than cross by one another to examine whether the content of imagined sound changes visual motion perception in a manner that is consistent with multisensory integration. The results from this study revealed that auditory imagery of a sound with acoustic properties typical of a collision (i.
View Article and Find Full Text PDFThe visual motion aftereffect is a visual illusion in which exposure to continuous motion in one direction leads to a subsequent illusion of visual motion in the opposite direction. Previous findings have been mixed with regard to whether this visual illusion can be induced cross-modally by auditory stimuli. Based on research on multisensory perception demonstrating the profound influence auditory perception can have on the interpretation and perceived motion of visual stimuli, we hypothesized that exposure to auditory stimuli with strong directional motion cues should induce a visual motion aftereffect.
View Article and Find Full Text PDFIt is well understood that the brain integrates information that is provided to our different senses to generate a coherent multisensory percept of the world around us (Stein and Stanford, 2008), but how does the brain handle concurrent sensory information from our mind and the external world? Recent behavioral experiments have found that mental imagery--the internal representation of sensory stimuli in one's mind--can also lead to integrated multisensory perception (Berger and Ehrsson, 2013); however, the neural mechanisms of this process have not yet been explored. Here, using functional magnetic resonance imaging and an adapted version of a well known multisensory illusion (i.e.
View Article and Find Full Text PDFMultisensory interactions are the norm in perception, and an abundance of research on the interaction and integration of the senses has demonstrated the importance of combining sensory information from different modalities on our perception of the external world. However, although research on mental imagery has revealed a great deal of functional and neuroanatomical overlap between imagery and perception, this line of research has primarily focused on similarities within a particular modality and has yet to address whether imagery is capable of leading to multisensory integration. Here, we devised novel versions of classic multisensory paradigms to systematically examine whether imagery is capable of integrating with perceptual stimuli to induce multisensory illusions.
View Article and Find Full Text PDFIt has been proposed that incompatible intentions (e.g., to inhale and not inhale while holding one's breath while underwater) are an essential ingredient of conscious conflict.
View Article and Find Full Text PDFA primary aspect of the self is the sense of agency – the sense that one is causing an action. In the spirit of recent reductionistic approaches to other complex, multifaceted phenomena (e.g.
View Article and Find Full Text PDFCan one be fooled into believing that one intended an action that one in fact did not intend? Past experimental paradigms have demonstrated that participants, when provided with false perceptual feedback about their actions, can be fooled into misperceiving the nature of their intended motor act. However, because veridical proprioceptive/perceptual feedback limits the extent to which participants can be fooled, few studies have been able to answer our question and induce the illusion to intend. In a novel paradigm addressing this question, participants were instructed to move a line on the computer screen by use of a phony brain-computer interface.
View Article and Find Full Text PDFAtten Percept Psychophys
November 2009
Although research on cognitive control has addressed the effects that different forms of cognitive interference have on behavior and the activities of certain brain regions, until recently, the effects of interference on subjective experience have not been addressed. We demonstrate that, at the level of the individual trial, participants can reliably introspect the subjective aspects (e.g.
View Article and Find Full Text PDF