Identification of walked-upon materials in auditory, kinesthetic, haptic, and audio-haptic conditions.

J Acoust Soc Am

Centre for Interdisciplinary Research in Music Media and Technology, Schulich School of Music, McGill University, 555 Sherbrooke Street West, Montréal, Quebéc H3A 1E3, Canada.

Published: May 2012

Locomotion generates multisensory information about walked-upon objects. How perceptual systems use such information to get to know the environment remains unexplored. The ability to identify solid (e.g., marble) and aggregate (e.g., gravel) walked-upon materials was investigated in auditory, haptic or audio-haptic conditions, and in a kinesthetic condition where tactile information was perturbed with a vibromechanical noise. Overall, identification performance was better than chance in all experimental conditions and for both solids and the better identified aggregates. Despite large mechanical differences between the response of solids and aggregates to locomotion, for both material categories discrimination was at its worst in the auditory and kinesthetic conditions and at its best in the haptic and audio-haptic conditions. An analysis of the dominance of sensory information in the audio-haptic context supported a focus on the most accurate modality, haptics, but only for the identification of solid materials. When identifying aggregates, response biases appeared to produce a focus on the least accurate modality--kinesthesia. When walking on loose materials such as gravel, individuals do not perceive surfaces by focusing on the most accurate modality, but by focusing on the modality that would most promptly signal postural instabilities.

Download full-text PDF

Source
http://dx.doi.org/10.1121/1.3699205DOI Listing

Publication Analysis

Top Keywords

haptic audio-haptic
12
audio-haptic conditions
12
walked-upon materials
8
auditory kinesthetic
8
focus accurate
8
accurate modality
8
conditions
5
identification walked-upon
4
materials
4
materials auditory
4

Similar Publications

Ultrasonic mid-air haptic technology allows for the perceptual rendering of textured surfaces onto the user's hand. Unlike real textured surfaces, however, mid-air haptic feedback lacks implicit multisensory cues needed to reliably infer a texture's attributes (e.g.

View Article and Find Full Text PDF

Synchronization of audio-tactile stimuli represents a key feature of multisensory interactions. However, information on stimuli synchronization remains scarce, especially with virtual buttons. This work used a click sensation produced with traveling waves and auditory stimulus (a bip-like sound) related to a virtual click for a psychological experiment.

View Article and Find Full Text PDF

Working memory (WM) plays a crucial role in helping individuals perform everyday activities and interact with the external environment. However, despite valuable insights into visual memory mechanisms, the multi-sensory aspects of WM have not been thoroughly investigated, especially in congenitally blind individuals, primarily due to a lack of proper technologies. This work presents an audio-haptic system to study the generation and recall of multi-sensory spatial representations in visually impaired and sighted individuals.

View Article and Find Full Text PDF

Introduction: Auditory perception and associated cognition involve visual and auditory cortical areas for inference of meaningful soundscape.

Objective: To investigate auditory perception of ambiguous and non-ambiguous stimulation in auditory and visual cortical networks for categorical discrimination.

Methodology: Functional mapping was carried out in twenty early (EB), twenty late blind (LB) and fifteen healthy children, during auditory ambiguous and non-ambiguous stimulation task in a 3 T MR scanner to estimate hemodynamic signal alteration and its effect on functional connectivity.

View Article and Find Full Text PDF

A surface texture is perceived through both the sound and vibrations produced while being explored by our fingers. Because of their common origin, both modalities have a strong influence on each other, particularly at above 60 Hz for which vibrotactile perception and pitch perception share common neural processes. However, whether the sensation of rhythm is shared between audio and haptic perception is still an open question.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!