A multimedia speech corpus for audio visual research in virtual reality (L).

J Acoust Soc Am

Facebook Reality Labs, Redmond, Washington 98052, USA.

Published: August 2020

Virtual reality environments offer new possibilities in perceptual research, such as presentation of physically impossible but ecologically valid stimuli in contrived scenarios. To facilitate perceptual research in such environments, this study presents a publicly available database of anechoic audio speech samples with matching stereoscopic and 360° video. These materials and accompanying software tool allow researchers to create simulations with up to five talkers positioned at arbitrary azimuthal locations, at multiple depth planes, in any 360° or stereoscopic environment. This study describes recording conditions and techniques, contents of the corpus, and how to use the materials within a virtual reality environment.

Download full-text PDF

Source
http://dx.doi.org/10.1121/10.0001670DOI Listing

Publication Analysis

Top Keywords

virtual reality
12
multimedia speech
4
speech corpus
4
corpus audio
4
audio visual
4
visual virtual
4
reality virtual
4
reality environments
4
environments offer
4
offer possibilities
4

Similar Publications

Scalable InGaN nanowire µ-LEDs: paving the way for next-generation display technology.

Natl Sci Rev

January 2025

Division of Advanced Materials Engineering, College of Engineering, Research Center for Advanced Materials Development (RCAMD), Jeonbuk National University (JBNU), Jeonju 54896, South Korea.

Ever-increasing demand for efficient optoelectronic devices with a small-footprinted on-chip light emitting diode has driven their expansion in self-emissive displays, from micro-electronic displays to large video walls. InGaN nanowires, with features like high electron mobility, tunable emission wavelengths, durability under high current densities, compact size, self-emission, long lifespan, low-power consumption, fast response, and impressive brightness, are emerging as the choice of micro-light emitting diodes (µLEDs). However, challenges persist in achieving high crystal quality and lattice-matching heterostructures due to composition tuning and bandgap issues on substrates with differing crystal structures and high lattice mismatches.

View Article and Find Full Text PDF

Digital health interventions in adult intensive care and recovery after critical illness to promote survivorship care.

J Intensive Care Soc

January 2025

Department of Physiotherapy, Faculty of Medicine, Dentistry and Health Sciences, School of Health Sciences, The University of Melbourne, Melbourne, VIC, Australia.

Digital health refers to the field of using and developing technology to improve health outcomes. Digital health and digital health interventions (DHIs) within the area of intensive care and critical illness survivorship are rapidly evolving. Digital health interventions refer to technologies in clinical interventional format.

View Article and Find Full Text PDF

Training system for converting current visual information to bird's-eye view.

Front Psychol

December 2024

Faculty of Systems Information Science, Future University Hakodate, Hakodate, Japan.

Introduction: Effective decision-making in ball games requires the ability to convert positional information from a first-person perspective into a bird's-eye view. To address this need, we developed a virtual reality (VR)-based training system designed to enhance spatial cognition.

Methods: Using a head-mounted virtual reality display, participants engaged in tasks where they tracked multiple moving objects in a virtual space and reproduced their positions from a bird's-eye perspective.

View Article and Find Full Text PDF

Background: Fibromyalgia Syndrome (FMS) is highly prevalent with a significant associated morbidity and socioeconomic burden. Effective treatments for FMS remain elusive with pharmacological management (including use of opioids) often proving ineffective. There is a need to develop accessible, innovative management approaches to improve patient care.

View Article and Find Full Text PDF

Background: Reminiscence therapy through music is a psychosocial intervention with benefits for older patients with neurocognitive disorders. Therapies using virtual or augmented reality are efficient in ecologically assessing, and eventually training, episodic memory in older populations. We designed a semi-immersive musical game called "A Life in Songs," which invites patients to immerse themselves in a past era through visuals and songs from that time period.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!