We describe an experiment that explores the contribution of auditory and other features to the illusion of plausibility in a virtual environment that depicts the performance of a string quartet. 'Plausibility' refers to the component of presence that is the illusion that the perceived events in the virtual environment are really happening. The features studied were: Gaze (the musicians ignored the participant, the musicians sometimes looked towards and followed the participant's movements), Sound Spatialization (Mono, Stereo, Spatial), Auralization (no sound reflections, reflections corresponding to a room larger than the one perceived, reflections that exactly matched the virtual room), and Environment (no sound from outside of the room, birdsong and wind corresponding to the outside scene). We adopted the methodology based on color matching theory, where 20 participants were first able to assess their feeling of plausibility in the environment with each of the four features at their highest setting. Then five times participants started from a low setting on all features and were able to make transitions from one system configuration to another until they matched their original feeling of plausibility. From these transitions a Markov transition matrix was constructed, and also probabilities of a match conditional on feature configuration. The results show that Environment and Gaze were individually the most important factors influencing the level of plausibility. The highest probability transitions were to improve Environment and Gaze, and then Auralization and Spatialization. We present this work as both a contribution to the methodology of assessing presence without questionnaires, and showing how various aspects of a musical performance can influence plausibility.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TVCG.2017.2657138DOI Listing

Publication Analysis

Top Keywords

string quartet
8
virtual environment
8
feeling plausibility
8
environment gaze
8
plausibility
6
environment
6
plausibility string
4
quartet performance
4
virtual
4
performance virtual
4

Similar Publications

This paper presents the Cadenza Woodwind Dataset. This publicly available data is synthesised audio for woodwind quartets including renderings of each instrument in isolation. The data was created to be used as training data within Cadenza's second open machine learning challenge (CAD2) for the task on rebalancing classical music ensembles.

View Article and Find Full Text PDF

String Quartet No. 1 "Polar Energy Budget" - Music composition using Earth observation data of polar regions.

iScience

May 2024

Department of Geography, Faculty of Geo-environmental Science, Rissho University, Kumagaya, Japan.

In recent years, advancements in digital processing have facilitated the transformation of data into sound, a process referred to as . To raise awareness and understanding of climate change, various sonification endeavors utilizing Earth science data have surfaced; nevertheless, the outcomes frequently deviate from conventional music compositions. This backstory aims to examine the possibilities and limitations of sonification by composing music based on Earth observation data with intentional and staged intervention of arrangements by a composer, presenting the music composition results and presenting the feedback and discussions raised by the audience.

View Article and Find Full Text PDF

Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings.

View Article and Find Full Text PDF

Environmental enrichment can improve animal welfare. As a method of environmental enrichment, the effect of different auditory stimulations on the behavior response and welfare of laying hen chicks has yet to be investigated. Therefore, this study was aimed at exploring the impact of various auditory exposures on the behavior, learning ability, and fear response of 4-week-old laying hen chicks.

View Article and Find Full Text PDF

We use functional Magnetic Resonance Imaging (fMRI) to explore synchronized neural responses between observers of audiovisual presentation of a string quartet performance during free viewing. Audio presentation was accompanied by visual presentation of the string quartet as stick figures observed from a static viewpoint. Brain data from 18 musical novices were obtained during audiovisual presentation of a 116 s performance of the allegro of String Quartet, No.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!