Deep neural network models reveal interplay of peripheral coding and stimulus statistics in pitch perception.

Nat Commun

Department of Brain and Cognitive Sciences, MIT, Cambridge, MA, USA.

Published: December 2021

Perception is thought to be shaped by the environments for which organisms are optimized. These influences are difficult to test in biological organisms but may be revealed by machine perceptual systems optimized under different conditions. We investigated environmental and physiological influences on pitch perception, whose properties are commonly linked to peripheral neural coding limits. We first trained artificial neural networks to estimate fundamental frequency from biologically faithful cochlear representations of natural sounds. The best-performing networks replicated many characteristics of human pitch judgments. To probe the origins of these characteristics, we then optimized networks given altered cochleae or sound statistics. Human-like behavior emerged only when cochleae had high temporal fidelity and when models were optimized for naturalistic sounds. The results suggest pitch perception is critically shaped by the constraints of natural environments in addition to those of the cochlea, illustrating the use of artificial neural networks to reveal underpinnings of behavior.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8671597PMC
http://dx.doi.org/10.1038/s41467-021-27366-6DOI Listing

Publication Analysis

Top Keywords

pitch perception
12
artificial neural
8
neural networks
8
deep neural
4
neural network
4
network models
4
models reveal
4
reveal interplay
4
interplay peripheral
4
peripheral coding
4

Similar Publications

Musical Pitch Perception and Categorization in Listeners with No Musical Training Experience: Insights from Mandarin-Speaking Non-Musicians.

Behav Sci (Basel)

December 2024

Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents, Ministry of Education, & Center for Studies of Psychological Application, School of Psychology, South China Normal University, Guangzhou 510631, China.

Pitch is a fundamental element in music. While most previous studies on musical pitch have focused on musicians, our understanding of musical pitch perception in non-musicians is still limited. This study aimed to explore how Mandarin-speaking listeners who did not receive musical training perceive and categorize musical pitch.

View Article and Find Full Text PDF

Despite extensive research on absolute pitch (AP), there remains no gold-standard task to measure its presence or extent. This systematic review investigated the methods of pitch-naming tasks for the classification of individuals with AP and examined how our understanding of the AP phenotype is affected by variability in the tasks used to measure it. Data extracted from 160 studies (N = 23,221 participants) included (i) the definition of AP, (ii) task characteristics, (iii) scoring method, and (iv) participant scores.

View Article and Find Full Text PDF

Conventional energy-absorbing components have limitations in terms of performance and functionality, including significant variability in reaction forces, inherent instability, and inadequate energy absorption capabilities. This paper presents a threaded shear-type energy-absorbing component designed for anti-impact hydraulic support columns, specifically for ZQL advancing support roadway hydraulic supports. The component operates based on the principle of threaded shear energy absorption.

View Article and Find Full Text PDF

The affective iconicity of lexical tone: Evidence from standard Chinesea).

J Acoust Soc Am

January 2025

Leiden University Centre for Linguistics, Leiden University, Leiden, The Netherlands.

Previous studies suggested that pitch characteristics of lexical tones in Standard Chinese influence various sensory perceptions, but whether they iconically bias emotional experience remained unclear. We analyzed the arousal and valence ratings of bi-syllabic words in two corpora (Study 1) and conducted an affect rating experiment using a carefully designed corpus of bi-syllabic words (Study 2). Two-alternative forced-choice tasks further tested the robustness of lexical tones' affective iconicity in an auditory nonce word context (Study 3).

View Article and Find Full Text PDF

EXPRESS: Vocal and musical emotion perception, voice cue discrimination, and quality of life in cochlear implant users with and without acoustic hearing.

Q J Exp Psychol (Hove)

January 2025

Department of Otorhinolaryngology / Head and Neck Surgery, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands.

This study aims to provide a comprehensive picture of auditory emotion perception in cochlear implant (CI) users by (1) investigating emotion categorization in both vocal (pseud-ospeech) and musical domains, and (2) how individual differences in residual acoustic hearing, sensitivity to voice cues (voice pitch, vocal tract length), and quality of life (QoL) might be associated with vocal emotion perception, and, going a step further, also with musical emotion perception. In 28 adult CI users, with or without self-reported acoustic hearing, we showed that sensitivity (d') scores for emotion categorization varied largely across the participants, in line with previous research. However, within participants, the d' scores for vocal and musical emotion categorization were significantly correlated, indicating similar processing of auditory emotional cues across the pseudo-speech and music domains and robustness of the tests.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!