The use of deep learning technology in dance movement generation.

Front Neurorobot

Department of Teaching Profession, Sehan University, Chonnam, South Korea.

Published: August 2022

The dance generated by the traditional music action matching and statistical mapping models is less consistent with the music itself. Moreover, new dance movements cannot be generated. A dance movement generation algorithm based on deep learning is designed to extract the mapping between sound and motion features to solve these problems. First, the sound and motion features are extracted from music and dance videos, and then, the model is built. In addition, a generator module, a discriminator module, and a self-encoder module are added to make the dance movement smoother and consistent with the music. The Pix2PixHD model is used to transform the dance pose sequence into a real version of the dance. Finally, the experiment takes the dance video on the network as the training data and trained 5,000 times. About 80% of the dance data are used as the training set and 20% as the test set. The experimental results show that Train, Valid, and Test values based on the Generator+Discriminator+Autoencoder model are 15.36, 17.19, and 19.12, respectively. The similarity between the generated dance sequence and the real dance sequence is 0.063, which shows that the proposed model can generate a dance more in line with the music. Moreover, the generated dance posture is closer to the real dance posture. The discussion has certain reference value for intelligent dance teaching, game field, cross-modal generation, and exploring the relationship between audio-visual information.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9389150PMC
http://dx.doi.org/10.3389/fnbot.2022.911469DOI Listing

Publication Analysis

Top Keywords

dance
16
dance movement
12
generated dance
12
deep learning
8
movement generation
8
consistent music
8
music dance
8
sound motion
8
motion features
8
sequence real
8

Similar Publications

Beta oscillations predict the envelope sharpness in a rhythmic beat sequence.

Sci Rep

January 2025

RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Forskningsveien 3A, Oslo, 0373, Norway.

Periodic sensory inputs entrain oscillatory brain activity, reflecting a neural mechanism that might be fundamental to temporal prediction and perception. Most environmental rhythms and patterns in human behavior, such as walking, dancing, and speech do not, however, display strict isochrony but are instead quasi-periodic. Research has shown that neural tracking of speech is driven by modulations of the amplitude envelope, especially via sharp acoustic edges, which serve as prominent temporal landmarks.

View Article and Find Full Text PDF

The inversion effect in biological motion suggests that presenting a point-light display (PLD) in an inverted orientation impairs the observer's ability to perceive the movement, likely due to the observer's unfamiliarity with the dynamic characteristics of inverted motion. Vertical dancers (VDs), accustomed to performing and perceiving others to perform dance movements in an inverted orientation while being suspended in the air, offer a unique perspective on this phenomenon. A previous study showed that VDs were more sensitive to the artificial inversion of PLDs depicting dance movements when compared to typical and non-dancers if given sufficient dynamic information.

View Article and Find Full Text PDF

Dietary intakes of flavonoids in relation to cognitive function among middle-aged and older adults: results from the Chinese Square Dance Cohort.

Food Funct

January 2025

Academy of Nutrition and Health, Hubei Province Key Laboratory of Occupational Hazard Identification and Control, School of Public Health, Wuhan University of Science and Technology, Wuhan 430065, China.

: The study aims to explore the association between intake of dietary flavonoids and global cognition, domain-specific cognition and mild cognitive impairment (MCI) in middle-aged and older adults in China. : A cross-sectional study. : This study used baseline data collected during 2021-2023 from the Chinese Square Dance Cohort.

View Article and Find Full Text PDF

Dance or rhythmic movement-based training has demonstrated significant efficacy in addressing a range of motor and cognitive deficits associated with neurodegenerative diseases like Parkinson's and Alzheimer's diseases. Leveraging both human and non-human animal behavioral and neurobiological evidence, I hypothesize a possible untapped role of dance training in mitigating impairments in the motor control of speech, a complex sensorimotor behavior affected in these conditions. Here, this hypothesis is supported by an in-depth examination of motor speech deficits in Parkinson's and Alzheimer's diseases, at a behavioral, physiological, and neural level.

View Article and Find Full Text PDF

Group A basic leucine zipper (bZIP) transcription factors play critical roles in abscisic acid (ABA) signaling and plant development. In Arabidopsis thaliana, these factors are defined by a highly conserved core bZIP domain, and four conserved domains throughout their length: three at the N-terminus (C1 to C3) and a phosphorylatable C-terminal SAP motif located at the C4 domain. Initially, members such as ABI5 and ABFs were studied for their roles in ABA signaling during seed germination or stress responses.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!