[Virtual audiovisual talking heads: articulatory data and models--applications].

Rev Laryngol Otol Rhinol (Bord)

GIPSA-lab, ENSIEG, Domaine Universitaire, BP46, 38402 Saint Martin d'Hères, France.

Published: May 2010

In the framework of experimental phonetics, our approach to the study of speech production is based on the measurement, the analysis and the modeling of orofacial articulators such as the jaw, the face and the lips, the tongue or the velum. Therefore, we present in this article experimental techniques that allow characterising the shape and movement of speech articulators (static and dynamic MRI, computed tomodensitometry, electromagnetic articulography, video recording). We then describe the linear models of the various organs that we can elaborate from speaker-specific articulatory data. We show that these models, that exhibit a good geometrical resolution, can be controlled from articulatory data with a good temporal resolution and can thus permit the reconstruction of high quality animation of the articulators. These models, that we have integrated in a virtual talking head, can produce augmented audiovisual speech. In this framework, we have assessed the natural tongue reading capabilities of human subjects by means of audiovisual perception tests. We conclude by suggesting a number of other applications of talking heads.

Download full-text PDF

Source

Publication Analysis

Top Keywords

articulatory data
12
talking heads
8
[virtual audiovisual
4
audiovisual talking
4
heads articulatory
4
data models--applications]
4
models--applications] framework
4
framework experimental
4
experimental phonetics
4
phonetics approach
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!