Exploring the mathematical relationship between acoustic and visual speech.
Read Online

Exploring the mathematical relationship between acoustic and visual speech.

  • 366 Want to read
  • ·
  • 68 Currently reading

Published .
Written in English

Book details:

About the Edition

Speech perception involves two senses, hearing and seeing: we hear and lip-read speech. The synchrony between acoustic and visual speech is a driving force for the development of facial animators, which predict facial motion given an acoustic speech input. A computationally and conceptually simple model of audio-visual speech production is examined, one that relates acoustic speech and visual speech through a linear transformation. The model is tested with a large group of generic sentences, as well as sentences composed of highly controlled contexts to elicit specific types of articulator motion. On average, the transformation can account for 70% of facial motion, but this result is influenced by the context of the sentence. Results are interpreted in terms of the model assumptions in approximating the speech production system. This research is relevant to animating faces for multimedia or rehabilitation purposes, and falls in the framework of current speech perception theories.

The Physical Object
Pagination140 leaves.
Number of Pages140
ID Numbers
Open LibraryOL19216144M
ISBN 100494071001

Download Exploring the mathematical relationship between acoustic and visual speech.


Techniques in Speech Acoustics provides an introduction to the acoustic analysis and characteristics of speech sounds. The first part of the book covers aspects of the source-filter decomposition of speech, spectrographic analysis, the acoustic theory of speech production and acoustic phonetic : Springer Netherlands. Key Features: The first book that provides a comprehensive review on noise and reverberation robust speech recognition methods in the era of deep neural networks Connects robust speech recognition techniques to machine learning paradigms with rigorous mathematical treatment Provides elegant and structural ways to categorize and analyze noise-robust speech recognition techniques Written by Cited by: from the speech stream, then these alternative sources of information could be important and perhaps make the interpretation of the acoustic signals much easier. Petajan [ll] has explored the visual speech signals for isolated digit recog- nition. In his system, the acoustic and visual speech information were inde-. Some studies of the relationship between speech acoustics, articulation and phonetic structure* Jesper Hogberg Abstract This paper is the introductory part of a compilation of papers discussing analyses of acoustic and articulatory variability and the relation between acoustics, articulation and .

This research investigated the relationship between specific acoustic features and perceptual judgements of speech intelligibility for utterances produced Author: Yunjung Kim. Among the literature on acoustics the book of Pierce [] is an excellent introduction available for a low price from the Acoustical Society of America. In the preparation of the lecture notes we consulted various books which cover different aspects of the problem [14, 16, 18, 37, 48, 70, 87, 93, 99, , , , , , , , ]. The vocal fold movement is related to the acoustic output on which the acoustic methods are based, and the theoretical bases and results of several methods are compared, indicating the problems. Applied Acoustics looks not only at recent developments in the understanding of acoustics but also at ways of exploiting that understanding. The Journal aims to encourage the exchange of practical experience through publication and in so doing creates a fund of technological information that can be used for solving related problems.

Ponder now the forces of nature: the next time you are caught in a thunderstorm note the relationship between thunder and lightning. You will notice, if you have not already done so, that there is a delay between seeing the flash of the lightning and hearing the thun der: sound travels with some time delayFile Size: KB. Acoustic resonances in the vocal tract can produce peaks in the spectral envelope of the output sound. In speech science, the word ‘formant’ is used to describe either the spectral peak or the resonance that gives rise to it. In acoustics, it usually means the peak in . Lindblom () is another. Using the relationship between speech production and acoustics as to explain sound change as misperception and misparsing of the speech signal (Ohala, , Chapter x Ohala, this book) could also be grouped in this area. 3. Variability. The acoustic speech signal carries not only the linguistic structure. acoustic properties and perceived vocal qualities, or the relationships between the characteristics of the acoustic signal and the underlying laryngeal vibratory patterns that shape the sound wave, has not proven to be an especially easy problem. Goals of Acoustic Analysis The major clinical applications of acoustic analysis tend to fall into three broad categories.