On the Relationship between Face Movements, Tongue Movements, and Speech Acoustics

Jintao Jiang · Abeer A. Alwan · Patricia Keating · Edward T. Auer · Lynne E. Bernstein

112 citations0/0 files storedEURASIP Journal on Advances in Signal Processing

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Phonetics and Phonology Research Speech and Audio Processing Voice and Speech Disorders

Abstract

This study examines relationships between external face movements, tongue movements, and speech acoustics for consonant-vowel (CV) syllables and sentences spoken by two male and two female talkers with different visual intelligibility ratings. The questions addressed are how relationships among measures vary by syllable, whether talkers who are more intelligible produce greater optical evidence of tongue movements, and how the results for CVs compared to those for sentences. Results show that the prediction of one data stream from another is better for C/a/ syllables than C/i/ and C/u/ syllables. Across the different places of articulation, lingual places result in better predictions of one data stream from another than do bilabial and glottal places. Results vary from talker to talker; interestingly, high rated intelligibility do not result in high predictions. In general, predictions for CV syllables are better than those for sentences.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 112 citations exist upstream.

References

1971Acoustic Theory of Speech Production 1972Speech Analysis Synthesis and Perception 2000The use of visible speech cues for improving auditory detection of spoken sentences 1965Speech Analysis Synthesis and Perception 1955Development of a Quantitative Description of Vowel Articulation 1978Inversion of articulatory-to-acoustic transformation in the vocal tract by a computer-sorting technique

Cited by

2009Optical Phonetics and Visual Perception of Lexical and Phrasal Stress in English 2014No, There Is No 150 ms Lead of Visual Speech on Auditory Speech, but a Range of Audiovisual Asynchronies Varying from Small Audio Lead to Large Audio Lag 2012Binding and unbinding the auditory and visual streams in the McGurk effect 2013Auditory Perceptual Learning for Speech Perception Can be Enhanced by Audiovisual Training 2011Analysis of and feedback on phonetic features in pronunciation training with a virtual teacher 2017Visual Cortical Entrainment to Motion and Categorical Speech Features during Silent Lipreading 2011Psychophysics of the McGurk and other audiovisual speech integration effects.

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.