Exploring the Role of the Modulation Spectrum in Phoneme Recognition

Frederick J. Gallun · Pamela E. Souza

44 citations0/0 files storedEar and Hearing

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Phonetics and Phonology Research Speech and Audio Processing Neuroscience and Music Perception

Abstract

In Brief Objectives: The ability of human listeners to identify consonants (presented as nonsense syllables) on the basis of primarily temporal information was compared with the predictions of a simple model based on the amplitude modulation spectra of the stimuli calculated for six octave-spaced carrier frequencies (250 to 8000 Hz) and six octave-spaced amplitude modulation frequencies (1 to 32 Hz). Design: The listeners and the model were presented with 16 phonemes each spoken by four different talkers processed so that one, two, four, or eight bands of spectral information remained. The average modulation spectrum of each of the processed phonemes was extracted and similarity across phonemes was calculated by the use of a spectral correlation index (SCI). Results: The similarity of the modulation spectra across phonemes as assessed by the spectral correlation index was a strong predictor of the confusions made by human listeners. Conclusions: This result suggests that a sparse set of time-averaged patterns of modulation energy can capture a meaningful aspect of the information listeners use to distinguish among speech signals. The ability of listeners to identify consonants on the basis of primarily temporal information was compared with the predictions of a model based on amplitude modulation spectra. Listeners and model were presented with phonemes processed so that one to eight bands of spectral information remained. The similarity of the modulation spectra across phonemes was a strong predictor of the confusions made by human listeners, suggesting that a sparse set of time-averaged patterns of modulation energy can capture a meaningful aspect of the information listeners use to distinguish among speech signals.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 44 citations exist upstream.

References

1995Speech Recognition with Primarily Temporal Cues 1992Temporal information in speech: acoustic, auditory and linguistic aspects 1994Effect of temporal envelope smearing on speech reception 2003Acoustic properties of naturally produced clear speech at normal speaking rates 2004Relative importance of temporal information in various frequency regions for consonant identification in quiet and in noise 2001The relation between speech intelligibility and the complex modulation spectrum 1998Speech intelligibility derived from exceedingly sparse spectral information 1999Syllable intelligibility for temporally filtered LPC cepstral trajectories

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.