Multi-time resolution analysis of speech: evidence from psychophysics

Maria Chait A · Steven Greenberg · Takayuki Arai · Jonathan Z. Simon · David Poeppel

95 citations0/0 files storedFrontiers in Neuroscience

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Phonetics and Phonology Research Neurobiology of Language and Bilingualism Neuroscience and Music Perception

Abstract

How speech signals are analyzed and represented remains a foundational challenge both for cognitive science and neuroscience. A growing body of research, employing various behavioral and neurobiological experimental techniques, now points to the perceptual relevance of both phoneme-sized (10-40 Hz modulation frequency) and syllable-sized (2-10 Hz modulation frequency) units in speech processing. However, it is not clear how information associated with such different time scales interacts in a manner relevant for speech perception. We report behavioral experiments on speech intelligibility employing a stimulus that allows us to investigate how distinct temporal modulations in speech are treated separately and whether they are combined. We created sentences in which the slow (~4 Hz; Slow) and rapid (~33 Hz; Shigh) modulations-corresponding to ~250 and ~30 ms, the average duration of syllables and certain phonetic properties, respectively-were selectively extracted. Although Slow and Shigh have low intelligibility when presented separately, dichotic presentation of Shigh with Slow results in supra-additive performance, suggesting a synergistic relationship between low- and high-modulation frequencies. A second experiment desynchronized presentation of the Slow and Shigh signals. Desynchronizing signals relative to one another had no impact on intelligibility when delays were less than ~45 ms. Longer delays resulted in a steep intelligibility decline, providing further evidence of integration or binding of information within restricted temporal windows. Our data suggest that human speech perception uses multi-time resolution processing. Signals are concurrently analyzed on at least two separate time scales, the intermediate representations of these analyses are integrated, and the resulting bound percept has significant consequences for speech intelligibility-a view compatible with recent insights from neuroscience implicating multi-timescale auditory processing.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 95 citations exist upstream.

References

1995Speech Recognition with Primarily Temporal Cues 1985The motor theory of speech perception revised 1996Language Comprehension in Language-Learning Impaired Children Improved with Acoustically Modified Speech 1979Does awareness of speech as a sequence of phones arise spontaneously?1992Temporal information in speech: acoustic, auditory and linguistic aspects 2010A temporal sampling framework for developmental dyslexia 1994Effect of temporal envelope smearing on speech reception 2005Lexical Information Drives Perceptual Learning of Distorted Speech: Evidence From the Comprehension of Noise-Vocoded Sentences.

Cited by

2018Is conscious perception a series of discrete temporal frames?2016Atypical neural synchronization to speech envelope modulations in dyslexia 2016Perception of Filtered Speech by Children with Developmental Dyslexia and Children with Specific Language Impairments

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.