Dynamic Changes in Superior Temporal Sulcus Connectivity during Perception of Noisy Audiovisual Speech

Audrey R. Nath · Michael S. Beauchamp

171 citations0/0 files storedJournal of Neuroscience

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Multisensory perception and integration Speech and Audio Processing Neurobiology of Language and Bilingualism

Abstract

Humans are remarkably adept at understanding speech, even when it is contaminated by noise. Multisensory integration may explain some of this ability: combining independent information from the auditory modality (vocalizations) and the visual modality (mouth movements) reduces noise and increases accuracy. Converging evidence suggests that the superior temporal sulcus (STS) is a critical brain area for multisensory integration, but little is known about its role in the perception of noisy speech. Behavioral studies have shown that perceptual judgments are weighted by the reliability of the sensory modality: more reliable modalities are weighted more strongly, even if the reliability changes rapidly. We hypothesized that changes in the functional connectivity of STS with auditory and visual cortex could provide a neural mechanism for perceptual reliability weighting. To test this idea, we performed five blood oxygenation level-dependent functional magnetic resonance imaging and behavioral experiments in 34 healthy subjects. We found increased functional connectivity between the STS and auditory cortex when the auditory modality was more reliable (less noisy) and increased functional connectivity between the STS and visual cortex when the visual modality was more reliable, even when the reliability changed rapidly during presentation of successive words. This finding matched the results of a behavioral experiment in which the perception of incongruent audiovisual syllables was biased toward the more reliable modality, even with rapidly changing reliability. Changes in STS functional connectivity may be an important neural mechanism underlying the perception of noisy speech.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 171 citations exist upstream.

References

2002Humans integrate visual and haptic information in a statistically optimal fashion 1995Speech Recognition with Primarily Temporal Cues 2004The Ventriloquist Effect Results from Near-Optimal Bimodal Integration 1994The merging of the senses 1988MRC psycholinguistic database: Machine-usable dictionary, version 2.00 1996The Evolution of Communication 2000Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex 2000Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey

Cited by

2011Attention, biological motion, and action recognition 2011The development of multisensory speech perception continues into the late childhood years 2014Neural pathways for visual speech perception 2021Perceptual Inference, Learning, and Attention in a Multisensory World 2013Cue Integration 2017Forty Years After Hearing Lips and Seeing Voices: the McGurk Effect Revisited

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.