A possible neurophysiological correlate of audiovisual binding and unbinding in speech perception

Attigodu Chandrashekara Ganesh · Frédéric Berthommier · Coriandre Vilain · Marc Sato · Jean‐Luc Schwartz

34 citations0/0 files storedFrontiers in Psychology

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Multisensory perception and integration Speech and Audio Processing Neuroscience and Music Perception

Abstract

Audiovisual (AV) speech integration of auditory and visual streams generally ends up in a fusion into a single percept. One classical example is the McGurk effect in which incongruent auditory and visual speech signals may lead to a fused percept different from either visual or auditory inputs. In a previous set of experiments, we showed that if a McGurk stimulus is preceded by an incongruent AV context (composed of incongruent auditory and visual speech materials) the amount of McGurk fusion is largely decreased. We interpreted this result in the framework of a two-stage "binding and fusion" model of AV speech perception, with an early AV binding stage controlling the fusion/decision process and likely to produce "unbinding" with less fusion if the context is incoherent. In order to provide further electrophysiological evidence for this binding/unbinding stage, early auditory evoked N1/P2 responses were here compared during auditory, congruent and incongruent AV speech perception, according to either prior coherent or incoherent AV contexts. Following the coherent context, in line with previous electroencephalographic/magnetoencephalographic studies, visual information in the congruent AV condition was found to modify auditory evoked potentials, with a latency decrease of P2 responses compared to the auditory condition. Importantly, both P2 amplitude and latency in the congruent AV condition increased from the coherent to the incoherent context. Although potential contamination by visual responses from the visual cortex cannot be discarded, our results might provide a possible neurophysiological correlate of early binding/unbinding process applied on AV interactions.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 34 citations exist upstream.

References

1976Hearing lips and seeing voices 2005Visual speech speeds up the neural processing of auditory speech 2000The use of visible speech cues for improving auditory detection of spoken sentences 1987Some preliminaries to a comprehensive account of audio-visual speech perception.2005Audiovisual Integration of Speech Falters under High Attention Demands 2007Neural Correlates of Multisensory Integration of Ecologically Valid Audiovisual Events 2004Bimodal speech: early suppressive visual effects in human auditory cortex 2004Seeing to hear better: evidence for early audio-visual interactions in speech identification

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.