Effects of separating auditory and visual sources on audiovisual integration of speech

Jeffery A. Jones · Kevin G. Munhall

49 citations0/0 files storedCanadian acoustics

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Multisensory perception and integration Speech and Audio Processing Tactile and Sensory Interactions

Abstract

W hen the image of a speaker saying the bisyllable /aga/ is presented in synchrony with the sound of a speaker saying /aba/, subjects tend to report hearing the sound /ada/.The present experiment explores the effects of spatial separation on this class of perceptual illusion known as the McGurk effect.Synchronous auditory and visual speech signals were presented from different locations.The auditory signal was presented from positions 0°, 30°, 60° and 90° in azimuth away from the visual signal source.The results show that spatial incongruencies do not substantially influence the multimodal integration of speech signals. SOMMAIRELorsqu'on présente simultanément l'image d'une personne prononçant la bisyllabe /aga/ et le son /aba/, les participants ont tendance à dire qu'ils ont entendu /ada/.Cette illusion est connue sous le nom d'effet McGurk.La présente étude explore les conséquences perceptives de la séparation spatiale entre les sources visuelle et sonore sur l'effet McGurk.Un signal auditif était présenté a 0, 30, 60, et 90 degrés en azimuth par rapport au signal visuel.Les résultats demontrent que les paramètres spatiaux n'ont que peu d'influence sur l'intégration visuo-auditive des signaux.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 49 citations exist upstream.

References

1969The Senses Considered as Perceptual Systems 1976Hearing lips and seeing voices 1991Human adults and human infants show a “perceptual magnet effect” for the prototypes of speech categories, monkeys do not 1980Immediate perceptual response to intersensory discrepancy.1951The intelligibility of speech as a function of the context of the test materials.1978Visual influences on speech perception processes 1987Some preliminaries to a comprehensive account of audio-visual speech perception.1981Cross-modal bias and perceptual fusion with auditory-visual spatial discordance

Cited by

2011Crossmodal correspondences: A tutorial review 2006Temporal window of integration in auditory-visual speech perception 2011Section III 2022Audiovisual speech perception: Moving beyond McGurk 2007Spatial coincidence modulates the Colavita visual dominance effect 2005Top-down and bottom-up modulation of audiovisual integration in speech

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.