Reference Frame of the Ventriloquism Aftereffect

Norbert Kopčo · I-Fan Lin · Barbara G. Shinn‐Cunningham · Jennifer M. Groh

60 citations0/0 files storedJournal of Neuroscience

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Multisensory perception and integration Neuroscience and Music Perception Tactile and Sensory Interactions

Abstract

Seeing the image of a newscaster on a television set causes us to think that the sound coming from the loudspeaker is actually coming from the screen. How images capture sounds is mysterious because the brain uses different methods for determining the locations of visual versus auditory stimuli. The retina senses the locations of visual objects with respect to the eyes, whereas differences in sound characteristics across the ears indicate the locations of sound sources referenced to the head. Here, we tested which reference frame (RF) is used when vision recalibrates perceived sound locations. Visually guided biases in sound localization were induced in seven humans and two monkeys who made eye movements to auditory or audiovisual stimuli. On audiovisual (training) trials, the visual component of the targets was displaced laterally by 5-6 degrees. Interleaved auditory-only (probe) trials served to evaluate the effect of experience with mismatched visual stimuli on auditory localization. We found that the displaced visual stimuli induced ventriloquism aftereffect in both humans (approximately 50% of the displacement size) and monkeys (approximately 25%), but only for locations around the trained spatial region, showing that audiovisual recalibration can be spatially specific. We tested the reference frame in which the recalibration occurs. On probe trials, we varied eye position relative to the head to dissociate head- from eye-centered RFs. Results indicate that both humans and monkeys use a mixture of the two RFs, suggesting that the neural mechanisms involved in ventriloquism occur in brain region(s) using a hybrid RF for encoding spatial information.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 60 citations exist upstream.

References

2004The Ventriloquist Effect Results from Near-Optimal Bimodal Integration 1983Interactions Among Converging Sensory Inputs in the Superior Colliculus 2005Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex 1987Sensorimotor integration in the primate superior colliculus. II. Coordinates of auditory signals 2005Multisensory Space Representations in the Macaque Ventral Intraparietal Area 1996Eye-centered, head-centered, and intermediate coding of remembered sound locations in area LIP 2005Nonauditory Events of a Behavioral Procedure Activate Auditory Cortex of Highly Trained Monkeys 1993Converging influences from visual, auditory, and somatosensory cortices onto output neurons of the superior colliculus

Cited by

2015Sensory recalibration integrates information from the immediate and the cumulative past 2019Shared neural underpinnings of multisensory integration and trial-by-trial perceptual recalibration in humans 2012Auditory signals evolve from hybrid- to eye-centered coordinates in the primate superior colliculus 2019Multisensory feature integration in (and out) of the focus of spatial attention

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.