Visual–Haptic Adaptation Is Determined by Relative Reliability

Johannes Burge · Ahna Reza Girshick · Martin S. Banks

78 citations0/0 files storedJournal of Neuroscience

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Multisensory perception and integration Visual perception and processing mechanisms Tactile and Sensory Interactions

Abstract

Accurate calibration of sensory estimators is critical for maintaining accurate estimates of the environment. Classically, it was assumed that sensory calibration occurs by one sense changing to become consistent with vision; this is visual dominance. Recently, it has been proposed that changes in estimators occur according to their relative reliabilities; this is the reliability-based model. We show that if cue combination occurs according to relative reliability, then reliability-based calibration assures minimum-variance sensory estimates over time. Recent studies are qualitatively consistent with the reliability-based model, but none have shown that the predictions are quantitatively accurate. We conducted an experiment in which the model could be assessed quantitatively. Subjects indicated whether visual, haptic, and visual-haptic planar surfaces appeared slanted positively or negatively from frontoparallel. In preadaptation, we determined the visual and haptic slants of perceived frontoparallel, and measured visual and haptic reliabilities. We varied visual reliability by adjusting the size of the viewable stimulus. Haptic reliability was fixed. During adaptation, subjects were exposed to visual-haptic surfaces with a discrepancy between the visual and haptic slants. After adaptation, we remeasured the visual and haptic slants of perceived frontoparallel. When vision was more reliable, haptics adapted to match vision. When vision was less reliable, vision adapted to match haptics. Most importantly, the ratio of visual and haptic adaptation was quantitatively predicted by relative reliability. The amount of adaptation of one sensory estimator relative to another depends strongly on the relative reliabilities of the two estimators.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 78 citations exist upstream.

References

2002Humans integrate visual and haptic information in a statistically optimal fashion 2004The Ventriloquist Effect Results from Near-Optimal Bimodal Integration 1964Vision and Touch: An Experimentally Created Conflict between the Two Senses 2002When Feeling Is More Important Than Seeing in Sensorimotor Adaptation 2002Instructed learning in the auditory localization pathway of the barn owl 1991Visual Instruction of the Neural Map of Auditory Space in the Developing Optic Tectum 2003Viewing Geometry Determines How Vision and Haptics Combine in Size Perception 2005Why Seeing Is Believing: Merging Auditory and Visual Worlds

Cited by

2015Informational and Normative Influences in Conformity from a Neurocomputational Perspective 2020Modality-specific attention attenuates visual-tactile integration and recalibration effects by reducing prior expectations of a common source for vision and touch

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.