Section III

Abstract

Most of our real-world perceptual experiences are speciœed by synchronous redundant and/or complementary multisensory perceptual attributes. As an example, a talker can be heard and seen at the same time, and as a result, we typically have access to multiple features across the different senses (i.e., lip movements, facial expression, pitch, speed, and temporal structure of the speech sound). This is highly advantageous because it increases perceptual reliability and saliency and, as a result, it might enhance learning, discrimination, or the speed of a reaction to the stimulus (Sumby and Pollack 1954; Summerœeld 1987). However, the multisensory nature of perception also raises the question about how the different sense organs cooperate so as to form a coherent representation of the world. In recent years, this has been the focus of much behavioral and neuroscientiœc research (Calvert et al. 2004). The most commonly held view among researchers in multisensory perception is what has been referred to as the “assumption of unity.” It states that, as information from different modalities share more (amodal) properties, the more likely the brain will treat them as originating from a common object or source (see, e.g., Bedford 1989; Bertelson 1999; Radeau 1994; Stein and Meredith 1993; Welch 1999; Welch and Warren 1980). Without a doubt, the most important amodal 9.1 Introduction .......................................................................................................................... 147 9.2 Measuring Intersensory Synchrony: Temporal Order Judgment Task and Simultaneity Judgment Task ...................................................................................................................... 148 9.3 Point of Subjective Simultaneity ........................................................................................... 150 9.3.1 Attention Affecting PSS: Prior Entry ....................................................................... 151 9.4 Sensitivity for Intersensory Asynchrony .............................................................................. 152 9.4.1 Spatial Disparity Affects JND .................................................................................. 153 9.4.2 Stimulus Complexity Affects JND ........................................................................... 154 9.4.3 Stimulus Rate Affects JND ...................................................................................... 155 9.4.4 Predictability Affects JND ....................................................................................... 155 9.4.5 Does Intersensory Pairing Affect JND? ................................................................... 156 9.5 How the Brain Deals with Lags between the Senses ........................................................... 156 9.5.1 Window of Temporal Integration ............................................................................. 156 9.5.2 Compensation for External Factors .......................................................................... 158 9.5.3 Temporal Recalibration ............................................................................................ 161 9.5.4 Temporal Ventriloquism ........................................................................................... 164 9.6 Temporal Synchrony: Automatic or Not? ............................................................................. 167 9.7 Neural Substrates of Temporal Synchrony ........................................................................... 169 9.8 Conclusions ........................................................................................................................... 170 References ...................................................................................................................................... 171 property is temporal coincidence (e.g., Radeau 1994). From this perspective, one expects intersensory interactions to occur if, and only if, information from the different sense organs arrives at around the same time in the brain; otherwise, two separate events are perceived rather than a single multimodal one.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 46 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.