The Effect of Temporal Asynchrony on the Multisensory Integration of Letters and Speech Sounds

Nienke van Atteveldt · Elia Formisano E · Leo Blomert · Rainer Goebel

209 citations0/0 files storedCerebral Cortex

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Multisensory perception and integration Neuroscience and Music Perception Tactile and Sensory Interactions

Abstract

Temporal proximity is a critical determinant for cross-modal integration by multisensory neurons. Information content may serve as an additional binding factor for more complex or less natural multisensory information. Letters and speech sounds, which form the basis of literacy acquisition, are not naturally related but associated through explicit learning. We investigated the relative importance of temporal proximity and information content on the integration of letters and speech sounds by manipulating both factors within the same functional magnetic resonance imaging (fMRI) design. The results reveal significant interactions between temporal proximity and content congruency in anterior and posterior auditory association cortex, indicating that temporal synchrony is critical for the integration of letters and speech sounds. The temporal profiles for multisensory integration in the auditory association cortex resemble those demonstrated for single multisensory neurons in different brain structures and animal species. This similarity suggests that basic neural integration rules apply to the binding of multisensory information that is not naturally related but overlearned during literacy acquisition. Furthermore, the present study shows the suitability of fMRI to study temporal aspects of multisensory neural processing.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 209 citations exist upstream.

References

2004Specific reading disability (dyslexia): what have we learned in the past four decades?1994The merging of the senses 2001Crossmodal Processing in the Human Brain: Insights from Functional Neuroimaging Studies 2004The Handbook of Multisensory Processing 2000Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex 1982The Bimodal Perception of Speech In Infancy 1983Interactions Among Converging Sensory Inputs in the Superior Colliculus 2004Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus

Cited by

2008Touch, sound and vision in human superior temporal sulcus 2007Object Familiarity and Semantic Congruency Modulate Responses in Cortical Audiovisual Integration Areas 2010Distinct Functional Contributions of Primary Sensory and Association Areas to Audiovisual Integration in Object Categorization 2009Differential roles for left inferior frontal and superior temporal cortex in multimodal integration of action and language 2009Integration of iconic gestures and speech in left superior temporal areas boosts speech comprehension under adverse listening conditions

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.