A Two-Stage Unsupervised Learning Algorithm Reproduces Multisensory Enhancement in a Neural Network Model of the Corticotectal System

Thomas J. Anastasio · Paul E. Patton

42 citations0/0 files storedJournal of Neuroscience

No readable copy stored yet — this record is metadata only.

No open-access location is known for this record yet.

Literature note Cite in a project Citation map

Multisensory perception and integration Visual perception and processing mechanisms Neural dynamics and brain function

Abstract

Multisensory enhancement (MSE) is the augmentation of the response to sensory stimulation of one modality by stimulation of a different modality. It has been described for multisensory neurons in the deep superior colliculus (DSC) of mammals, which function to detect, and direct orienting movements toward, the sources of stimulation (targets). MSE would seem to improve the ability of DSC neurons to detect targets, but many mammalian DSC neurons are unimodal. MSE requires descending input to DSC from certain regions of parietal cortex. Paradoxically, the descending projections necessary for MSE originate from unimodal cortical neurons. MSE, and the puzzling findings associated with it, can be simulated using a model of the corticotectal system. In the model, a network of DSC units receives primary sensory input that can be augmented by modulatory cortical input. Connection weights from primary and modulatory inputs are trained in stages one (Hebb) and two (Hebb-anti-Hebb), respectively, of an unsupervised two-stage algorithm. Two-stage training causes DSC units to extract information concerning simulated targets from their inputs. It also causes the DSC to develop a mixture of unimodal and multisensory units. The percentage of DSC multisensory units is determined by the proportion of cross-modal targets and by primary input ambiguity. Multisensory DSC units develop MSE, which depends on unimodal modulatory connections. Removal of the modulatory influence greatly reduces MSE but has little effect on DSC unit responses to stimuli of a single modality. The correspondence between model and data suggests that two-stage training captures important features of self-organization in the real corticotectal system.

Paper brief

Loading…

Cite this work

Citation unavailable for this work.

BibTeX RIS CSL-JSON

No public copy is stored for this record, so only the metadata is cited.

Citations in this library

Citation map →

Stored only when both papers are in the corpus — 42 citations exist upstream.

References

1994The merging of the senses 1986Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration 1984A neural code for auditory space in the cat's superior colliculus 1996Representation and integration of multiple sensory inputs in primate superior colliculus 1989Behavioral Indices of Multisensory Integration: Orientation to Visual Cues is Affected by Auditory Stimuli 1986Spatial factors determine the activity of multisensory neurons in cat superior colliculus 1985Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus 1996Spatial determinants of multisensory integration in cat superior colliculus neurons

Cited by

2008Multisensory integration: current issues from the perspective of the single neuron 2008Multisensory integration in the superior colliculus: a neural network model 2012Hebbian mechanisms help explain development of multisensory integration in the superior colliculus: a neural network model 2008A theoretical study of multisensory integration in the superior colliculus by a neural network model

Explore the map →

Papers that cite the same references — the relational fallback while embeddings are still backfilling.

Imported from OpenAlex (CC0) — nothing here is generated.