Multisensory Perception & Binding

← Back to Domain-Specific Families

Abstractions about how the brain combines, attends to, and stabilizes sensory information, covering cross-modal integration (McGurk effect, ventriloquism effect, visual capture), perceptual stability and binding (perceptual constancy, temporal binding), auditory and attentional phenomena (precedence effect, dichotic listening), and sensorimotor coupling like gain fields and Braitenberg vehicles.

13 abstractions in this family — domain-specific abstractions that sit near one another in structural-signature space (k-means over structural-signature embeddings). Each is shown with its short description.

• Agnosia — Impaired recognition of objects, people, sounds, shapes, or odors despite intact primary sensation and memory.
• Braitenberg Vehicle — A Braitenberg vehicle is a simple sensor–motor agent whose embodied coupling produces behavior that can appear purposeful without requiring a planner.
• Dichotic Listening — Dichotic listening presents different simultaneous sounds to the two ears and interprets ear-specific responses under a stated attention task.
• Gain-field encoding — Gain field encoding is a hypothesis about the internal storage and processing of limb motion in the brain.
• Kappa effect — A psychophysical illusion in which the perceived duration between two stimuli lengthens when they are farther apart in space and shortens when closer, because the perceptual system reconstructs elapsed time from spatial layout under an implicit constant-velocity prior.
• McGurk effect — Show that speech perception is intrinsically multimodal: a face articulating /ga/ over an audio /ba/ is heard as /da/, because the auditory and visual streams are fused into a single percept — by reliability-weighted, coherence-gated combination — before the result reaches awareness.
• Multisensory integration — Multisensory integration, also known as multimodal integration, is the study of how information from the different sensory modalities (such as sight, hearing, touch, smell, taste, and proprioception) may be integrated by the nervous system.
• Multisensory learning — An instructional approach presenting coordinated material through more than one sensory modality so learners can integrate complementary representations.
• Perceptual Constancy — The phenomenon by which a perceiver holds an object's properties — size, shape, color, identity — stable despite large variation in the proximal stimulus, by inferring the distal property and implicitly factoring out the viewing condition.
• Precedence Effect — When two copies of a sound arrive within a short critical window (~1–40 ms), the auditory system localizes the fused percept entirely by the first-arriving wavefront and discounts the lagging copy's spatial claim, while still letting it contribute to loudness and timbre.
• Temporal Binding — Bind events that fall within a characteristic time window into a single perceived unit by attributing them to a shared source, warping subjective time and location to keep the percept consistent with that attribution.
• Ventriloquism Effect — A sound is mislocalised toward a synchronised visual event when the brain infers a common cause, because vision's lower spatial uncertainty pulls the merged location estimate toward it by inverse-variance weighting — gated by temporal and spatial binding windows beyond which the percept splits.
• Visual Capture — When vision conflicts with another sense about a shared property, the combined percept can be pulled toward the visual cue under conditions favoring vision.