McGurk effect¶
Show that speech perception is intrinsically multimodal: a face articulating /ga/ over an audio /ba/ is heard as /da/, because the auditory and visual streams are fused into a single percept — by reliability-weighted, coherence-gated combination — before the result reaches awareness.
Core Idea¶
The McGurk effect is a multisensory speech illusion in which conflicting visual and auditory phoneme information is fused into a third percept corresponding to neither input: a face articulating /ga/ over an audio /ba/ is heard as /da/. The structural claim is that speech perception is intrinsically multimodal — the streams are combined pre-attentively, before awareness — obeying a reliability-weighting rule and requiring spatio-temporal coherence to integrate at all.
Scope of Application¶
The McGurk effect lives across the subfields that study audiovisual speech — perception science, neuroscience, audiology, and linguistics — wherever a perceiver fuses conflicting auditory and visual articulation pre-attentively.
- Perception and cognitive science — the canonical demonstration that modalities are not encapsulated.
- Neuroscience — localizing integration regions (superior temporal sulcus, premotor cortex).
- Audiology and clinical communication — bearing on cochlear-implant users and lip-reading training.
- Linguistics — evidence for the motor theory and against auditory-only phoneme models.
- Speech technology and HCI — lip-sync tolerances kept within the coherence window since misalignment degrades intelligibility.
- Cross-cultural psychology — susceptibility tracking language community as a probe of experience-tuned weights.
Clarity¶
Naming the effect overturns the tacit picture in which hearing is auditory and the eyes merely assist: vision is a constituent of the percept, combined before awareness. The decisive distinction it sharpens is pre-attentive integration versus post-perceptual inference, settled by cognitive impenetrability — the fusion survives knowing the trick. It also recasts "do vision and audition interact?" into measurable questions about weighting and the coherence boundary.
Manages Complexity¶
Audiovisual speech perception is a thicket of disconnected facts. The McGurk effect collapses them to one structure: multimodal integration into a single pre-attentive percept by reliability-weighted combination gated on plausibly sharing one source. The qualitative outcome of any manipulation then follows from a few parameters — channel reliability sets capture direction, spatio-temporal coherence sets whether integration happens, cognitive penetrability sorts the percept's stage, and linguistic experience sets the weights.
Abstract Reasoning¶
The effect licenses a locus diagnostic reasoning from an illusion's robustness to the integration stage via a cognitive-impenetrability test, with the eyes-closed/eyes-open toggle as causal probe. Its predictive move reads capture direction off reliability weighting, its boundary-drawing move fixes fusion within the source-plausibility window, and its experience-calibration move infers the weights are tuned by linguistic exposure, with an applied corollary about lip-sync and intelligibility.
Knowledge Transfer¶
Within speech and multimodal-perception research the effect transfers as mechanism across subfields viewing one integration substrate through different instruments. Beyond speech, the lip-sync implication transfers literally wherever streams plausibly share a source; the integration machinery recurs across sibling illusions (ventriloquism, rubber-hand, sound-induced flash) as co-instances of the parent Multisensory integration / crossmodal_binding. The speech-specific cargo — phoneme fusion, articulatory cues, language-tuned weights — stays home; loose non-perceptual invocations are analogy.
Relationships to Other Abstractions¶
Current abstraction McGurk effect Domain-specific
Parents (1) — outgoing typed relations
-
McGurk effect is a decomposition of Bayesian Cue Integration Prime
Removing audiovisual-speech furniture leaves Bayesian Cue Integration's reliability-weighted fusion of simultaneous noisy cues to one latent speech event, conditional on common-source coherence.
Hierarchy path (1) — routes to 1 parentless root
- McGurk effect → is a decomposition of Bayesian Cue Integration → is a kind of Precision Weighting → is a kind of Aggregation → is a kind of Transformation → is a kind of, typical Function (Mapping)
Neighborhood in Abstraction Space¶
McGurk effect sits in a sparse region of the domain-specific corpus (62nd percentile for distinctiveness): few abstractions share its structure, so a faithful description tends to retrieve it precisely.
Family — Multisensory Perception & Binding (15 abstractions)
Nearest neighbors
- Dichotic Listening — 0.87
- Precedence Effect — 0.85
- Consonance — 0.85
- Ventriloquism Effect — 0.84
- Nonverbal Communication — 0.84
Computed from structural-signature embeddings · 2026-10-25