Adaptive Mixtures of Local Experts.¶
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991). Adaptive Mixtures of Local Experts. Neural Computation, 3(1), 79-87.
Cited by¶
3 citations across 3 artifacts.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Cognitive Flexibility
- The broader-repertoire-survives-disturbance finding from behavioral ecology transfers to ensemble and mixture-of-experts architectures in machine learning, where the gating-network problem is the structural twin of the foraging trigger problem.
This sourceIntroduces the mixture-of-experts architecture in which a gating network selects among specialized experts — the structural twin of repertoire-plus-trigger switching.
- The broader-repertoire-survives-disturbance finding from behavioral ecology transfers to ensemble and mixture-of-experts architectures in machine learning, where the gating-network problem is the structural twin of the foraging trigger problem.
- Precision Weighting
- In weighted wisdom-of-crowds, contributions can scale with demonstrated accuracy; in mixture-of-experts and ensemble averaging, components are weighted by estimated reliability.
This sourceIntroduces mixture-of-experts, with the gating network a learned reliability-weighted allocator across experts.
- In weighted wisdom-of-crowds, contributions can scale with demonstrated accuracy; in mixture-of-experts and ensemble averaging, components are weighted by estimated reliability.
Mechanisms¶
- Local Model Ensemble with Gating
- This gating-network design is a mixture-of-experts architecture.
This sourceDefines an adaptive mixture architecture in which a gating network selects or weights local expert networks for each case.
- This gating-network design is a mixture-of-experts architecture.
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:428dc13b0a05 · see in the full table