Distributed Representations.¶
Hinton, G. E., McClelland, J. L., & Rumelhart, D. E. (1986). Distributed Representations. Parallel Distributed Processing, 1, 77-109.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Population Coding
- The entire field of distributed representations in neural networks was a deliberate import of population-coding insights from neuroscience, and word embeddings, hidden-layer codes, and transformer activations all instantiate the pattern that no single dimension is the representation.
This sourceArgues that concepts are represented as patterns of activity over many units, importing population-coding logic into neural networks.
Supported in partVerified against the work's full text
Hinton et al. define distributed representations as patterns over many units; they do not claim a deliberate import from neuroscience population coding or discuss word embeddings or transformers.
“Each entity is represented by a pattern of activity distributed over many computing elements, and each computing element is involved in representing many different entities.”
- The entire field of distributed representations in neural networks was a deliberate import of population-coding insights from neuroscience, and word embeddings, hidden-layer codes, and transformer activations all instantiate the pattern that no single dimension is the representation.
Verification¶
Does it exist? Not checked yet. This entry carries no identifier to resolve. It was extracted from the citation as written in the article, normalized, and deduplicated against the rest of the registry.
Does it back the claim? Read against the text for 1 of 1 citation: 1 supported in part. Each verdict is shown under its citation below, with what in the work backs the sentence.
Support is checked per citation rather than per work — the same source can be cited soundly in one article and wrongly in another. Per-citation recording began recently, so a citation with no recorded check is a gap in the record rather than evidence it went unchecked.
See how references were verified.
Registry ID ref:f7b795f43305 · see in the full table