Hopfield Networks is All You Need.¶
Ramsauer, H., Schäfl, Lehner, Seidl, Widrich, Gruber, Holzleitner, et al. (2020). Hopfield Networks is All You Need. arXiv:2008.02217.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Associative Memory
- Machine learning: Vector databases and embedding-retrieval systems fetch items by nearest-neighbor similarity in a learned representational space; the attention mechanism of modern transformers is itself a soft, differentiable associative read, where a query vector retrieves a similarity-weighted blend of stored values.
This sourceShows the transformer attention mechanism is equivalent to a continuous-state (modern Hopfield) associative read: a query retrieves a similarity-weighted blend of stored values in a single update. SUPPORTS marker 131.
- Machine learning: Vector databases and embedding-retrieval systems fetch items by nearest-neighbor similarity in a learned representational space; the attention mechanism of modern transformers is itself a soft, differentiable associative read, where a query vector retrieves a similarity-weighted blend of stored values.
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:9506f5e403af · see in the full table