Emergent World Representations¶
Li, K., Hopkins, A. K., Bau, D., Viégas, F., Pfister, H., & Wattenberg, M. (2022). Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task. arXiv preprint.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Good Regulator Theorem
- In AI and reinforcement learning, model-free agents seem to violate the theorem, but a successful policy network provably encodes predictive structure about its environment, and interpretability work on emergent world-models is the theorem instantiated in deep learning.
This sourceInterpretability evidence that a sequence model trained on Othello moves develops an internal representation of board state that causally controls its outputs — the good regulator theorem instantiated in deep learning.
- In AI and reinforcement learning, model-free agents seem to violate the theorem, but a successful policy network provably encodes predictive structure about its environment, and interpretability work on emergent world-models is the theorem instantiated in deep learning.
Verification¶
Does it exist? Not checked yet. This entry carries no identifier to resolve. It was extracted from the citation as written in the article, normalized, and deduplicated against the rest of the registry.
Does it back the claim? Not recorded. The single citation of this work carries no recorded support check.
Support is checked per citation rather than per work — the same source can be cited soundly in one article and wrongly in another. Per-citation recording began recently, so a citation with no recorded check is a gap in the record rather than evidence it went unchecked.
See how references were verified.
Registry ID ref:49b827ad2b63 · see in the full table