Evaluating Large Language Models in Theory of Mind Tasks.¶
Kosinski, M. (2024). Evaluating Large Language Models in Theory of Mind Tasks. Proceedings of the National Academy of Sciences, 121(45).
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Theory Of Mind
- False-belief tasks and Sally–Anne protocols have been ported directly into evaluations of large language models and embodied agents, revealing analogous failure modes.
This sourcePorts false-belief and Sally–Anne-style protocols into evaluations of large language models, revealing analogous performance and failure patterns.
Supported in partVerified against the work's full text
Kosinski ran false-belief and Sally-Anne tasks on eleven LLMs, with failures on older models, but did not test embodied agents.
“Eleven large language models (LLMs) were assessed using 40 bespoke false- belief”
- False-belief tasks and Sally–Anne protocols have been ported directly into evaluations of large language models and embodied agents, revealing analogous failure modes.
Verification¶
Does it exist? Confirmed. This work's DOI resolves to a registered record, which fixes its identity. That is all it fixes.
Does it back the claim? Read against the text for 1 of 1 citation: 1 supported in part. Each verdict is shown under its citation below, with what in the work backs the sentence.
Support is checked per citation rather than per work — the same source can be cited soundly in one article and wrongly in another. Per-citation recording began recently, so a citation with no recorded check is a gap in the record rather than evidence it went unchecked.
See how references were verified.
Registry ID ref:ab91a936ef7b · see in the full table