Attention Is Not Explanation¶
Jain, S., & Wallace, B. C. (2019). Attention Is Not Explanation. Proceedings of NAACL-HLT 2019.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Emic And Etic
- In AI interpretability, a model's emitted reasoning (emic — what it says it is doing) and its mechanistic description via probes (etic — what the circuits implement) are explicitly mapped in faithfulness work.
This sourceRepresentative faithfulness work testing whether a model's attended/emitted rationale matches its mechanistic computation — the emic self-report versus etic mechanistic account.
- In AI interpretability, a model's emitted reasoning (emic — what it says it is doing) and its mechanistic description via probes (etic — what the circuits implement) are explicitly mapped in faithfulness work.
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:59ed2af65418 · see in the full table