Lost in the middle¶
Liu, N. F., Lin, K., Hewitt, J., Paranjape, A., Bevilacqua, M., Petroni, F., & Liang, P. (2024). Lost in the middle: How language models use long contexts. Transactions of the Association for Computational Linguistics, 157-173.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Attentional Capacity
- The intervention family transfers from the human-factors literature with structural fidelity: filter upstream (RAG), automate per-task draw (caching), route across modality-analogs (mixture-of-experts), design the inference duty cycle to manage exhaustion (context windowing).
This sourceEmpirical demonstration that long-context models allocate attention-head capacity unevenly across position — retrieval is highest at context start/end and degrades in the middle
- The intervention family transfers from the human-factors literature with structural fidelity: filter upstream (RAG), automate per-task draw (caching), route across modality-analogs (mixture-of-experts), design the inference duty cycle to manage exhaustion (context windowing).
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:ab2dfb9bd766 · see in the full table