Outsider Oversight¶
Raji, I. D., Xu, P., Honigsberg, C., & Ho, D. (2022). Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance. Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society, 557-571.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Journalistic Objectivity
- Independence requirements developed for financial audit — no consulting relationships, no performance-tied compensation, rotation — carry into model evaluation, where third-party evaluators cannot be paid on whether the model passes and cannot also be optimizing it.
This sourceDraws independence lessons from financial-audit, environmental, and other oversight regimes (no conflicting relationships, third-party position) and applies them to external algorithmic auditing — the transfer of audit/recusal independence structure into AI model evaluation, where the builder cannot audit their own system.
Supported in partVerified against the publisher's abstract
The abstract confirms the transfer of institutional-design lessons from financial, environmental, and health audit regimes to algorithmic auditing, but names no specific independence mechanism such as rotation or performance-tied pay.
“we survey audit systems across domains - e.g., financial, environmental, and health regulation - and show that the institutional design of such audits are far from monolithic. Finally, we survey the evidence base around these design components and spell out the implications for algorithmic auditing.”
- Independence requirements developed for financial audit — no consulting relationships, no performance-tied compensation, rotation — carry into model evaluation, where third-party evaluators cannot be paid on whether the model passes and cannot also be optimizing it.
Verification¶
Does it exist? Confirmed. This work's DOI resolves to a registered record, which fixes its identity. That is all it fixes.
Does it back the claim? Read against the text for 1 of 1 citation: 1 supported in part. Each verdict is shown under its citation below, with what in the work backs the sentence.
Support is checked per citation rather than per work — the same source can be cited soundly in one article and wrongly in another. Per-citation recording began recently, so a citation with no recorded check is a gap in the record rather than evidence it went unchecked.
See how references were verified.
Registry ID ref:0df831cb970c · see in the full table