Outsider Oversight¶
Raji, I. D., Xu, P., Honigsberg, C., & Ho, D. (2022). Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance. Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society, 557-571.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Journalistic Objectivity
- Independence requirements developed for financial audit — no consulting relationships, no performance-tied compensation, rotation — carry into model evaluation, where third-party evaluators cannot be paid on whether the model passes and cannot also be optimizing it.
This sourceDraws independence lessons from financial-audit, environmental, and other oversight regimes (no conflicting relationships, third-party position) and applies them to external algorithmic auditing — the transfer of audit/recusal independence structure into AI model evaluation, where the builder cannot audit their own system.
- Independence requirements developed for financial audit — no consulting relationships, no performance-tied compensation, rotation — carry into model evaluation, where third-party evaluators cannot be paid on whether the model passes and cannot also be optimizing it.
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:0df831cb970c · see in the full table