Eligibility Audit¶
Procedure — instantiates Category Boundary Audit
Runs a program's eligibility criteria against a panel of real and hypothetical applicants to check that they admit the intended cases, exclude only what the purpose requires, and treat borderline claims consistently.
Eligibility Audit takes a set of written eligibility rules and does the one thing that reveals whether they actually work: it runs them against cases. It assembles a panel of applicants — people the program clearly intends to serve, people it clearly should not, and the hard ones in between — and pushes each through the criteria as written rather than as intended, then checks three things at once. Do the rules let in the people the program is for (no silent false exclusion)? Do they keep out only what the purpose actually requires (no overbroad drift)? And are the borderline claims resolved consistently, or does the outcome depend on who processes them? Its defining discipline is the gap between the rule on paper and the rule in effect: an eligibility criterion can read as generous and still exclude its intended beneficiaries through a proof burden nobody meant to impose.
Example¶
A university runs a scholarship for first-generation, financially independent students. An Eligibility Audit builds a panel from real and constructed applicants. A student whose parent earned a degree abroad that no U.S. registrar recognizes. A twenty-three-year-old supporting two younger siblings but still claimed as a dependent on a parent's tax return. A young person raised in foster care who has no family tax documents at all. Each is run through the criteria exactly as the aid office would apply them.
The audit finds that "financially independent" is operationalized entirely through federal dependency status, which turns on documents the foster-care applicant cannot produce — a hidden proof burden that excludes precisely the student the scholarship most wants to reach. It also finds "first-generation" silently assumes a recognized U.S. credential, admitting the foreign-degree student's child by accident of definition. The outcome is concrete: an alternative-evidence pathway for applicants without standard tax records, a clarified first-generation definition tied to the scholarship's purpose, and a register of the borderline cases so the next reviewer resolves them the same way.
How it works¶
- Build a purposive panel. Deliberately include intended-in cases, intended-out cases, and borderline claims — a random sample of easy applicants would hide the failures.
- Apply the rule as written. Adjudicate each case using the literal criteria and the real evidence requirements, not the spirit the drafters had in mind.
- Classify the four outcomes. Correctly admitted, correctly excluded, false exclusion of an intended case, and false inclusion against the purpose.
- Flag proof-burden and consistency failures. Note every exclusion that traces to documentation, cost, language, or timing rather than substance, and any borderline case two adjudicators would decide differently.
- Check against purpose. Hold the results up to what the program is for, and recommend clarification, alternative evidence, or scope change.
Unlike Edge-Case Analysis, which mines hard cases to redesign the concept, this procedure validates a fixed rule set against a representative panel.
Tuning parameters¶
- Panel composition — how many hard and adversarial cases versus routine ones. More stress finds more failures but is not a picture of the typical caseload.
- Letter versus spirit — whether adjudication follows the rule verbatim or the drafters' intent. The verbatim reading is what actually happens at the counter and is the more honest test.
- Proof-burden sensitivity — how aggressively documentation and process costs are counted as de facto exclusions rather than neutral requirements.
- Adjudicator blinding — whether the same cases are scored independently by more than one reviewer to measure consistency; costs effort but is the only way to catch discretionary drift.
When it helps, and when it misleads¶
Its strength is catching the two quiet failures of an eligibility rule before they harm anyone: intended beneficiaries turned away by an accidental proof burden, and identical claims decided differently by different clerks.
Its central failure mode is auditing the paper rule while the real exclusion lives in the process — the form that must be notarized, the portal that times out, the office open only during working hours. A classic misuse is populating the panel with clean, obvious cases so the rule "passes." The guarding discipline is to seed the panel with genuinely hard cases and to trace exclusions to what the archetype calls administrative burden[1] — the learning, compliance, and psychological costs that fall hardest on the people a program most needs to reach — rather than judging the criteria on their wording alone.
How it implements the components¶
Eligibility Audit realizes the rule-validation face of the archetype — the components that test whether the written criteria do their job:
inclusion_rule— subjects the positive criteria to real cases, checking they admit the intended beneficiaries.exclusion_rule— tests whether the exclusions are necessary, proportional, and free of accidental proof burdens.edge_case_register— logs the borderline claims and how they were resolved, so consistency can be maintained.boundary_purpose_statement— holds every result against what the program is meant to accomplish, catching drift in either direction.
It does not compute error rates across affected populations (classification_error_profile) — that is Classification Fairness Review; nor does it run the reconsideration path for a single contested applicant (appeal_or_exception_path), which is Appeals Case Review.
Related¶
- Instantiates: Category Boundary Audit — validates the inclusion/exclusion logic that the audit's decision depends on.
- Sibling mechanisms: Boundary Critique Review · Taxonomy Review · Classification Fairness Review · Edge-Case Analysis · Ontology Audit · Category Governance Record · Appeals Case Review
Editorial Notes¶
Form Classification¶
Form family: Experiment, Test & Rehearsal
Rationale: The audit deliberately exercises the eligibility rule on a purposive panel of intended-in, intended-out, borderline, real, and hypothetical cases to expose its behavior.
Nearest alternative: Assessment, Review & Assurance — It yields audit findings, but those findings are generated by actively testing designed cases rather than only reviewing an existing record of eligibility decisions.
Review outcome: Adjudicated after independent review; high confidence.
Origin Attribution¶
Primary origin: Public Administration & Policy
Origin pattern: Cross-disciplinary synthesis
Present-day reach: Multi-domain
Rationale: Program administration supplies the practice of testing admission criteria against actual and hypothetical claimants to verify intended coverage and consistent edge-case treatment.
Related originating lineages:
- Law & Governance — Administrative-law review supplies legality, equal-treatment, reasons, and appeal requirements for exclusions.
Review resolution: The current reviewers agree that public_administration_policy is primary. For the reported differences (reported_ambiguity, alternate_origin_disagreement, origin_mode_disagreement, domain_reach_disagreement, encyclopedia_synthesis_disagreement), the evidence supports cross_disciplinary_synthesis, multi_domain, and law_governance; these choices preserve materially formative origins without conflating later domain reach.
Attribution caveat: The audit form combines program evaluation with legal review of rule-governed access.
Encyclopedia synthesis: The exact catalogued form synthesizes established practice rather than reproducing a single standard historical label.
Review outcome: Reconciled after independent review; medium confidence.
References¶
[1] Herd, P., and Moynihan, D. P. Administrative Burden: Policymaking by Other Means. Russell Sage Foundation (2018). Defines administrative burden through learning, compliance, and psychological costs that disproportionately impede disadvantaged people’s access to programs. registry ↩