Bias Specific Decision Audit¶
Audit high-stakes decisions for the specific bias vulnerabilities most likely to distort that decision type.
The Diagnostic Story¶
Symptom: The same generic review form is applied to every consequential decision. Reviewers can name a dozen biases but cannot say which one most threatens the decision sitting in front of them. Critical scrutiny arrives after public commitment, when correction is embarrassing. Findings go into a report that changes nothing about criteria, evidence flow, or who owns the call.
Pivot: Link the audit to the specific decision type and its known distortion pathways. Select proportionate checks for the biases most likely to corrupt this kind of reasoning, apply them before commitment, and record findings in a form that revises the process or documents residual risk.
Resolution: Review effort is concentrated where it can actually change the decision. Earlier corrections remove distorted evidence before it compounds. Repeated decisions of the same type accumulate process learning rather than repeating the same checklist theater.
Reach for this when you hear…¶
[venture capital] “We do the same due diligence checklist for every deal, but the bias that killed our last portfolio company was specific to founder-market fit assessments — nobody audits for that.”
[hospital credentialing] “We review every candidate the same way, but the systematic problem is affinity bias in peer references, and our current process doesn't even name it.”
[procurement] “We added three more sign-offs after the last procurement scandal, but we still haven't fixed the part where the vendor is already selected before the formal review starts.”
When This Archetype Applies¶
No catalog groundingNone of the structural conditions is currently represented by an accepted prime or domain-specific abstraction.
Diagnostic problem
A consequential decision is exposed to predictable distortion pathways, but the review process is absent, generic, too late, or detached from the actual decision structure.
What this problem means
Many organizations respond to bias risk with awareness training or long lists of cognitive biases. Those tools rarely change the structure of the decision. Reviewers may know that bias exists but still fail to identify the specific vulnerability in the current case.
The structural problem is a mismatch between broad bias awareness and concrete decision risk. A hiring decision, a diagnosis, a budget forecast, a strategic investment, and a policy rollout do not need the same checks. They differ in evidence channels, incentives, irreversibility, social pressure, affected parties, and known failure modes.
Show the applicability expression
Applicability expression4 distinct conditions
groundedpartly groundedopen
4 conditions, all required.
4Required in every casenumbered 1–4
These hold no matter which pattern applies.
High-stakes decision · open
The decision has high stakes or durable consequences.
This is a load-bearing situation condition in the diagnostic expression. The condition is: The decision has high stakes or durable consequences. If it does not hold, this particular condition set is incomplete.
Known bias vulnerability · open
The decision type has a known recurring vulnerability to one or more named cognitive or procedural biases.
The source archetype describes the situation as follows: The decision type has known recurring bias vulnerabilities. The normalized requirement above isolates the load-bearing portion used in this condition set.
Bias-insensitive review · open
Current review is generic, checklist-performative, or otherwise insensitive to the named bias mechanism.
The source archetype describes the situation as follows: Review is currently generic or performative. The normalized requirement above isolates the load-bearing portion used in this condition set.
Uninterrupted bias pathway · open
A named bias mechanism has a plausible causal path into this decision and existing review does not interrupt that path.
This condition preserves a load-bearing part of the diagnostic problem that was not captured by a source-condition atom. It remains explicit because omitting it would weaken the sufficient condition set.
Other requirements and context (2)
Why these sit outside the expression
Solution feasibility — it describes whether the intervention can work, not whether the diagnostic problem exists.
Deployment constraint — it constrains how the intervention must be deployed, not the situation that calls for it.
Solution feasibilityThe decision process can still change.
Those tools rarely change the structure of the decision. In this archetype, the relevant feasibility condition is: The decision process can still change. It identifies something that must be possible or available for the intervention to be workable.
Deployment constraintThe audit burden can be kept proportionate.
Coverage
0 of 4 conditions grounded · 4 open.
Mechanisms / Implementations¶
- Bias Audit: Runs a consequential decision through one structured pass — classify its type, map the few distortion pathways that actually threaten it, deploy only the matching checks, and either revise the process or record the bias risk left standing.
- Blind or Masked Review: Removes identifying or extraneous information — names, sources, affiliations, demographics — from what a reviewer sees, so judgment attaches to the work rather than to who produced it.
- Decision Checklist: A short, decision-specific list of the few bias checks worth running here, phrased as prompts a reviewer answers before closing — kept deliberately brief so it actually gets used.
- Decision Log: Captures each significant decision as a linked record — its rationale, the alternatives weighed, who approved it, and the artifacts it affects — so a choice can later be traced back to why it was made and forward to what it touched.
- Diagnostic Debiasing Check: A structured challenge to a favored explanation — force the alternative, seek what would disconfirm it, and re-examine confidence — matched to the known ways expert diagnosis goes wrong and calibrated over time against outcomes.
- Hiring Review Rubric: Fixes the criteria, weights, and anchored rating scales a hiring decision will be judged on before candidates are seen, so every applicant is scored on the same job-relevant dimensions instead of on gut fit.
- Independent Estimation: Collects judgments from several people separately, before any of them see the others' answers, then aggregates — so the estimate reflects genuinely independent information instead of the first number or the loudest voice.
- Red-Team Review
- Reference-Class Forecasting: Forecasts how long the subject will persist by placing it in a class of genuinely comparable cases and reading its lifetime off that class's distribution, instead of trusting a bottom-up guess.
- Structured Review Form: Turns a bias review into a filled record — the decision's context, the vulnerability map, the checks run and what they found, what changed, and the residual risk accepted — so a later reader can see what actually happened.
Related Abstractions¶
Abstractions this archetype builds on — directly (a source ingredient) or as a related pattern. Links follow the typed catalog namespace.
Built directly on (4)
- Bounded Rationality: Limited decision capacity.
- Confirmation Bias: Favor confirming evidence.
- Heuristic: Mental shortcuts.
- Uncertainty: Incomplete knowledge.
Also references 8 related abstractions
- Accountability: Responsibility for actions.
- Anchoring: Overweight initial info.
- Framing: Presentation shapes perception.
- Groupthink: Conformity overrides realism.
- Loss Aversion: Losses felt stronger than gains.
- Optimism Bias: Overestimate positive outcomes.
- Procedural Fairness (Due Process): Due process.
- Selection Bias: Skewed sampling.
Variants¶
Narrower or domain-specific specializations that share this archetype's core structure. Recognized variants are established; candidate variants are provisional.
Disconfirming Evidence Protocol · subtype · recognized
A bias-specific audit subtype that requires active search for evidence that could disprove a favored claim, diagnosis, plan, or interpretation.
Planning Fallacy Countermeasure · domain variant · recognized
A planning-focused variant that selects reference cases, independent estimates, uncertainty ranges, and buffers when plans are likely to be overoptimistic.
Priming Environment Control · implementation variant · recognized
A cue-environment variant that audits whether order, labels, visual context, exposure, or interface cues are influencing judgment without relevance.
Familiarity Bias Check · subtype · recognized
A variant that checks whether repeated exposure, incumbency, or familiarity is being mistaken for quality, truth, safety, or preference.
Loss-Frame Rebalancing · subtype · recognized
A variant that audits whether anticipated losses, transition costs, or downside framing dominate comparable gains and protections.
Independent Judgment Before Consensus · governance variant · recognized
A group-decision variant that captures individual estimates or views before discussion creates anchors, conformity, or premature agreement.
Editorial Notes¶
Problem Classification¶
Classification: Decision, Search & Optimization Failure → Bounded Judgment, Bias & Method Fit
Problem kernel: decision review misses its specific bias pathway
Rationale: A consequential choice faces predictable anchoring, salience, horizon, or other distortions, but review is generic, late, or detached from the actual structure.
Independent corroboration: The earliest necessary condition in the frozen evidence is: A consequential decision is exposed to predictable distortion pathways, but the review process is absent, generic, too late, or detached from the actual decision structure. That is a bounded judgment bias and method fit problem because Choice is distorted by bounded attention, predictable bias, horizon and risk salience, or mismatch among heuristics, algorithms, and exemplar-based reasoning.
Review outcome: Independent reviewer agreement; high confidence.