Skip to content

Risk Evidence Review

Calibration review — instantiates Affect–Evidence Separation

Weighs a felt sense of danger or safety against likelihood, consequence, controls, and reversibility, then sets a proportionate — often reversible — response.

Version
v2 · 2026-08-28 · History
Mechanism #
7674
Type
Calibration Review
Form family
Assessment, Review & Assurance
Solution family
Reframing & Sensemaking
Problem family
Uncertainty, Evidence & Inference Failure
Problem subfamily
Belief Bias, Confidence & Revision Governance
Origin domain
Psychology
Also from
Cognitive Science, Engineering & Design, Statistics & Experimental Design
Instantiates
Affect–Evidence Separation

When the feeling in play is fear of a hazard or a sense of safety, the evidence that matters has a specific shape: how likely is the bad outcome, how bad would it be, what controls stand in the way, and can the action be undone? Risk Evidence Review is the mechanism specialized to that case. It takes a felt danger or felt comfort and forces it to stand against those risk quantities, then lands on a response scaled to what the evidence supports — proceed, add a control, defer, or take the reversible version. Its distinctive move is that its evidence check is risk-typed: it doesn't build a general ledger of observations, it estimates likelihood × consequence against existing controls and reversibility, and turns that into a proportionate action. It is where "this feels dangerous" (or, more insidiously, "this feels fine") is made to justify itself in risk terms.

Example

Two weeks before a small satellite launch, a booster on an unrelated vehicle fails spectacularly on a livestream — a fireball everyone on the team watches on repeat. The next morning the room feels their own launch is unsafe; the vivid image has made catastrophe feel imminent. A Risk Evidence Review keeps that feeling from either grounding the rocket or being waved away. The team lays the claim — "we are about to have that failure" — against the risk quantities: the failed booster used a different engine and a valve their design doesn't share; their own component has flown a number of times without incident; the failure mode they're now afraid of has a control already in place. Likelihood turns out low, consequence high, controls present. The proportionate response isn't "scrub" and isn't "ignore" — it's the reversible one: hold the launch two days to re-inspect the one shared subsystem, a move they can undo the moment the inspection clears. The fear got a hearing; it did not get the last word.

How it works

  • Type the feeling as risk. Establish whether the affect is felt danger or felt safety, and about which specific hazard — this scopes what evidence counts.
  • Estimate the risk quantities. Compare the claim against likelihood, consequence, existing controls, and reversibility, rather than against a general pile of observations. Vividness and recency get explicitly discounted here.
  • Set the response boundary. Map evidence strength and stakes to a proportionate action: strong evidence justifies decisive movement, weak evidence with high stakes justifies a control, a delay, or the reversible option.
  • Prefer reversibility when uncertain. When the risk estimate is genuinely uncertain but action can't wait, the review defaults to the recoverable action so a wrong call stays cheap.

Tuning parameters

  • Evidence threshold — how strong the evidence must be before decisive action is licensed. Raise it with stakes and irreversibility; too high and the review becomes endless caution.
  • Likelihood-vs-consequence weighting — how much a low-probability, high-severity risk counts relative to a likely, mild one. Shifts the whole review toward either boldness or dread.
  • Vividness discount — how aggressively a recent, salient incident is down-weighted relative to base rates. Under-discount and availability rules the room; over-discount and a real warning gets dismissed.
  • Reversibility preference — how strongly the response defaults to the recoverable option under uncertainty. High preference protects against irreversible error at some cost to decisiveness.

When it helps, and when it misleads

Its strength is calibration: it keeps a vivid but rare hazard from grounding a sound plan, and it keeps a comfortable but real hazard from sailing through, by making both stand on likelihood, consequence, controls, and reversibility rather than on how the room feels. Its reversibility default gives it a safe move even when the estimate is uncertain.

Its failure modes run in both directions. Felt danger, freshly stoked by a vivid incident, inflates a rare risk until the review scrubs things that should fly (availability doing the work of evidence). Far more dangerous is the opposite: felt safety quietly lowering the threshold, so that anomalies get accepted as normal because nothing has gone wrong yet — the slow drift of normalization of deviance.[1] The tidy risk numbers can also lend false precision to consequences (lives, trust) that resist quantification. The guarding discipline is to run the check against both felt danger and felt safety, hold the evidence threshold fixed to stakes rather than to mood, and treat an unbroken streak as evidence to examine, not to relax.

How it implements the components

Risk Evidence Review realizes the risk-typed evidence check and the response it drives:

  • evidence_check — compares the felt-risk claim against likelihood, consequence, controls, and reversibility, discounting vividness and recency.
  • decision_boundary — maps evidence strength and stakes onto a proportionate response, from decisive action to a control to a deferral.
  • reversible_action_option — supplies the recoverable move the review defaults to when the risk estimate is uncertain but action cannot wait.

The review starts from an already-named feeling: it does not perform the affect_label or surface the judgment_claim — that front end is Emotion Labeling — and it does not run a dedicated counterevidence_probe ledger, which is Evidence Log. Its nearest twin is Decision Pause Protocol, which reaches the same kind of bounded, reversible choice but on a single in-the-moment cue; this review reaches it on a weighed risk estimate, the evidence check the pause has no time for.

Editorial Notes

Form Classification

Form family: Assessment, Review & Assurance

Rationale: Risk Evidence Review operates as a bounded evaluation of existing evidence or work that produces a finding or disposition because it weighs a felt sense of danger or safety against likelihood, consequence, controls, and reversibility, then sets a proportionate — often reversible — response.

Independent corroboration: The frozen evidence defines Risk Evidence Review as 'Weighs a felt sense of danger or safety against likelihood, consequence, controls, and reversibility, then sets a proportionate — often reversible — response', so its operative form is Assessment, Review & Assurance.

Nearest alternative: Decision, Gate & Allocation — Risk Evidence Review includes features of a case-specific gate, selection, routing, prioritization, or resource disposition, but its defining operation is a bounded evaluation of existing evidence or work that produces a finding or disposition.

Review outcome: Independent reviewer agreement; medium confidence.

Origin Attribution

Primary origin: Psychology

Origin pattern: Cross-disciplinary synthesis

Present-day reach: Universal

Rationale: Comparing felt danger with evidence and choosing a proportionate reversible response draws on cognitive-behavioral risk appraisal.

Related originating lineages:

  • Cognitive Science — Cognitive-science research on representation, learning, and recall supplies a parallel or contributing lineage for the mechanism's defining operation: weighs a felt sense of danger or safety against likelihood, consequence, controls, and reversibility, then sets a proportionate — often reversible — response.
  • Engineering & Design — Hazard analysis materially supplies consequence, controls, and reversibility dimensions.
  • Statistics & Experimental Design — Likelihood evidence provides calibrated correction to intuition.

Review resolution: Both blind reviewers agree that psychology is the primary historical origin. Explicit reconciliation of alternate origin disagreement, origin mode disagreement, domain reach disagreement starts from reviewer_a’s mechanism-specific evidence: Comparing felt danger with evidence and choosing a proportionate reversible response draws on cognitive-behavioral risk appraisal. Reviewer A proposed alternates=engineering_design, statistics_experimental_design, origin_mode=cross_disciplinary_synthesis, domain_reach=universal, and encyclopedia_synthesis=true; reviewer B proposed alternates=cognitive_science, origin_mode=single_lineage, domain_reach=multi_domain, and encyclopedia_synthesis=true. The final record retains every independently supported alternate from either review (engineering_design, statistics_experimental_design, cognitive_science) without an arbitrary cap, selects origin_mode=cross_disciplinary_synthesis to represent the combined lineage evidence, and keeps domain_reach=universal and encyclopedia_synthesis=true from the more mechanism-specific assessment. Present-day transfer is recorded as reach and is not treated as proof of historical origin.

Encyclopedia synthesis: The exact catalogued form synthesizes established practice rather than reproducing a single standard historical label.

Review outcome: Reconciled after independent review; medium confidence.

References

[1] Vaughan, D. The Challenger Launch Decision: Risky Technology, Culture, and Deviance at NASA. University of Chicago Press (1996). Traces how repeated anomaly acceptance became normalized over time. registry