Skip to content

Counterfactual Comparison

Compare what happened with a plausible alternative to isolate causal effect or decision value.

The Diagnostic Story

Symptom: An outcome is evaluated on its own terms — success or failure, guilty or blameless — without naming what would have happened under any alternative condition. The baseline is unstated or cherry-picked, and the comparison being made sounds causal but tracks something else entirely. Hindsight locks the story: the outcome was obvious, the decision was reckless, the result was inevitable. Disagreements about value persist even after everyone agrees on what actually happened.

Pivot: Replace outcome-only judgment with an explicit actual-versus-counterfactual comparison. Name the actual path, define the plausible alternate condition, select and justify a reference baseline, and limit all causal, responsibility, or value claims to what the comparison can genuinely support.

Resolution: Better causal attribution and fairer decision evaluation become possible because the missing path is made visible and its plausibility is checked. Opportunity costs are clearer, learning under uncertainty improves, and speculative what-if reasoning is bounded by the comparison's honest scope.

Reach for this when you hear…

[public policy] “We're calling the program a success because outcomes went up, but we never said what we expected to happen without it.”

[litigation] “You can't say the surgeon caused the harm without first saying what the outcome would have been had she done nothing.”

[investment review] “The fund beat the benchmark, sure — but nobody agreed on the benchmark before we wrote the check.”

Mechanisms / Implementations

  • What-If Analysis: Is a mechanism for eliciting an alternate condition.
  • Control Group Comparison: Compares treated units against otherwise-similar untreated ones to recover what total use would have been without the efficiency program — separating the real saving from the rebound and from what would have happened anyway.
  • Synthetic Control Method: A synthetic control method constructs a comparison baseline from weighted combinations of other units.
  • A/B Test: An A/B test implements counterfactual comparison by assigning comparable units to different versions.
  • Baseline Comparison: Uses a previous trend, expected trajectory, benchmark, or no-action forecast.
  • Scenario Contrast: Compares the actual path with a described alternative.
  • Matched Case Comparison: Pairs similar cases, groups, time periods, or contexts.
  • Counterfactual History Review: Uses historically plausible alternatives to test contingency.

Abstractions this archetype builds on — directly (a source ingredient) or as a related pattern. Links follow the typed catalog namespace.

Built directly on (2)

Also references 8 related abstractions

Variants

Narrower or domain-specific specializations that share this archetype's core structure. Recognized variants are established; candidate variants are provisional.

Causal Effect Counterfactual Comparison · subtype · recognized

Compares observed outcome under an action or exposure with the outcome expected under no action or a different exposure in order to estimate causal effect.

Decision-Value Counterfactual Comparison · subtype · recognized

Compares the actual decision with a feasible alternative to judge value, regret, opportunity cost, avoided harm, or future decision policy.

Historical Counterfactual Comparison · temporal variant · candidate

Uses historically plausible alternatives to test contingency, agency, structural force, or decision significance in events that cannot be experimentally replayed.

Baseline Selection Counterfactual Comparison · implementation variant · likely subtype

Focuses the counterfactual work on choosing and defending the baseline that stands in for the unobserved alternative.

Counterfactual Contingency Testing · temporal variant · merge review

Uses plausible what-if alternatives to test whether an outcome depended on a specific condition, choice, timing, or contingent event.