Technology Impact Base-Rate Review¶
Method — instantiates Horizon-Calibrated Impact Forecasting
Before accepting a forecast, positions the focal technology inside a reference class of analogous past adoptions — including flops and slow-burn successes — and lets the class's realized spread set the anchor and the uncertainty band.
Every new technology arrives wrapped in a story about why it is unprecedented — which is precisely why forecasts built from the inside run wild. Technology Impact Base-Rate Review refuses the inside view. Before it will entertain a horizon-specific claim, it asks what happened to the class of things this most resembles: prior platforms, format transitions, rollouts, and interventions that faced the same familiar adoption bottlenecks. It anchors the forecast on the realized distribution of that reference class and, just as importantly, sets the uncertainty band from how widely the class actually dispersed. Its one distinguishing idea is that the outside view governs: the base rate of comparable technologies, not the vividness of this one's demo, sets the starting number. It is external-analog comparison — not an internal interrogation of the forecast's horizon structure, and not an inventory of this project's frictions.
Example¶
A consumer-hardware maker is forecasting mass adoption of a new virtual-reality headset. The launch demo is genuinely stunning, and the internal projection has VR in a third of living rooms within five years. The Base-Rate Review sets the demo aside and builds a reference class of prior consumer-hardware bets: 3D television (heavily hyped, adopted, then abandoned), the smartphone (slow for years, then explosive), tablets (fast then plateaued), fitness wearables (steady but niche). It reads the class's realized trajectories — most consumer-hardware categories that looked transformative took far longer than promised, and a meaningful fraction never crossed into the mainstream at all.
Positioned in that distribution, the headset's five-year claim moves from the optimistic tail to the middle, and — because the class disperses enormously between 3D TV and the smartphone — the confidence band is set wide, wider at the long horizon than the short. The review's product is not a verdict but a disciplined anchor: "comparable categories reached this penetration in eight-to-fifteen years with a one-in-three failure rate; justify why this one is faster before you budget for it."[n1]
How it works¶
- Define the reference class. Decide what genuinely counts as analogous — same adoption bottlenecks, similar complement dependence — and fix it before looking at the answer.
- Gather realized outcomes, failures included. Pull the actual trajectories of class members, correcting for survivorship by deliberately seeking the ones that flopped.
- Position the focal case. Locate this technology within the class distribution rather than treating it as a category of one.
- Set anchor and band. Take the class central tendency as the anchor and its dispersion as the confidence band, widening the band at horizons where the class scattered most.
Tuning parameters¶
- Class breadth — a narrow, highly-similar class (few, tight) or a broad one (many, noisy). Narrow classes are more relevant but statistically thin; broad ones are stable but blur.
- Failure inclusion — how aggressively you correct for survivorship by including abandoned analogs. Omit them and the base rate flatters; include them and it sobers.
- Adjustment allowance — how far you permit the forecast to depart from the anchor for genuine idiosyncrasies. Wide allowance quietly restores the inside view you were trying to escape.
- Band derivation — whether the confidence band is the raw class spread or a narrowed version; and how much it widens per horizon.
When it helps, and when it misleads¶
Its strength is deflating uniqueness: it is the cheapest, most robust correction for both the planning fallacy on the near horizon and the "this changes everything" narrative overall, and it produces an honestly wide band where the evidence is genuinely thin.
Its failure mode is that the whole method rides on the choice of reference class, and a class can be gerrymandered to yield any answer — a friendly analogist picks smartphones, a hostile one picks 3D TV. Bad analogies manufacture false discipline, lending the authority of history to a comparison that doesn't hold. It can also over-anchor, flattening a genuine step-change into "just another gadget." The guarding discipline is to pre-register the reference class before seeing where the focal case lands, to include disconfirming analogs by rule, and to state plainly what would justify departing from the base rate.
How it implements the components¶
base_rate_and_reference_class_anchor— its core: the assembled distribution of analogous adoptions against which the focal forecast is anchored.confidence_band_by_horizon— the class's realized dispersion sets each horizon's uncertainty band, typically widening as the horizon lengthens.
It does not decompose the claim into horizon cells or assign each an action posture — horizon_segmented_impact_claim and action_portfolio_by_horizon belong to Three-Horizons Impact Review, its nearest twin: base-rate review supplies the outside-view anchor that those horizon cells are then checked against, whereas three-horizons interrogates the internal confusion between operate-now, transition, and future claims.
Related¶
- Instantiates: Horizon-Calibrated Impact Forecasting — Base-Rate Review supplies the outside-view anchor and band the rest of the forecast is disciplined against.
- Sibling mechanisms: Adoption Bottleneck Mapping · Compounding Trajectory Modeling · Three-Horizons Impact Review · Horizon-Split Forecast Canvas · Hype Deflation Checklist · Impact Signal Dashboard · Staged Option Investment Plan · Near-Term De-escalation / Long-Term Sustain Gate · Forecast Backtesting Cadence
Editorial Notes¶
Form Classification¶
Form family: Assessment, Review & Assurance
Rationale: Technology Impact Base Rate Review is defined in the frozen evidence as: Before accepting a forecast, positions the focal technology inside a reference class of analogous past adoptions — including flops and slow-burn successes — and lets the class's realized spread set the anchor and the uncertainty band. Its operative deployed or enacted form is therefore Assessment, Review & Assurance.
Nearest alternative: Analysis, Modeling & Optimization — Analysis, Modeling & Optimization can support this mechanism, but the evidence centers the concrete operation described above rather than the alternative family's defining operation.
Review outcome: Adjudicated after independent review; medium confidence.
Origin Attribution¶
Primary origin: Futurism & Strategic Foresight
Origin pattern: Cross-disciplinary synthesis
Present-day reach: Universal
Rationale: Technology impact base rate review derives most directly from foresight's scenario, horizon-scanning, and anticipatory-planning tradition; its defining operation is to before accepting a forecast, positions the focal technology inside a reference class of analogous past adoptions — including flops and slow-burn successes — and lets the class's realized spread set the anchor and the uncertainty band.
Related originating lineages:
- Innovation & Entrepreneurship — Innovation practice's piloting, adoption, and technology-transition tradition provides a formative adjacent lineage for the same technology impact base rate review operation.
- Organizational & Management Science — Organizational design, management, and operational governance supplies a parallel or contributing lineage for the mechanism's defining operation: before accepting a forecast, positions the focal technology inside a reference class of analogous past adoptions — including flops and slow-burn successes — and lets the class's….
- Statistics & Experimental Design — Statistics, experimental design, and measurement theory supplies a parallel or contributing lineage for the mechanism's defining operation: before accepting a forecast, positions the focal technology inside a reference class of analogous past adoptions — including flops and slow-burn successes — and lets the class's….
Review resolution: Both blind reviewers independently select futurism_foresight as the primary historical origin for the concrete operation—Before accepting a forecast, positions the focal technology inside a reference class of analogous past adoptions — including flops and slow-burn successes — and lets the class's realized spread set the anchor and the uncertainty band. The queued differences concern alternate origin disagreement, origin mode disagreement, encyclopedia synthesis disagreement, not the primary lineage. I retain every alternate that either reviewer explains, without a numeric cap, and choose origin_mode=cross_disciplinary_synthesis because the reviewers' combined evidence identifies material construction from multiple disciplines. domain_reach=universal records later portability rather than multiplying historical origins; confidence=high is the conservative shared evidentiary level, and encyclopedia_synthesis=true preserves either reviewer's affirmative synthesis finding.
Encyclopedia synthesis: The exact catalogued form synthesizes established practice rather than reproducing a single standard historical label.
Review outcome: Reconciled after independent review; high confidence.
Notes¶
[n1] Reference-class forecasting (Kahneman & Tversky's "outside view," extended to projects by Bent Flyvbjerg): forecast an uncertain case by studying the distribution of outcomes for a class of similar past cases rather than by building up a story about this one. It is the standard corrective to optimism and uniqueness bias. ↩