Structured Forecasting Panel¶
Workflow — instantiates Structured Expert Judgment Iteration
Uses repeated expert estimates, feedback, and uncertainty summaries to assess future events, timelines, or probabilities.
A Structured Forecasting Panel is the workflow for pointing structured expert judgment at the future — a dated, checkable prediction about when an event happens or how likely it is. Its defining features are all forward-looking: the output is a probability distribution over an outcome, that distribution is wired to a specific decision it is meant to move, and it carries update triggers — pre-named signals that, when they fire, reopen the forecast. Because the question is about a future that will actually arrive, the panel's judgments are eventually scorable, which disciplines the whole enterprise: a forecast is not a position to defend but a bet to be graded and revised. Where its policy twin decides who is in the room and what is being asked, this workflow assumes those are settled and concentrates on producing a live, decision-linked estimate of what will happen and when.
Example¶
A consumer-electronics firm needs to plan capital commitments around when a new battery chemistry reaches cost parity with the incumbent — a timeline question that will decide a factory-tooling investment. A Structured Forecasting Panel takes it on. Analysts across supply-chain, materials, and market functions each submit not a date but a distribution over the parity year, and the panel summarizes the pool as an uncertainty range: a most-likely window of 2029–2031 with a long tail into the mid-2030s, reflecting genuine disagreement about raw-material scaling. The classic diffusion-of-innovations logic frames why the tail is fat — adoption S-curves are notoriously hard to time.[n1]
Crucially, the forecast does not just sit in a slide. It is linked to the tooling decision with an explicit rule ("commit tooling only once the p50 parity year falls inside the plant's payback window"), and it carries update triggers: a competitor's cost announcement, a lithium price move beyond a set band, or a pilot-line yield result. Eight months later a supplier cost disclosure trips a trigger; the panel reconvenes, the distribution shifts earlier, and the investment timing moves with it — because the workflow was built to be updated, not filed.
How it works¶
- Elicit as distributions over dated outcomes. Each expert gives a probability spread over a future event or timeline, not a single date, and the pool is summarized preserving the tails.
- Link to a decision. State the specific choice the forecast informs and the rule connecting the distribution to that choice, so the number has a job.
- Name update triggers up front. Define the observable signals that will reopen the forecast, before any of them occurs.
- Re-run on trigger or cadence. When a trigger fires (or on schedule), reconvene, revise the distribution, and let the linked decision move.
Tuning parameters¶
- Forecast horizon — near-term versus long-range. Near-term forecasts are scorable soon and stay sharp; long-range ones matter more for planning but resist calibration and grow fat tails.
- Trigger sensitivity — how easily an update trigger fires. Twitchy triggers keep the forecast fresh but cause churn; sluggish ones let it go stale before the decision notices.
- Decision-coupling tightness — whether the distribution mechanically drives the choice or merely informs it. Tight coupling forces discipline but can over-automate a call that deserves human judgment.
- Distribution summary — central estimate plus interval, or full predictive density. Fuller summaries preserve tail risk but are harder for planners to act on.
When it helps, and when it misleads¶
Its strength is producing a live forecast rather than a one-time guess: because the estimate is scorable, decision-linked, and equipped with triggers, it can be graded against reality and updated when the world moves, which is exactly what a static prediction cannot do. This makes it well-suited to timing-sensitive planning under deep uncertainty.
Its failure mode is false precision about the far future: a tidy distribution over a 2032 event can imply a resolution the evidence cannot support, and long-horizon forecasts are the ones where overconfidence bites hardest. The classic misuse is a forecast that is dutifully produced but never wired to anything — decision detachment, where the panel's careful distribution has no update trigger and no linked choice, so it ages on a shelf. The guarding discipline is to insist on both an explicit decision link and named update triggers at creation, and to widen the intervals honestly as the horizon lengthens.
How it implements the components¶
uncertainty_distribution— its output is a probability spread over a dated future outcome, tails preserved rather than collapsed to a point date.decision_use_link— it wires the distribution to a specific decision with a stated rule, giving the forecast a job.update_trigger— it names, in advance, the observable signals that reopen the forecast, keeping it live.
It forecasts, but it does not constitute the panel or frame a values question: seating the panel, mapping coverage, and screening conflicts — expert_panel, expertise_coverage_map, conflict_of_interest_screen, and the decision_use_question itself — belong to its workflow twin Policy Expert Panel Process; this workflow predicts, it does not convene.
Related¶
- Instantiates: Structured Expert Judgment Iteration — it aims the archetype at scorable, decision-linked forecasts of the future.
- Consumes: Calibrated Probability Elicitation supplies the calibrated distributions its forecasts are built from.
- Sibling mechanisms: Policy Expert Panel Process (its workflow twin, on the convening end) · Anonymous Survey Round · Delphi Study · Expert Elicitation Protocol · Judgment Aggregation Dashboard · Rationale Coding Matrix · Technical Consensus Round
Editorial Notes¶
Form Classification¶
Form family: Analysis, Modeling & Optimization
Rationale: Structured Forecasting Panel operates as an analytical, modeling, inference, comparison, or optimization procedure that derives insight or a solution because it uses repeated expert estimates, feedback, and uncertainty summaries to assess future events, timelines, or probabilities.
Independent corroboration: The frozen evidence defines Structured Forecasting Panel as 'Uses repeated expert estimates, feedback, and uncertainty summaries to assess future events, timelines, or probabilities', so its operative form is Analysis, Modeling & Optimization.
Nearest alternative: Representation, Specification & Plan — Structured Forecasting Panel includes features of a static representation, map, specification, schema, or prospective plan that externalizes information, but its defining operation is an analytical, modeling, inference, comparison, or optimization procedure that derives insight or a solution.
Review outcome: Independent reviewer agreement; medium confidence.
Origin Attribution¶
Primary origin: Futurism & Strategic Foresight
Origin pattern: Convergent development
Present-day reach: Universal
Rationale: Repeated expert probability elicitation is structured forecasting.
Related originating lineages:
- Organizational & Management Science — Panels govern participation.
- Psychology — Experimental, clinical, and behavioral psychology supplies a parallel or contributing lineage for the mechanism's defining operation: uses repeated expert estimates, feedback, and uncertainty summaries to assess future events, timelines, or probabilities.
- Statistics & Experimental Design — Calibration and aggregation quantify estimates.
Review resolution: The blind reviewers agree that futurism_foresight is the primary origin and differ only on alternate origin disagreement, origin mode disagreement, domain reach disagreement, encyclopedia synthesis disagreement. I preserve every independently explained alternate from both records rather than imposing a numeric cap. I retain convergent because the combined evidence shows independent disciplinary development. The broader reach of universal records portability separately from historical provenance; encyclopedia_synthesis=true preserves the affirmative synthesis judgment where either reviewer identified one.
Encyclopedia synthesis: The exact catalogued form synthesizes established practice rather than reproducing a single standard historical label.
Review outcome: Reconciled after independent review; high confidence.
Notes¶
[n1] Everett Rogers's diffusion of innovations describes technology adoption as an S-curve whose timing depends on many interacting factors — which is why when a technology crosses a threshold is far harder to forecast than whether it eventually will, and why honest forecasting panels carry wide intervals and live update triggers on such questions. ↩