Policy Expert Panel Process¶
Workflow — instantiates Structured Expert Judgment Iteration
Adapts structured judgment iteration to policy questions where evidence, values, feasibility, legitimacy, and stakeholder effects interact.
A Policy Expert Panel Process is the front-end workflow for using structured expert judgment on a policy question — one where the answer is entangled with values, feasibility, legitimacy, and who is affected, not just with a fact about the world. Its defining work is composition and framing: pinning down exactly what policy decision the judgment must serve, assembling a panel whose coverage spans the disciplines and the stakeholder-relevant perspectives the question implicates, mapping which viewpoints are present and which are missing, and screening conflicts so a regulated party's paid advisor cannot quietly shape the recommendation. It does not itself run the quantitative rounds or forecast anything; it decides what is being asked and by whom, which for a contested policy question is the part most likely to go wrong. Get the panel and the question wrong and every downstream round is precise about the wrong thing.
Example¶
An environmental agency must advise on a workplace exposure limit for an industrial solvent where the toxicology is genuinely uncertain and the stakes cut across health, cost, and jobs. A Policy Expert Panel Process opens the work. First it fixes the decision-use question narrowly: not "is this chemical safe?" but "what exposure limit, over an 8-hour shift, does the evidence support given defined health-protection goals?" — scope, horizon, and intended regulatory use stated up front so the panel does not drift into a general referendum on the chemical.
Then it builds the panel for coverage, not prestige: toxicologists and industrial hygienists, but also an exposure epidemiologist and an occupational-medicine clinician, because the question spans those lenses. The coverage map is drawn explicitly and reveals a gap — no one represents the small-employer feasibility perspective — which is documented as a known limitation rather than hidden. Every panelist files conflict disclosures; two who consult for solvent manufacturers are seated but flagged, their potential interest recorded in the panel's charter. The workflow's output is not an answer but a legitimately constituted question and panel the elicitation rounds can now run against.
How it works¶
- Frame the decision use. State the specific policy choice the judgment informs, its scope and horizon, and how it may and may not be used — before any expert is recruited.
- Compose for coverage. Select panelists so relevant disciplines and stakeholder-affected perspectives are represented, weighting breadth over seniority.
- Map presence and absence. Draw the coverage map explicitly, naming which perspectives are seated and which are missing, so the panel is never mistaken for representative by default.
- Screen conflicts. Require disclosures, and decide seating, flagging, or recusal transparently in the panel's charter.
Tuning parameters¶
- Panel breadth — narrow-technical versus broad socio-technical. Breadth improves legitimacy and coverage on values-laden questions but makes the later rounds harder to synthesize.
- Question scope — tightly bounded versus expansive. Tight scope keeps the panel accountable to a decision; too tight can exclude the very tradeoff that makes it a policy question.
- Conflict handling — exclude, seat-and-flag, or weight down disclosed interests. Exclusion protects credibility but can strip out the most experienced (and most conflicted) specialists.
- Coverage-gap disclosure — how prominently missing perspectives are surfaced. Loud disclosure builds trust but invites challenge to the panel's standing.
When it helps, and when it misleads¶
Its strength is legitimacy on contested ground: by fixing the question and making panel coverage and conflicts visible, it lets a policy recommendation withstand the charge that it was rigged by who was in the room. Structured uncertainty language in policy science advice exists for exactly this reliability-under-scrutiny purpose.[n1]
Its failure mode is expert-pool blind spots disguised as expertise: a panel of eminent specialists from one discipline or one institution can look authoritative while systematically missing a perspective, and a coverage map that is drawn but not honest just launders the gap. The classic misuse is treating an expert panel as a substitute for democratic legitimacy or affected-community input — letting "the experts decided" authorize a value choice that was never theirs to make. The guarding discipline is an explicit coverage map that names absences, transparent conflict handling, and a charter stating that the panel informs the policy choice rather than authorizing it.
How it implements the components¶
decision_use_question— it fixes the specific policy decision, scope, and horizon the judgment must serve, its first act.expert_panel— it assembles the panel, weighting disciplinary and stakeholder coverage over status.expertise_coverage_map— it draws which perspectives are present and absent, defending against a prestige panel being read as representative.conflict_of_interest_screen— it requires disclosures and decides seating/flagging transparently in the panel charter.
This is the front end: it constitutes the question and the panel but does not produce the numbers or track them over time. Quantified predictions tied to re-open triggers — uncertainty_distribution, decision_use_link, update_trigger — are the province of its workflow twin Structured Forecasting Panel; this process convenes and frames, it does not forecast.
Related¶
- Instantiates: Structured Expert Judgment Iteration — it adapts the archetype's front end to values-laden policy questions.
- Sibling mechanisms: Structured Forecasting Panel (its workflow twin, on the prediction end) · Anonymous Survey Round · Calibrated Probability Elicitation · Delphi Study · Expert Elicitation Protocol · Judgment Aggregation Dashboard · Rationale Coding Matrix · Technical Consensus Round
Editorial Notes¶
Form Classification¶
Form family: Communication, Facilitation & Learning
Rationale: Policy Expert Panel Process operates as a designed message, facilitated interaction, ritual, or learning activity that changes shared understanding because it adapts structured judgment iteration to policy questions where evidence, values, feasibility, legitimacy, and stakeholder effects interact.
Independent corroboration: The frozen evidence defines Policy Expert Panel Process as 'Adapts structured judgment iteration to policy questions where evidence, values, feasibility, legitimacy, and stakeholder effects interact', so its operative form is Communication, Facilitation & Learning.
Review outcome: Independent reviewer agreement; high confidence.
Origin Attribution¶
Primary origin: Public Administration & Policy
Origin pattern: Cross-disciplinary synthesis
Present-day reach: Multi-domain
Rationale: Structured expert judgment for policy choices is a policy-analysis practice for combining evidence, feasibility, legitimacy, and values.
Related originating lineages:
- Futurism & Strategic Foresight — Strategic foresight contributes Delphi-style iterative elicitation under uncertainty.
- Statistics & Experimental Design — Statistics contributes formal elicitation, aggregation, and calibration of expert judgments.
Review resolution: Both blind reviewers agree that public administration policy is the primary origin. Reconciliation resolves alternate origin disagreement, encyclopedia synthesis disagreement. Formative alternate lineages are retained as futurism_foresight, statistics_experimental_design; later breadth of use is recorded separately as domain_reach=multi_domain, while origin_mode=cross_disciplinary_synthesis describes the relationship among origin lineages.
Encyclopedia synthesis: The exact catalogued form synthesizes established practice rather than reproducing a single standard historical label.
Review outcome: Reconciled after independent review; high confidence.
Notes¶
[n1] Assessment bodies such as the IPCC use calibrated language ("likely," "very likely," with defined probability bands) and explicit expert-panel composition rules so that policy-facing scientific advice is legible, comparable, and defensible under adversarial review. The apparatus manages how expertise is constituted and expressed for a policy audience — it does not convert value choices into technical ones. ↩