Anonymous Survey Round¶
Procedure — instantiates Structured Expert Judgment Iteration
Captures independent judgments and revisions while reducing status pressure, anchoring, and conformity.
An Anonymous Survey Round is the atomic unit of structured judgment: one blind pass in which every expert answers privately, then sees the group's answers played back with no names attached. Its whole reason for existing is sequence — each person commits an estimate before learning what anyone else thinks, and the playback carries the distribution of views rather than a badge that says which one came from the department head. It is not a whole study and it does not decide anything; it is the single collect-and-reflect step that a larger method chains together. Strip away the anonymity or let people answer out loud in turn and the procedure collapses into an ordinary poll, where the first confident voice sets the anchor for everyone after it.
Example¶
A platform-engineering group at a mid-size software company needs to judge the risk that a planned database migration slips past its quarter. In the past these calls were made in a stand-up where the staff engineer spoke first, and the number the room "agreed on" was really just his number. This time the team lead runs an Anonymous Survey Round: a short form goes out asking each of eleven engineers, privately and asynchronously, for a slip probability and a one-line reason. Responses come back sealed; the lead — who does not submit an estimate herself — strips names, lightly edits any comment that gives away its author ("as I built the old schema…" becomes "someone familiar with the legacy schema notes…"), and posts the result: a histogram spanning 20% to 75%, plus the anonymized reasons.
The playback is the payoff. Two engineers had quietly flagged an undocumented replication dependency the senior engineer's optimistic 20% ignored — and because the estimates arrived blind, that warning shows up as a genuine cluster in the histogram instead of evaporating under his seniority. The round produces no decision; it produces an honest snapshot the team can now argue about on the merits.
How it works¶
The procedure is deliberately small and repeatable:
- Sealed capture. Each expert answers privately — a form, a sealed ballot, an asynchronous submission — with no visibility into others' responses until their own is locked.
- De-identification. A neutral owner removes names and rewrites tells: phrasing, jargon, or anecdotes that would let readers reverse-engineer who said what.
- Distribution playback. The group receives the spread of answers and the anonymized rationales, not a single averaged figure — the point is to show that judgments diverge and why.
The round ends there. Whether to run another one, and when to stop, is a decision made outside the procedure.
Tuning parameters¶
- Anonymity strength — from simple name-removal to comment-editing and response-batching. Stronger anonymity cuts status leakage but costs facilitation time and can blur genuine accountability for method quality.
- Response format — free-text opinion, a category, or a required number. More structure aids playback and comparison; less structure captures nuance the form would have amputated.
- Synchrony — live-but-private (everyone submits in one sitting) versus fully asynchronous. Async widens participation and defeats time-pressure conformity but stretches the round out.
- Comment editing aggressiveness — how hard the owner rewrites identifying phrasing. Heavy editing protects the blind but risks distorting the reason itself.
When it helps, and when it misleads¶
Its strength is cheapness and surgical effect: it neutralizes anchoring and deference[n1] at the exact moment they do the most damage — the first articulation of an estimate — without requiring a whole apparatus. A single well-run round often surfaces a dissenting cluster that a meeting would have silently absorbed.
Its failure mode is being mistaken for the whole intervention. A one-shot survey with no feedback and no chance to revise is just an opinion snapshot; the archetype's value comes from iterating on it, which this procedure does not do. The classic misuse is status leakage: anonymity that fails because a comment's wording, or a tiny panel, lets everyone guess the author — reintroducing the very hierarchy the round was meant to suppress. The guarding discipline is a neutral owner who actively edits identifying phrasing and, in small panels, batches or paraphrases responses rather than posting them verbatim.
How it implements the components¶
independent_elicitation— the sealed private capture is independence: every judgment is committed before its author sees the group.anonymized_feedback— the de-identified distribution-and-rationale playback returns the group's views without status labels.facilitator_or_method_owner— a neutral administrator who holds the blind, strips tells, and (crucially) does not vote is what makes the anonymity real.
This is a single pass: it does not chain rounds or decide when learning has plateaued — iteration_round and stopping_rule belong to Delphi Study — and it does not select or COI-screen the panel it surveys (expert_panel, conflict_of_interest_screen), which are done by Policy Expert Panel Process.
Related¶
- Instantiates: Structured Expert Judgment Iteration — it is the collect-and-reflect step the archetype iterates on.
- Sibling mechanisms: Delphi Study (which consumes this procedure as its repeated round) · Calibrated Probability Elicitation · Expert Elicitation Protocol · Judgment Aggregation Dashboard · Rationale Coding Matrix · Structured Forecasting Panel · Policy Expert Panel Process · Technical Consensus Round
Editorial Notes¶
Form Classification¶
Form family: Communication, Facilitation & Learning
Rationale: Experts submit sealed independent views that are de-identified and played back to the group, creating a bounded participatory round for reflection without status pressure, so its operative form is facilitated collective learning.
Nearest alternative: Protocol, Workflow & Routine — The sealed-capture and playback steps structure the round, but the mechanism's defining effect comes from the anonymous exchange among participants.
Review outcome: Adjudicated after independent review; medium confidence.
Origin Attribution¶
Primary origin: Futurism & Strategic Foresight
Origin pattern: Single lineage
Present-day reach: Multi-domain
Rationale: Anonymous iterative expert-survey rounds are the defining structure of the Delphi method developed for strategic foresight.
Related originating lineages:
- Organizational & Management Science — Organizations use Delphi rounds for complex decisions and planning.
- Psychology — Anonymity reduces status, conformity, and anchoring effects.
- Statistics & Experimental Design — Survey design and aggregation support elicitation quality.
Review resolution: Both reviewers identify the Delphi method in strategic foresight. Survey technique, revision psychology, and facilitated expert coordination materially support it, but anonymous iterative rounds remain a single established Delphi lineage.
Review outcome: Reconciled after independent review; high confidence.
Notes¶
[n1] The tendency for an early number or a first confident statement to pull all subsequent judgments toward it — the anchoring effect described by Tversky and Kahneman. Blind, private first capture is the standard structural defense, which is why sequence (answer before you see others) is the load-bearing feature of this procedure. ↩