Incentive-Compatible Preference Elicitation¶
Method — instantiates Cost-Asymmetric Preference Revelation Design
Uses scoring, choice architecture, or rule design to make truthful preference reporting strategically safer or more beneficial than misreporting.
Incentive-Compatible Preference Elicitation is a family of scoring rules, choice architectures, and mechanism designs that make honest reporting of a preference the respondent's best strategy — one under which truth-telling earns at least as much as any misreport — so that candor is secured by the payoff structure rather than by hiding who answered. Its defining move, against the anonymity siblings, is that it works even when responses are attributed: it changes what truth earns, not who can see it. Where a poll or a ballot lowers cost by concealing identity, this method leaves identity in the open and instead removes the reason to shade an answer, by making an honest report the move a self-interested respondent would choose anyway.
Example¶
A research team wants a panel of analysts' honest probability estimates for a set of future events, but each analyst has a reputational incentive to hedge toward the consensus. Rather than promise anonymity, the team scores every analyst with a proper scoring rule that rewards calibrated honesty and penalizes hedging, and adds a peer-prediction step: each analyst reports both their own answer and a prediction of how others will answer, and answers that turn out more common than predicted score highest — which rewards privately held minority views that respondents believe are rarer than they are. The stakes are real: the score feeds a visible standing and a bonus pool. The outcome is that hedging stops paying, so the elicited distribution tracks held belief even though every response is signed. No one hid; the payoffs simply made honesty the winning play.
How it works¶
- Make truth the dominant strategy. Choose a scoring or allocation rule under which no misreport beats an honest report — proper scoring rules, strategyproof designs.
- Tie it to real stakes. The rule only bites if something the respondent values rides on the score.
- Cross-check with meta-beliefs. Ask respondents to predict others' answers, then use the gap to detect and reward truthful, surprisingly-common views.
- Keep it strategy-robust. Stress-test the design against the ways a clever respondent would try to game it.
Tuning parameters¶
- Stakes size — how much rides on the score. Bigger stakes sharpen truth-telling but also sharpen the incentive to crack the mechanism.
- Rule complexity — a simple proper score versus a full truth-serum. More sophistication resists gaming but costs comprehensibility, and respondents must trust what they cannot follow.
- Attribution — signed versus pseudonymous. The method tolerates attribution, but pairing it with mild anonymity can add belt-and-suspenders candor.
- Validation weight — how much the predict-others cross-check influences the final score.
- Domain fit — verifiable-outcome questions (where scoring against ground truth is possible) versus pure subjective preference (where peer-prediction scoring is the only lever).
When it helps, and when it misleads¶
Its strength is that it secures candor without needing anonymity or a protected channel, which makes it usable where identity must be known — auctions, expert panels, resource allocation — and where a real, named design such as the Bayesian Truth Serum can score subjective answers for truthfulness.[1]
Its failure is that incentive-compatibility is fragile: a design that is provably truthful under its assumptions can be gamed the moment those assumptions break — through collusion, side-bets, or respondents who do not understand or trust the rule — and complex mechanisms can lose the very people they were meant to elicit. The classic misuse is bolting a fancy scoring rule onto a question whose "truth" cannot be scored, producing false rigor. The guarding discipline is to match the mechanism to what can actually be verified, stress-test it against strategic play, and keep it simple enough that respondents believe honesty pays.
How it implements the components¶
truthful_expression_incentive_alignment— the core: a payoff structure under which truthful reporting is the respondent's best move.private_preference_snapshot— the elicited, incentive-secured answers form a measured snapshot of held preference, obtained via payoffs rather than anonymity.counter_signal_validation_layer— the predict-others cross-check validates and scores each report against the distribution of others' expectations.
It does not lower cost by detaching answers from identity through a protected_revelation_channel — that is the Anonymous Preference Poll — and it does not depend on a public_expression_trace captured in sequence around a vote, which is the Sealed Ballot Before Voice Vote. This method changes the payoff, not the audience or the timing.
Related¶
- Instantiates: Cost-Asymmetric Preference Revelation Design — the method is how truthful preference is elicited when identity cannot be hidden.
- Sibling mechanisms: Aggregate Norm-Correction Report · Anonymous Preference Poll · Confidential Ombuds Channel · Face-Saving Position Update Path · No-Retaliation Commitment and Monitor · Preference Divergence Dashboard · Protected Dissent Window · Reprisal Risk Audit · Sealed Ballot Before Voice Vote
Editorial Notes¶
Form Classification¶
Form family: Rule, Policy & Commitment
Rationale: Incentive-Compatible Preference Elicitation operates as a standing rule, threshold, contractual commitment, or policy constraint governing future conduct because it uses scoring, choice architecture, or rule design to make truthful preference reporting strategically safer or more beneficial than misreporting
Independent corroboration: The frozen evidence defines Incentive-Compatible Preference Elicitation as 'Uses scoring, choice architecture, or rule design to make truthful preference reporting strategically safer or more beneficial than misreporting', so its operative form is Rule, Policy & Commitment.
Nearest alternative: Intervention, Treatment & Transformation — The standing scoring or allocation rule governs elicitation incentives rather than directly treating a target state.
Review outcome: Independent reviewer agreement; medium confidence.
Origin Attribution¶
Primary origin: Economics & Finance
Origin pattern: Single lineage
Present-day reach: Specialized
Rationale: Truthful revelation through scoring and rule design is a mechanism-design and information-economics problem.
Related originating lineages:
- Behavioral Economics — Observed reporting behavior and subjective belief elicitation materially shape practical implementations.
- Statistics & Experimental Design — Proper scoring and Bayesian Truth Serum supply statistical elicitation machinery.
Review resolution: Both reviewers independently assign economics_finance as the primary originating domain, so that shared primary is retained. Alternate domains are the union of reviewer-identified formative or independently originating lineages; later application settings alone are excluded. The evidence describes one principal historical lineage. Its defining controls and vocabulary remain bounded to a particular professional or technical practice. The encyclopedia entry generalizes the established mechanism without creating a new composite lineage.
Review outcome: Reconciled after independent review; high confidence.
References¶
[1] Bayesian Truth Serum — a scoring method introduced by Dražen Prelec (Science, 2004) for eliciting truthful subjective answers when there is no external ground truth: respondents give both an answer and a prediction of the population distribution, and answers that are more common than collectively predicted are scored as truthful. It rewards honestly held minority views that respondents wrongly believe are rare. registry ↩