Expert Political Judgment¶
Tetlock, P. E. (2005). Expert Political Judgment: How Good Is It? How Can We Know?. Princeton University Press.
Cited by¶
5 citations across 5 artifacts.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Calibration
- Tetlock (2005) showed how the choice of reference frame shapes expert judgment in his long-running study of political forecasting accuracy.
This sourceTwo-decade study of expert political/economic forecasts showing systematic overconfidence and frequent underperformance versus simple baselines, with reasoning style (fox vs hedgehog) shaping forecast quality.
- Tetlock (2005) showed how the choice of reference frame shapes expert judgment in his long-running study of political forecasting accuracy.
- Epistemic Humility
- Historically, overconfident predictions in military strategy (the Maginot Line, the assumption that Germany would never invade; the belief that Vietnam would be a quick victory), economic forecasting (the 2008 financial crisis blindsided confident risk models; analysts consistently overestimated growth trajectories), medical diagnosis (misdiagnosed conditions, overconfident prognoses leading to unnecessary treatments), and policy (regime-change interventions based on overconfident geopolitical models) have led to preventable failures and human suffering, a pattern Tetlock (2005) documented across two decades of expert political forecasts that systematically underperformed simple statistical baselines.
This sourceReports a multi-decade study of ~28,000 expert forecasts showing experts were systematically overconfident and often outperformed by simple statistical baselines. SUPPORTS marker 225 (two decades of expert political forecasts that underperformed simple statistical baselines).
- Historically, overconfident predictions in military strategy (the Maginot Line, the assumption that Germany would never invade; the belief that Vietnam would be a quick victory), economic forecasting (the 2008 financial crisis blindsided confident risk models; analysts consistently overestimated growth trajectories), medical diagnosis (misdiagnosed conditions, overconfident prognoses leading to unnecessary treatments), and policy (regime-change interventions based on overconfident geopolitical models) have led to preventable failures and human suffering, a pattern Tetlock (2005) documented across two decades of expert political forecasts that systematically underperformed simple statistical baselines.
- Foreseeing (Prediction)
- Foresight
- Foresight makes room for trend-breaking futures — black-swan-style high-impact, low-probability events; regime shifts; phase transitions — by treating them as legitimate scenarios within the plural set rather than as off-distribution noise, the structural worry Taleb (2007) and Tetlock (2005) make central to their critiques of single-point forecasting.
This sourceTwo-decade study of 284 experts and 82,361 forecasts showing experts were systematically overconfident and often performed worse than simple statistical baselines — canonical demonstration of overconfidence costs in single-point prediction. SUPPORTS the critique-of-single-point-forecasting claim (165). [Forecast count corrected from 'nearly 28,000' to 82,361 from 284 experts.]
- Foresight makes room for trend-breaking futures — black-swan-style high-impact, low-probability events; regime shifts; phase transitions — by treating them as legitimate scenarios within the plural set rather than as off-distribution noise, the structural worry Taleb (2007) and Tetlock (2005) make central to their critiques of single-point forecasting.
- Wild Cards
- The method generates a conditional claim: if this event occurred, the consequences would be severe enough to warrant investment in contingency planning; therefore, it merits watchlist status and preparation. The converse claim — that named wild cards are likely to occur — does not follow from wild-card analysis, a separation Tetlock (2005) makes explicit in distinguishing scenario-based preparation from probabilistic prediction.
This sourceReports a two-decade study of nearly 28,000 expert forecasts showing that political and economic experts were systematically overconfident and frequently performed worse than simple statistical baselines—canonical empirical demonstration of overconfidence costs in policy-relevant prediction.
- The method generates a conditional claim: if this event occurred, the consequences would be severe enough to warrant investment in contingency planning; therefore, it merits watchlist status and preparation. The converse claim — that named wild cards are likely to occur — does not follow from wild-card analysis, a separation Tetlock (2005) makes explicit in distinguishing scenario-based preparation from probabilistic prediction.
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:e83efc23ab97 · see in the full table