Goodhart's Law¶
Core Idea¶
Binding optimization pressure on a proxy degrades the proxy's correlation with the construct it was meant to indicate. Once consequences attach to a measure, agents take the cheapest path to move the proxy, which almost never coincides with the path that would move the underlying thing — and the proxy comes to index optimization effort rather than the construct.
How would you explain it like I'm…
Chasing the Sticker
When the Stand-In Breaks
The Proxy Trap
Broad Use¶
- Education: test scores drive funding and pay, so the easiest path becomes test-prep and narrowed curriculum while scores climb and learning does not.
- Healthcare: four-hour-wait and door-to-balloon targets distort triage and coding.
- Science: citation counts and p-values, tied to careers, breed citation cartels, p-hacking, and a replication crisis.
- AI alignment: trained policies maximize a reward signal in unintended ways — reward hacking is the canonical failure mode.
- Finance and monetary policy: targeting a monetary aggregate collapses the very regularity that motivated targeting it (the original case).
- Management: sales quotas and first-call-resolution metrics invite channel-stuffing and ticket-gaming.
Clarity¶
Distinguishes measurement (passive, low-stakes diagnosis) from incentivization (high-stakes, weighted into consequence): a metric can be excellent for one and catastrophic for the other.
Manages Complexity¶
Compresses Campbell's law, the McNamara fallacy, surrogation, reward hacking, and p-hacking into one mechanism, and bundles a portfolio of remedies — scorecards, held-out evaluation, rotation, decoupling — rather than a single domain fix.
Abstract Reasoning¶
Predicts which proxies collapse first (those with a wide, easily exploited wedge) and licenses robustness via multi-objective design — make the target a joint motion of several loosely correlated proxies so the wedge becomes a multidimensional intersection.
Knowledge Transfer¶
- Public administration: audit-and-investigate and multiple-measures accountability.
- AI: held-out reward evaluation and reward ensembling read as a re-derivation of those same remedies.
- Management accounting: the surrogation effect is the same proxy-collapse under a different name.
Example¶
An emergency department under a four-hour-wait target rushes disposition near the boundary, defers registration to delay the clock, and codes for compliance — the headline metric climbs while twelve-hour trolley waits and delayed-sepsis mortality fail to improve, exposing the proxy's collapse.
Relationships to Other Abstractions¶
Current abstraction Goodhart's Law Prime
Parents (2) — more general patterns this builds on
-
Goodhart's Law is a kind of Intervention-Induced Model Invalidation Prime
Goodhart's Law is Intervention-Induced Model Invalidation specialized to a proxy relationship that breaks because the proxy is placed under binding optimization pressure.
-
Goodhart's Law is a kind of Proxy-Target Divergence Prime
Goodhart's Law is Proxy-Target Divergence specialized to the mechanism in which binding optimization pressure on the proxy destroys its correlation with the construct.
Children (3) — more specific cases that build on this
-
Campbell's Law Domain-specific is a kind of Goodhart's Law
Campbell's Law is Goodhart's Law specialized to consequential use of quantitative social indicators, where measured actors game the indicator and distort the social process it governs.
-
Teaching to the test Domain-specific is a kind of Goodhart's Law
The proposed strict upward parent is
prime:goodharts_law. -
Government Failure Domain-specific is part of, conditional Goodhart's Law
Its cobra-effect branch contains Goodhart's proxy-under-pressure mechanism, while capture and electoral-myopia branches need not target a proxy.
Hierarchy paths (7) — routes to 5 parentless roots
- Goodhart's Law → Intervention-Induced Model Invalidation → Concept Drift → Calibrated Rule versus Moving World → Temporal Decay and Degradation → Entropy (Thermodynamic Sense)
- Goodhart's Law → Intervention-Induced Model Invalidation → Reflexivity (Self-Reference)
- Goodhart's Law → Intervention-Induced Model Invalidation → Concept Drift → Non-Stationary Objective
- Goodhart's Law → Proxy-Target Divergence → Proxy–Target Fidelity → Representation → Abstraction
- Goodhart's Law → Intervention-Induced Model Invalidation → Concept Drift → Temporal Decay and Degradation → Entropy (Thermodynamic Sense)
- Goodhart's Law → Intervention-Induced Model Invalidation → Concept Drift → Temporal Decay and Degradation → Time
- Goodhart's Law → Intervention-Induced Model Invalidation → Concept Drift → Calibrated Rule versus Moving World → Temporal Decay and Degradation → Time
Not to Be Confused With¶
- Goodhart's Law is not Regulatory Capture because Goodhart is a measurement-target failure needing no capturing party, whereas capture is a regulator co-opted by the industry it oversees; the fixes diverge (control-loop redesign versus structural independence).
- Goodhart's Law is not the Agency Problem because Goodhart bites even when objectives are perfectly aligned — the honest agent optimizing the proxy still degrades the construct — whereas the agency problem rests on a divergence of goals.
- Goodhart's Law is not Moral Hazard because Goodhart concerns a proxy's informativeness collapsing under optimization, independent of who bears risk, whereas moral hazard is changed risk-taking under insulation from consequences.