Objective Function Alignment¶
Define what is being optimized so search, incentives, and evaluation do not improve the wrong thing.
The Diagnostic Story¶
Symptom: The score improves but lived outcomes, mission results, or user value do not improve; teams satisfy the metric while bypassing the purpose behind it. Edge cases, vulnerable groups, and long-term harms are invisible to the primary objective, and people have learned to game, select into, or avoid the measurement regime — while leaders respond by adding more metrics without resolving which outcomes are primary and which are guardrails.
Pivot: Define the intended outcome, translate it into an explicit objective function or decision target, surround it with constraints and protected invariants, validate the measurement proxies, and maintain safeguards against gaming, drift, and unintended optimization — keeping the target traceable to the outcome it claims to represent.
Resolution: Misoptimization and proxy-driven distortion decrease; effort, incentives, and measurement connect to real-world outcomes; metric gaming and reward hacking reduce; and improvement claims become meaningful rather than merely numerical because they are periodically checked against independent evidence.
Reach for this when you hear…¶
[education policy] “Our test scores went up three years in a row and actual reading comprehension went down — we optimized the drill, not the skill.”
[machine learning] “The model aced the benchmark because the benchmark leaked into the training data — it's not smarter, it's just better at memorizing the test.”
[customer support] “We hit every call-time target and customer satisfaction fell ten points because we were optimizing for speed, not for actually solving the problem.”
When This Archetype Applies¶
Complete catalog groundingAt least one sufficient condition set is fully represented by existing primes or domain-specific abstractions.
Diagnostic problem
A system is subject to optimization pressure, but the target being optimized is implicit, underspecified, proxy-based, stale, gameable, or misaligned with the real outcome that stakeholders care about.
What this problem means
The structural problem is a gap between **what the system optimizes** and **what the system is supposed to accomplish**. The gap can be small at first, but optimization amplifies it. A proxy that was useful for learning can become dangerous when tied to rewards. A benchmark that once measured quality can become stale. A KPI that made sense locally can undermine system-level mission. A reward that captures one desirable behavior can create new incentives to ignore safety, fairness, trust, or long-term outcomes.
This failure is not only a measurement problem. It is a structural problem because the objective reshapes behavior. Once people, models, departments, or institutions know what is rewarded, they search for ways to satisfy that target. If the target is incomplete, the system may improve visibly while degrading the outcome that mattered.
Show the applicability expression
Applicability expression6 distinct conditions
groundedpartly groundedopen
Equivalent to the 5 condition sets it replaces, with 4 duplicate condition cards removed.
1Required in every casenumbered 1–1
These hold no matter which pattern applies.
Binding optimization pressure · grounded · any one of 4
A system is under binding optimization pressure on a measurable target.
The source archetype describes the situation as follows: an algorithm, team, organization, or policy program is optimizing a measurable target. The normalized requirement above isolates the load-bearing portion used in this condition set.
5At least one of theselettered A–E
Any single one of these completes the pattern.
Pressure-sensitive proxy · grounded
The optimized metric is an indirect proxy whose relation to the desired outcome can collapse under pressure.
The source archetype describes the situation as follows: the easiest available metric is only an indirect proxy for the desired outcome. The normalized requirement above isolates the load-bearing portion used in this condition set.
Strategic metric gaming · open
Actors who know the measurement or reward rule can adapt their behavior around it.
The source archetype describes the situation as follows: actors can change behavior once they know what is being measured or rewarded. The normalized requirement above isolates the load-bearing portion used in this condition set.
Proxy improves, mission degrades · grounded · any one of 2
A local or proxy target improves while system-level quality or mission value degrades.
The source archetype describes the situation as follows: a local target may improve while system-level quality, safety, fairness, trust, or mission value degrades. The normalized requirement above isolates the load-bearing portion used in this condition set.
Premature optimization · open
Optimization begins before stakeholders agree on what improvement means.
The source archetype describes the situation as follows: optimization begins before stakeholders have agreed what should count as improvement. The normalized requirement above isolates the load-bearing portion used in this condition set.
Stale encoded target · open
The encoded target changes more slowly than the context it is meant to represent.
The source archetype describes the situation as follows: the target has changed less often than the context it is supposed to represent. The normalized requirement above isolates the load-bearing portion used in this condition set.
Other requirements and context (1)
Why these sit outside the expression
Application gate — it governs whether applying the archetype is appropriate or material, rather than defining the structural problem itself.
Application gatea decision process ranks, selects, rewards, recommends, funds, penalizes, or prioritizes options.
The target may be a score, a metric, a rank, a reward, a loss function, a policy goal, a service-level objective, a grading rubric, a decision criterion, or a dashboard indicator. In this archetype, the relevant application gate is: a decision process ranks, selects, rewards, recommends, funds, penalizes, or prioritizes options. It narrows when choosing or applying the archetype is warranted or decision-relevant.
Coverage
3 of 6 conditions grounded · 3 open.
None of the 3 open conditions sit in the shared core — each falls inside one alternative branch, so grounding any one of them closes only that branch.
Mechanisms / Implementations¶
- Metric Design: Creates observable measures that approximate the intended outcome closely enough to guide action and review.
- Loss Function Design: Translates desired model behavior into a mathematical penalty structure used during training or selection.
- Reward Function Specification: Specifies what an agent or actor is rewarded for, often in automated, organizational, or behavioral systems.
- KPI Governance: Manages organizational key performance indicators so targets guide the intended behavior rather than local score maximization.
- Decision Criteria Rubric: Makes selection criteria explicit so ranking, approval, grading, or prioritization follows the intended objective and constraints.
- Policy Objective-Setting Workshop: Uses facilitated deliberation to define outcomes, constraints, stakeholder values, and unacceptable side effects before policy optimization begins.
- Optimization Target Review: Periodically reviews whether the current objective, metric, or reward target still produces the intended outcomes under observed behavior.
- Metric-Gaming Red Team: A metric-gaming red team searches for strategies that improve the visible score while violating the purpose.
- Guardrail Dashboard: Displays constraint, safety, fairness, quality, or side-effect indicators alongside the main objective score.
- Balanced Scorecard: Tracks multiple performance dimensions to reduce single-metric tunnel vision in organizations.
Related Abstractions¶
Abstractions this archetype builds on — directly (a source ingredient) or as a related pattern. Links follow the typed catalog namespace.
Built directly on (3)
- Feedback: Outputs influence inputs.
- Incentive Compatibility: Align incentives.
- Optimization: Finds best solution under constraints.
Also references 11 related abstractions
- Accountability: Responsibility for actions.
- Bounded Rationality: Limited decision capacity.
- Constraint: Limits possibilities to guide outcomes.
- Goal Congruence (Alignment): Alignment of objectives.
- Mechanism Design: Rule engineering.
- Multiobjective Optimization: Balance competing objectives.
- Observability: Infer internal state externally.
- Overfitting: Poor generalization.
- Representation: Model complex ideas.
- Trade-offs: Balancing competing priorities.
Variants¶
Narrower or domain-specific specializations that share this archetype's core structure. Recognized variants are established; candidate variants are provisional.
Proxy Metric Alignment · implementation variant · recognized
Aligns an indirect measurement proxy with an underlying outcome that cannot be observed directly or cheaply.
Reward Function Alignment · domain variant · recognized
Aligns rewards for agents, teams, models, or participants with the behavior and outcomes the system actually intends.
Guardrailed Objective Alignment · risk or failure variant · recognized
Aligns a primary objective while surrounding it with non-negotiable guardrails for safety, legality, quality, fairness, or mission boundaries.
KPI Alignment Governance · governance variant · recognized
Aligns organizational performance indicators with mission outcomes, decision rights, and behavior incentives.
Editorial Notes¶
Problem Classification¶
Classification: Goal, Value & Purpose Misalignment → Optimization Target & Mission-Scope Drift
Problem kernel: optimization pressure targets a stale or gameable proxy
Rationale: Earliest causal condition: A system is subject to optimization pressure, but the target being optimized is implicit, underspecified, proxy-based, stale, gameable, or misaligned with the real outcome that stakeholders care about.
Independent corroboration: The earliest necessary condition in the frozen evidence is: A system is subject to optimization pressure, but the target being optimized is implicit, underspecified, proxy-based, stale, gameable, or misaligned with the real outcome that stakeholders care about. That is a optimization target and mission scope drift problem because Proxies, subunit targets, or expanding subobjectives displace the intended system outcome and silently erode protected mission dimensions.
Review outcome: Independent reviewer agreement; high confidence.