Value-Weight Sensitivity Analysis¶
Method — instantiates Welfare Analysis and Distributional Effects Assessment
Varies welfare weights, thresholds, and discount assumptions to test whether the decision remains acceptable under reasonable normative alternatives.
Value-Weight Sensitivity Analysis holds the scenario, the affected-party map, and the estimated incidence fixed, and varies only the normative dials — which welfare metric counts, how heavily each group's welfare is weighted, the discount rate applied to future welfare, and any acceptability threshold — to see whether the recommendation flips. Its defining idea is that a welfare verdict can be an artifact of unstated value choices, so the real test is whether the decision survives across the range of weightings that reasonable people actually hold. It changes the values, never the facts of the comparison; the distribution it reweights is taken as given.
Example¶
An agency weighs a carbon-abatement program whose costs fall on present energy consumers and whose benefits accrue mostly to future generations and to lower-income regions most exposed to heat. The emissions and cost estimates are settled; what is contested is how to value them. Holding those estimates fixed, the analysis sweeps three dials: the social discount rate from low to high, an equity weight that counts a dollar to a poorer region more heavily than a dollar to a richer one, and the welfare metric itself (money versus a health-and-wellbeing measure).
It reports a switching value — the discount rate above which the program stops clearing its bar. Under a low rate, close to the framing of the Stern Review, it passes easily; under a higher rate, nearer the approach associated with William Nordhaus, it does not.[n1] The entire decision, it turns out, rides on one contested number. That relocates the debate correctly: the room stops arguing "is this efficient?" and starts arguing "what discount rate is defensible?" — the normative question that had been buried inside a single aggregate score.
How it works¶
- Enumerate the value parameters. List every normative dial the verdict could hinge on: the welfare metric, distributional weights, the discount rate, and any acceptability threshold.
- Set reasonable ranges. For each dial, bound the span that defensible positions actually occupy — and record the basis for those bounds.
- Sweep, singly and jointly. Move each dial across its range with the facts held constant, then move combinations, watching for the point where the recommendation changes.
- Report switching values. Name the exact weighting at which the decision flips and which dial it is most sensitive to, so the argument attaches to the contested value rather than to the headline number.
Tuning parameters¶
- Parameters varied — which value dials are in play. Omitting one (say, distributional weights) silently asserts it doesn't matter.
- Range width — how wide a span each dial sweeps. A narrow range fakes robustness; too wide a range makes everything look fragile.
- Sweep structure — one-at-a-time versus joint. Joint sweeps catch interactions but obscure which single parameter is driving the flip.
- Output form — a switching value versus a full robustness distribution. Switching values are actionable; distributions are more complete but harder to decide on.
- "Reasonable" bound — whose value positions count as within range. Drawing this line is itself a value judgment and should be disclosed.
When it helps, and when it misleads¶
Its strength is that it exposes value-weight laundering — the move of hiding a normative choice inside a supposedly technical score — and it tells the room whether their disagreement is empirical or normative, which are resolved in completely different ways.
Its failure mode is that the ranges it sweeps are themselves value judgments: a quietly narrow range manufactures a false sense of robustness, while a decision that is genuinely knife-edge on values can become paralyzing, and sweeping everything at once can bury the one dial that actually matters. The classic misuse is presenting a single weighting as neutral or objective and skipping the sweep entirely. The guarding discipline is to disclose each range and its basis and to report switching values rather than a bare "robust / not robust," so readers can judge whether the pivotal value is defensible.
How it implements the components¶
This method realizes the normative-robustness side of the archetype — stress-testing the values, not the facts:
welfare_metric_and_value_weights— the parameters it varies are the metric and the weights, discounting included as a weight on future welfare; it turns them from hidden assumptions into explicit, movable dials.uncertainty_and_sensitivity_frame— it is the sensitivity frame pointed at normative rather than empirical inputs, reporting switching values and the dial the verdict depends on.
It does not choose or vary the comparison scenario over a horizon (baseline_and_counterfactual_frame, temporal_distribution_window) — that is Counterfactual Welfare Comparison, its nearest twin. This method varies the weights on a fixed comparison; the twin varies the comparison under fixed weights.
Related¶
- Instantiates: Welfare Analysis and Distributional Effects Assessment — it is the robustness check that keeps a welfare verdict from resting on one unstated value.
- Consumes: the mapped distribution it reweights comes from Distributional Incidence Matrix or Subgroup Disaggregation Audit.
- Sibling mechanisms: Distributional Incidence Matrix · Counterfactual Welfare Comparison · Subgroup Disaggregation Audit · Compensation Adequacy Review · Externality and Spillover Inventory · Equity Guardrail Test · Public Reason Disclosure Protocol
Editorial Notes¶
Form Classification¶
Form family: Analysis, Modeling & Optimization
Rationale: Value-Weight Sensitivity Analysis operates as an analytical, modeling, inference, comparison, or optimization procedure that derives insight or a solution because it varies welfare weights, thresholds, and discount assumptions to test whether the decision remains acceptable under reasonable normative alternatives.
Independent corroboration: The frozen evidence defines Value-Weight Sensitivity Analysis as 'Varies welfare weights, thresholds, and discount assumptions to test whether the decision remains acceptable under reasonable normative alternatives', so its operative form is Analysis, Modeling & Optimization.
Nearest alternative: Assessment, Review & Assurance — Value-Weight Sensitivity Analysis includes features of a bounded evaluation of existing evidence or work that produces a finding or disposition, but its defining operation is an analytical, modeling, inference, comparison, or optimization procedure that derives insight or a solution.
Review outcome: Independent reviewer agreement; medium confidence.
Origin Attribution¶
Primary origin: Public Administration & Policy
Origin pattern: Single lineage
Present-day reach: Universal
Rationale: OECD/JRC Handbook on Constructing Composite Indicators documents that composite-indicator practice requires explicit weights and sensitivity analysis because rankings can change with value judgments. This is direct, mechanism-specific evidence for public administration policy as the best-evidenced historical home of the operation—Varies welfare weights, thresholds, and discount assumptions to test whether the decision remains acceptable under reasonable normative alternatives.—rather than evidence merely that the operation is useful there. The retained alternates record genuine adjacent lineages; later portability is represented separately by domain_reach=universal.
Related originating lineages:
- Accounting & Auditing — Accounting and audit's variance, evidence, ledger, and assurance tradition contributes a separate formative lineage to the mechanism's value weight sensitivity analysis logic.
- Economics & Finance — Economics Finance supplies a historically relevant adjacent lineage or formative practice for the operation—Varies welfare weights, thresholds, and discount assumptions to test whether the decision remains acceptable under reasonable normative alternatives.—but the adjudicated evidence more directly locates the defining lineage in public administration policy.
- Law & Governance — Legal doctrine, regulatory governance, and procedural accountability supplies a parallel or contributing lineage for the mechanism's defining operation: varies welfare weights, thresholds, and discount assumptions to test whether the decision remains acceptable under reasonable normative alternatives.
- Organizational & Management Science — Organizational design, management, and operational governance supplies a parallel or contributing lineage for the mechanism's defining operation: varies welfare weights, thresholds, and discount assumptions to test whether the decision remains acceptable under reasonable normative alternatives.
- Statistics & Experimental Design — Statistics, experimental design, and measurement theory supplies a parallel or contributing lineage for the mechanism's defining operation: varies welfare weights, thresholds, and discount assumptions to test whether the decision remains acceptable under reasonable normative alternatives.
Review resolution: The blind reviewers disagree on primary lineage (economics_finance versus public_administration_policy). The defining operation is: Varies welfare weights, thresholds, and discount assumptions to test whether the decision remains acceptable under reasonable normative alternatives. The researched OECD/JRC Handbook on Constructing Composite Indicators establishes that composite-indicator practice requires explicit weights and sensitivity analysis because rankings can change with value judgments. That source therefore supports public administration policy as the historical origin. economics finance remains in the uncapped alternates where it contributes a formative practice, but application or governance is not itself proof of origin. origin_mode=single_lineage records lineage construction; domain_reach=universal separately records later applicability.
Encyclopedia synthesis: The exact catalogued form synthesizes established practice rather than reproducing a single standard historical label.
Review outcome: Researched adjudication after independent review; high confidence.
Sources consulted:
Notes¶
[n1] The social discount rate sets how much weight future welfare carries against present welfare, and small changes swing long-horizon verdicts enormously. The well-known divergence between the low-rate Stern Review and the higher-rate approach associated with William Nordhaus is the canonical illustration that a climate verdict can turn on a contested value rather than on the physical facts. ↩