Skip to content

Criteria, Tradeoff & Robust Selection

← Back to Decision, Search & Optimization Failure

Known alternatives are compared under unrealistic baselines, narrow objectives, dominated tradeoffs, or fragile assumptions rather than defensible multi-criteria and scenario-aware selection.

38 mechanisms across 5 solution archetypes. This is a recurring problem pattern within Decision, Search & Optimization Failure; the mechanisms below inherit it from the primary archetype they instantiate.

Because this set contains more than 30 mechanisms, it is divided by form family—the concrete kind of thing a practitioner deploys, enacts, maintains, or convenes. This is a browsing subdivision only; it does not change the inherited problem classification. Click a form below to jump to its fully visible section.

Form familyMechanismsDescription
Analysis, Modeling & Optimization11A calculation, model, estimator, diagnostic, comparison, simulation, or optimization that transforms inputs into an inference, prediction, recommendation, or formal result.
Assessment, Review & Assurance9A bounded evaluation of existing evidence, work, compliance, or readiness that produces a finding, approval, correction, or disposition.
Decision, Gate & Allocation6A bounded selection, disposition, routing, admission, prioritization, matching, or allocation among eligible alternatives.
Experiment, Test & Rehearsal3An active probe, controlled variation, simulated condition, or practiced execution used to generate evidence or readiness.
Interface, Display & Cue2A user-facing perceptual surface or interactive affordance that presents status, options, warnings, prompts, or controls.
Organization, Role & Governance1An enduring actor, authority, body, program, service, pooled capacity, or institutional arrangement whose mandate, membership, resources, or continuity is operative.
Record, Log & Register1A durable, usually accumulating account of actual events, decisions, custody, exceptions, or state transitions whose value depends on history, provenance, or accountability.
Representation, Specification & Plan3A non-executable information artifact that externalizes understood, desired, or future structure, including maps, matrices, templates, checklists, specifications, reports, plans, and schedules.
Rule, Policy & Commitment2A standing constraint, permission, default, threshold, quota, obligation, right, or conditional action rule governing future behavior.

Analysis, Modeling & Optimization

A calculation, model, estimator, diagnostic, comparison, simulation, or optimization that transforms inputs into an inference, prediction, recommendation, or formal result.

11 mechanisms · View full form family

  • Barrier Height Estimation — Sizes the activation barrier — the upfront effort and friction that must be paid before a change becomes self-sustaining — so it can be weighed against the payoff.
  • Break-Even Activation Model — Prices the activation decision by combining upfront cost, probability of crossing, timing, and post-threshold benefit into an explicit break-even condition.
  • Counterfactual Non-Activation Comparison — Compares activation against delaying, doing nothing, pursuing a lower-barrier alternative, or investing in a different threshold-crossing opportunity.
  • Feasibility Sensitivity Probe — Perturbs the feasibility and cost assumptions to see whether the winning option and its dominance ranking survive — or hang on one fragile estimate.
  • Knee Point Analysis — Finds the bend in the frontier where extra gains start costing disproportionately more, nominating that point of diminishing returns as a pragmatic default.
  • Monte Carlo Robustness Screen — Samples many plausible parameter combinations to estimate how often each candidate remains acceptable, with sampling assumptions documented.
  • Multiobjective Optimization Model — Formalizes the objectives and constraints as math and searches the feasible space to generate frontier points where the options are too many or too continuous to list by hand.
  • Regret Analysis — Compares how much each option would underperform the scenario-specific best choice, supporting decisions that avoid severe ex post regret.
  • Robust Optimization Model — Implements robust selection by optimizing under uncertainty sets, downside constraints, or scenario families rather than a single best-estimate parameter vector.
  • Sensitivity and Scenario Sweep — Tests whether the activation recommendation changes under different assumptions about costs, adoption rate, benefit timing, failure probability, and maintenance burden.
  • Status Quo Costing Sheet — Refuses to treat 'do nothing' as free — prices the status quo as a real option with ongoing costs, residual risks, and forgone value.

Assessment, Review & Assurance

A bounded evaluation of existing evidence, work, compliance, or readiness that produces a finding, approval, correction, or disposition.

9 mechanisms · View full form family

  • Explainability Review — Asks not whether a system is correct but whether its reasons are legible — whether the explanation it offers is understandable, and faithful, enough for the people who must rely on or contest the decision.
  • Ideal Comparator Filter — Catches comparators that have smuggled in perfection and quarantines them, so a real option is never rejected for failing to match something no one could have chosen.
  • Process Audit — Inspects the procedures, approval chains, and controls behind a system's outputs — catching the fragile or noncompliant process that a clean result can hide.
  • Robust Policy Design Review — Applies robust selection to a policy rule by checking whether it remains acceptable across populations, states, scenarios, or implementation contexts.
  • Scenario Robustness Check — Evaluates each candidate solution against named scenarios and records where it remains acceptable, fails, or requires contingency support.
  • Shared-Burden Comparison Table — Forces every option onto the same dimensions under the same constraints, so none gets to be abstract and exempt from burdens the others carry.
  • Stress-Tested Plan Review — Reviews a plan or design against adverse but plausible conditions before selecting it for implementation.
  • Tiered Audit Protocol — Starts every case at the lightest, least-intrusive evaluation and widens internal access one tier at a time only when defined triggers fire — so scrutiny is spent where risk actually shows up.
  • White-Box Audit — Opens the box and inspects the internals directly — code, configuration, records, controls, and decision logic — to find the causes and hidden risks that behavior alone cannot reveal.

Decision, Gate & Allocation

A bounded selection, disposition, routing, admission, prioritization, matching, or allocation among eligible alternatives.

6 mechanisms · View full form family

  • Defect/Disqualifier Sort — Separates each shortfall into a residual defect to carry forward as a tradeoff versus a hard-constraint violation that genuinely disqualifies.
  • Dominance Screening — Removes every option that another feasible option matches or beats on all objectives, shrinking a listed field to its non-dominated set before any value choice is made.
  • Maximin / Satisficing Rule — Chooses an option that maximizes the minimum acceptable performance or clears a defined performance floor across scenarios.
  • Minimax Decision Rule — Selects the option with the least severe worst-case loss when guarding against credible downside is the governing concern.
  • Stage-Gate Activation Review — Divides activation investment into decision gates so commitment increases only when evidence about threshold distance, adoption, and benefit realization improves.
  • Weighted Scoring Overlay — Chooses among the non-dominated options by attaching explicit, stakeholder-elicited weights to each objective and scoring every frontier point — keeping the value judgment on the surface.

Experiment, Test & Rehearsal

An active probe, controlled variation, simulated condition, or practiced execution used to generate evidence or readiness.

3 mechanisms · View full form family

  • Black-Box Test — Evaluates a system purely by exercising its inputs and observing its outputs — treating the internals as a sealed box and judging only what can be seen from outside.
  • Pilot Option Probe — Runs a bounded experiment that preserves option value while learning whether full activation is likely to cross the threshold and produce durable benefit.
  • Post-Crossing Feedback Check — Checks whether the newly activated state is generating the expected reinforcing feedback, recurring benefit, or operational stability after the threshold is crossed.

Interface, Display & Cue

A user-facing perceptual surface or interactive affordance that presents status, options, warnings, prompts, or controls.

2 mechanisms · View full form family

  • Efficient Frontier Plot — Draws the non-dominated options as points in objective space with the efficient boundary traced through them, so which options are efficient is visible at a glance.
  • Tradeoff Curve Visualization — Plots one objective against another along the frontier to expose the exchange rate — how much of one must be given up per unit of the other, and where that price accelerates.

Organization, Role & Governance

An enduring actor, authority, body, program, service, pooled capacity, or institutional arrangement whose mandate, membership, resources, or continuity is operative.

1 mechanism · View full form family

  • Certification Regime — A standing institution that codifies the evidence a system must present before it is approved — keyed to its risk class — and defines the events that force the credential to be re-earned.

Record, Log & Register

A durable, usually accumulating account of actual events, decisions, custody, exceptions, or state transitions whose value depends on history, provenance, or accountability.

1 mechanism · View full form family

  • Comparison-Class Review Memo — Records, for a given decision, what comparison class each objection actually used and flags where a comparator drifted between aspiration, diagnostic, and decision roles.

Representation, Specification & Plan

A non-executable information artifact that externalizes understood, desired, or future structure, including maps, matrices, templates, checklists, specifications, reports, plans, and schedules.

3 mechanisms · View full form family

  • Decision Matrix Under Uncertainty — Displays candidates, scenarios, performance thresholds, robustness metrics, and tradeoff notes so selection is auditable.
  • Feasible Option Inventory — Turns 'compared to what?' into an explicit, bounded list of the options that could actually be chosen or built under the real constraints.
  • Inspection / Outcome Matrix — A grid that lists every question the evaluation must answer and assigns each to the evidence source that can answer it — behavior test, internal inspection, or both — so no question is orphaned and no evidence is collected without a question.

Rule, Policy & Commitment

A standing constraint, permission, default, threshold, quota, obligation, right, or conditional action rule governing future behavior.

2 mechanisms · View full form family

  • Activation Hurdle-Rate Rule — Requires expected post-threshold value to exceed activation cost, uncertainty, delay, and opportunity cost by a predeclared margin before commitment.
  • Best Feasible Alternative Test — Applies the rule that an option is validly rejected only if some feasible alternative beats it on net — not because it falls short of an ideal.