Assessment, Review & Assurance¶
← Back to Mechanisms by Form Family
A bounded evaluation of existing evidence, work, compliance, or readiness that produces a finding, approval, correction, or disposition.
1,313 mechanisms across 648 solution archetypes. Form describes the concrete thing a practitioner deploys, enacts, maintains, or convenes; it does not describe the problem, the solution move, or the originating domain.
Because this set contains more than 100 mechanisms, it is divided by solution family—the governing move the mechanism makes. This is a browsing subdivision only; it does not change the form classification. Click a family below to jump to its fully visible section, or click a column header to sort.
| Solution family | Mechanisms | Description |
|---|---|---|
| Access, Admission & Permissions | 6 | Solutions that decide who or what may enter, act, consume capacity, or cross a protected boundary, including eligibility rules, quotas, credentials, and scoped authority. |
| Adaptation & Reconfiguration | 38 | Solutions that alter structure, parameters, roles, or behavior in response to changing conditions while preserving the system's purpose. |
| Aggregation & Synthesis | 22 | Solutions that combine many observations, judgments, signals, or parts into a useful whole while managing weighting, dependence, and loss of detail. |
| Alignment & Incentives | 27 | Solutions that make individual choices, rewards, responsibilities, or local objectives support a larger goal instead of working against it. |
| Allocation & Prioritization | 12 | Solutions that distribute scarce attention, effort, money, capacity, or opportunity among competing claims and make the order of service explicit. |
| Anticipation & Forecasting | 29 | Solutions that look ahead, surface plausible futures, identify leading indicators, or prepare options before a consequential state arrives. |
| Attention, Salience & Focus | 15 | Solutions that direct limited attention toward what matters, protect focus from interference, or deliberately change what becomes noticeable. |
| Boundary & Scope Control | 24 | Solutions that define, move, or police what is inside a problem, system, role, claim, or responsibility and what remains outside it. |
| Buffering & Reserves | 31 | Solutions that absorb variability, delay, shocks, or temporary imbalance through slack, queues, inventories, reserves, or intermediate storage. |
| Calibration & Tuning | 40 | Solutions that compare behavior with a reference and adjust parameters, thresholds, mappings, or tolerances until performance falls within an acceptable range. |
| Causal Diagnosis | 6 | Solutions that distinguish symptoms from causes, compare explanations, localize a fault, or identify the intervention point responsible for an outcome. |
| Classification & Taxonomy | 12 | Solutions that sort cases into meaningful classes, establish membership criteria, or organize concepts so distinctions can guide action. |
| Communication & Signaling | 15 | Solutions that convey meaning, intent, state, or credibility across people or systems while accounting for interpretation, noise, and strategic response. |
| Comparison & Evaluation | 6 | Solutions that place alternatives, cases, or outcomes against shared criteria so differences become visible and judgments become defensible. |
| Compression & Simplification | 12 | Solutions that reduce complexity, detail, or dimensionality while retaining the structure needed for the current decision or task. |
| Constraints & Guardrails | 44 | Solutions that prevent unacceptable states or actions by encoding limits, invariants, preconditions, safe envelopes, or error-proofing rules. |
| Containment & Isolation | 23 | Solutions that keep faults, hazards, conflicts, contamination, or overload from spreading by separating regions, flows, or responsibilities. |
| Coordination & Synchronization | 40 | Solutions that align interdependent actors, tasks, clocks, states, or handoffs so joint work progresses without collision or drift. |
| Cost, Value & Pricing | 6 | Solutions that expose economic value, opportunity cost, price, return, or burden so choices reflect what is gained, spent, or displaced. |
| Decomposition & Modularity | 16 | Solutions that split a difficult whole into coherent levels, modules, roles, or subproblems that can be understood and changed more independently. |
| Decoupling & Interfaces | 26 | Solutions that reduce harmful dependency by inserting contracts, adapters, abstractions, or replaceable boundaries between interacting parts. |
| Deliberation & Conflict Resolution | 4 | Solutions that structure disagreement, negotiation, arbitration, or collective judgment so incompatible views can reach a workable resolution. |
| Diversity & Exploration | 2 | Solutions that preserve variety, generate alternatives, widen the search space, or prevent premature convergence on one approach. |
| Emergence & Self-Organization | 23 | Solutions that shape local rules, interactions, or environmental cues so useful global order can arise without direct central specification. |
| Error Prevention & Correction | 4 | Solutions that remove opportunities for mistakes, detect invalid states, repair deviations, or make failures easier to reverse. |
| Evidence, Inference & Validation | 102 | Solutions that gather, test, triangulate, or qualify evidence so claims and decisions match what the observations can actually support. |
| Feedback & Regulation | 19 | Solutions that sense the effects of action and use the result to stabilize, steer, damp, amplify, or otherwise regulate subsequent behavior. |
| Flow & Routing | 8 | Solutions that direct material, information, demand, work, or traffic through paths and stages to improve movement and avoid congestion. |
| Governance & Accountability | 40 | Solutions that allocate decision rights, oversight, responsibility, transparency, and consequences so power remains answerable and action-owned. |
| Identity, Reference & Matching | 19 | Solutions that establish what an entity is, bind records to the right referent, resolve names, or match cases without confusing near-equivalents. |
| Integration & Composition | 2 | Solutions that assemble parts into a functioning whole, reconcile interfaces, and verify that combined behavior preserves required properties. |
| Knowledge, Memory & Provenance | 33 | Solutions that capture, retain, retrieve, transfer, and trace knowledge or records so later users can recover both content and origin. |
| Learning & Scaffolding | 27 | Solutions that sequence practice, feedback, examples, and support so capability grows and transfers beyond the original learning setting. |
| Lifecycle & Maintenance | 5 | Solutions that manage creation, operation, upkeep, renewal, retirement, and accumulated burden across the useful life of an artifact or system. |
| Mapping & Transformation | 54 | Solutions that translate between representations, coordinate systems, scales, formats, or states while preserving the relationships that matter. |
| Measurement & Observability | 20 | Solutions that make hidden state inferable through instruments, indicators, probes, sampling, or diagnostic views with known limits. |
| Negotiation & Strategic Interaction | 22 | Solutions that account for other agents' incentives, reactions, commitments, bargaining power, and counter-moves when outcomes are interdependent. |
| Normalization & Standardization | 7 | Solutions that create comparable scales, shared formats, common baselines, or repeatable conventions across otherwise inconsistent cases. |
| Optimization & Search | 16 | Solutions that explore alternatives under objectives and constraints, prune infeasible regions, and improve a candidate toward a chosen criterion. |
| Ordering, Sequencing & Dependencies | 14 | Solutions that arrange steps or events according to precedence, causality, readiness, or dependency so work happens in a valid order. |
| Participation, Norms & Culture | 36 | Solutions that shape belonging, legitimacy, shared expectations, collective practice, and the willingness of people to contribute or comply. |
| Planning & Staging | 18 | Solutions that turn an intended outcome into phases, milestones, option points, and coordinated preparations before execution. |
| Prediction & Simulation | 6 | Solutions that use models, scenarios, experiments, or synthetic environments to estimate behavior before committing in the real system. |
| Quality Assurance & Release | 8 | Solutions that verify fitness, coverage, conformance, and readiness before an output is accepted, shipped, or trusted downstream. |
| Recovery & Restoration | 9 | Solutions that return a damaged, degraded, or interrupted system to service through repair, rollback, reentry, regeneration, or reconstruction. |
| Redundancy & Fault Tolerance | 3 | Solutions that preserve service when parts fail by duplicating capability, diversifying failure modes, or providing independent alternate paths. |
| Reframing & Sensemaking | 56 | Solutions that change the interpretive frame, surface hidden assumptions, or organize ambiguous experience into a more useful account. |
| Representation & Modeling | 105 | Solutions that construct schemas, models, diagrams, abstractions, or formal descriptions that make structure available for reasoning. |
| Resource Efficiency & Conservation | 7 | Solutions that reduce waste, preserve scarce stocks, recover usable value, or improve the useful output obtained from finite resources. |
| Risk, Robustness & Uncertainty | 40 | Solutions that make uncertainty explicit, limit downside, preserve acceptable behavior across variation, or prepare contingencies for adverse outcomes. |
| Scaling & Capacity | 25 | Solutions that match capability to load, grow or shrink safely, and manage how structure and performance change with size. |
| Scheduling & Pacing | 8 | Solutions that choose timing, cadence, duration, rate, or work-in-progress so demand and action remain temporally compatible. |
| Selection & Filtering | 17 | Solutions that admit, retain, rank, or reject candidates according to fitness, relevance, quality, or another discriminating rule. |
| State & Transition Management | 1 | Solutions that define valid states, govern transitions among them, preserve transition history, and prevent ambiguous or illegal mode changes. |
| Substitution & Fallback | 6 | Solutions that replace unavailable or unsuitable means with alternatives while preserving the essential function, contract, or outcome. |
| Thresholds & Phase Change | 33 | Solutions that detect, create, avoid, or govern nonlinear transitions when accumulating conditions cross a consequential boundary. |
| Tradeoffs & Decision Support | 30 | Solutions that expose competing objectives, preference structure, stopping rules, and consequences so a choice can be made under constraint. |
| Transmission, Propagation & Networks | 15 | Solutions that shape how signals, behaviors, effects, or resources spread through channels and network topology over space or time. |
| Variation & Experimentation | 19 | Solutions that deliberately vary conditions, compare trials, preserve controls, and learn from differential outcomes without overclaiming. |
Access, Admission & Permissions¶
Solutions that decide who or what may enter, act, consume capacity, or cross a protected boundary, including eligibility rules, quotas, credentials, and scoped authority.
6 mechanisms · View full solution family
- Access Log Review — Examines records of how permissions were actually used — successful accesses, failed attempts, escalations, and anomalies — to detect misuse, dormant grants, and scope failures after the fact.
- Access Recertification — On a fixed cadence, asks each resource owner or manager to review the access their people hold and explicitly confirm, narrow, or revoke it, so grants that outlived their purpose expire instead of accumulating.
- Appeals or Reconsideration Workflow — Gives a contested decision a defined second path — timed review, new-evidence handling, and a route to escalation — so a denial can be corrected or confirmed by someone other than the gate that made it.
- Blind or Double-Blind Review — Withholds identity and status signals from the decider so passage turns on the merits of the case rather than on who is behind it.
- Property Rights Impact Assessment — Tests a proposed rights arrangement before it is enacted for who gains, who is dispossessed, and whether it risks overuse or anti-commons gridlock — so the distribution of sticks is chosen with eyes open.
- Random Sample Audit — Pulls a random sample of gate decisions — including the rejected and demoted ones — and re-judges them to measure consistency and surface criteria nobody wrote down.
Adaptation & Reconfiguration¶
Solutions that alter structure, parameters, roles, or behavior in response to changing conditions while preserving the system's purpose.
38 mechanisms · View full solution family
- Adaptation Gap Report — Surveys the standing portfolio of defense, mitigation, and adaptation measures to find where residual harms still fall through unhandled — before the next event, not after it.
- Affordance Inventory Walkthrough — Walks the on-hand stock item by item to surface hidden capabilities, condition, permissions, and pairwise fit — separating what a resource can do from what it is labelled for, before anything is committed to a build.
- After-Action Loss Feedback Review — Turns the residual loss from a specific event into design changes upstream, so the same harm is strengthened against rather than merely paid for again.
- Archetype Fit Checklist — Tests a proposed system-archetype match against its evidence and its strongest rival before the label is allowed to guide action.
- Behind-Front Stabilization Pass — Runs just behind the advancing front to verify the newly changed region and reconcile the small residual mismatch it leaves, locking progress before the front moves on.
- Biomimetic Translation Sheet — Takes an abstracted biological principle and pressure-tests whether it survives the jump to human scale and whether it can actually be manufactured before any engineering commits to it.
- Capacity Mapping — Compares required capabilities and resources against what implementing actors actually possess or can build in time.
- Coadaptation Cadence Review — A recurring review whose interval is deliberately matched to how fast the other side adapts, so strategies and defenses are refreshed before they go stale — no slower, and no more churn than needed.
- Complexity Budget Review — A recurring review that totals the successor's cumulative complexity against a fixed cap and flags when the sum — not any single item — starts to threaten launchability.
- Control Effectiveness Review — A periodic review that checks whether controls reduce spread, avoid collateral harm, and remain effective against adapted entrant behavior.
- Convergence Confidence Card — A standardized one-page record that fixes the convergence claim, its supporting and disconfirming evidence, caveats, and a graded transfer confidence in a form others can audit and reuse.
- Cross-Team Retrospective — Gathers several teams after a shared event to surface the system-level lesson that lives in the seams between them — the pattern no single group could see alone.
- Developmental Milestone and Biomarker Panel — A battery of observable milestones and biomarkers that reads out where an individual currently sits relative to the window — supplying the raw readiness signals and surrogate markers that locating it depends on.
- Equitable Access and Consent Review — An independent oversight review that checks a time-critical intervention reaches everyone fairly and consensually — and that the claimed window is real, not urgency manufactured from shaky group evidence.
- Essential/Incidental Feature Sort — Sorts every feature of a single source into essential, supporting, optional, accidental, or source-specific — using cases where the source fails to test which features actually carry the logic.
- Evaluator Exemplar Calibration — Aligns evaluators by independently judging shared samples, comparing rationales, and resolving construct-irrelevant drift.
- Feasibility Study — Investigates whether the design can be executed under technical, operational, financial, regulatory, and organizational constraints.
- Governance Readiness Review — Checks whether decision rights, accountability, funding authority, escalation paths, and revision authority are in place.
- Hidden Diffusion Checklist — A fixed screen of known transmission channels — shared standards, data, tooling, vendors, staff movement — run against a candidate recurrence to rule out copying before it is called independent convergence.
- Homoplasy vs. Inheritance Review — Adjudicates whether a shared trait reflects common ancestry (homology) or independent origin (homoplasy) by weighing how deep versus superficial the resemblance is against the pattern of descent.
- Identity-Cue Audit — Reviews the end-to-end evaluation journey for contextual signals that make identity unnecessarily diagnostic.
- Implementation Readiness Review — Reviews whether people, resources, workflows, authority, support, and risk controls are ready enough to proceed.
- Learning Review Cadence — A recurring review that keeps the learning system alive — periodically checking whether past lessons changed practice, pruning stale ones, and revising the guidance that no longer holds.
- Lineage Independence Audit — Enumerates the recurring cases and reconstructs each one's full provenance — origins, contacts, sources, and influences — to build the map that establishes whether the cases really arose separately.
- Mutualism Alignment Review — A periodic check on whether a partnership still creates value for both sides and for the wider system, catching the slow drift from mutualism into one-sided extraction before it breaks the relationship.
- Post-Incident Residual-Loss Assessment — A post-event protocol that separates the loss the defenses prevented from the loss that got through, and attributes the residual — with its uncertainty — to the layers and causes involved.
- Post-Transfer Boundary Review — After the adapted design ships, reviews the finished result against the rights, attribution, and community-knowledge boundaries the source imposed — catching a copy that drifted past the line the up-front checklist could only anticipate.
- Red Queen Dynamics Review — A periodic check on whether both sides are investing heavily yet neither is gaining relative advantage — the running-to-stay-in-place signature — and what regime the coupling is actually in.
- Reopening-Signal Verification Panel — Independently confirms the system has actually entered a more editable state — separating true induced malleability from arousal, expectancy, or a surface effect — before any corrective input is paired.
- Residual-Defect Scan — Sweeps the region the front has already passed to catch what it left behind — the missed spots and new mismatches a moving reconfiguration inevitably seeds.
- Skills Matrix — Maps who can perform which roles against the roles the system needs, exposing where coverage is thin and turning latent capability gaps into a visible, trackable metric.
- Stakeholder Boundary Review — Decides who counts as inside the system being shaped — constructors, beneficiaries, and the affected outsiders who bear the spillovers — before the boundary is drawn implicitly by whoever holds the pen.
- Stakeholder Pulse Check — Samples readiness and trust before high-stakes communication, launch, escalation, or change intervention.
- Substitution Matrix — A table that scores candidate stand-ins against the attributes a role requires and records which swaps are acceptable under which conditions — and which resources must never be substituted at all.
- Timing After-Action Review — Reviews whether the action was early, timely, late, over-intense, or ethically questionable, then recalibrates future windows.
- Tragedy of the Commons Diagnosis — Diagnoses the degradation of a shared resource as Tragedy of the Commons — where individually rational use, summed across users, destroys the pool everyone depends on.
- Window-Closure Review — Judges whether the receptive window has closed or is about to, and applies a stop rule that halts window-dependent escalation and hands off to protected alternatives rather than pushing harder past closure.
- Window-Opening Readiness Assessment — Reads readiness signals against a preset opening criterion to declare when a receiving system has actually entered its high-malleability window — separating true receptivity from a calendar date.
Aggregation & Synthesis¶
Solutions that combine many observations, judgments, signals, or parts into a useful whole while managing weighting, dependence, and loss of detail.
22 mechanisms · View full solution family
- Aggregation Bias Audit — A structured checklist that interrogates a finished aggregate for named failure patterns — masking, ecological fallacy, Simpson-style reversals, subgroup erasure, accidental weights, and scale artifacts.
- Appeal and Exception Review — A standing channel through which a filtered-out or softened output can be contested, and exceptions granted on stated public reasons — a release valve on the intersection.
- Before/After Content Audit — Compares the same outputs before and after they pass through the filter stack — draft versus published — to measure what was cut, softened, delayed, or reframed.
- Blind Independent Review Round — Requires reviewers, forecasters, jurors, or evaluators to record a private assessment before they see anyone else's score or the group's discussion.
- Borderline Whole Review Protocol — A review path for the cases the threshold cannot cleanly decide — nested, overlapping, temporary, or right-at-the-line wholes.
- Constraint and Invariant Checker — Evaluates every candidate against a fixed, explicit set of constraints and invariants the checker itself holds, accepting only those that violate none — regardless of how the candidate was produced.
- Door-to-Door or Field Sweep — Sends people to physically walk every zone and verify units on the ground, catching the ones administrative records never held.
- Feasibility Certificate Check — Accepts or prunes a candidate branch by checking a supplied certificate — a witness that a solution exists, or a compact rationale that none can — instead of re-searching it.
- Outlier, Range, and Transformation Sensitivity Review — Re-computes the association with and without outliers, across restricted and full ranges, and under raw versus transformed scales, to see how much of it survives those choices.
- Part Inventory and Granularity Review — Enumerates the candidate parts and fixes the granularity at which they are judged, before any unity relation is applied.
- Proof-Assistant Kernel Check — Re-checks a machine-generated proof term against a tiny fixed set of primitive inference rules, so trust rests only on a small kernel however elaborate the search that produced it.
- Representative Microcase Panel — Pulls a deliberate spread of individual cases across the distribution so humans can read how the equilibrium is actually experienced.
- Rollup Reconciliation Report — Reconciles a hierarchy's subtotals against an independent recomputation and its coverage lineage, flagging omissions, double-counts, and drift as an auditable artifact.
- Sample Audit Review — Tests a representative sample of delegated or broad-span work after the fact to infer whether the whole stays within quality, risk, and policy limits — without inspecting everything.
- Scientific Consensus Process — Converges a scientific community on the current best understanding by synthesizing the whole evidence base under calibrated uncertainty, recording dissent, and revising as knowledge changes.
- Stratified Sampling Review — Audits whether the measurement behind an aggregate actually covers every relevant subgroup and locality, rather than over-weighting the easiest cases to observe.
- Structural Filter Postmortem — After an output that should have surfaced didn't, reconstructs the trace of every filter it hit and how they combined — blamelessly, because each filter was locally reasonable and each producer sincere.
- Succinct Cryptographic Proof Verifier — Checks a tiny cryptographic proof that a large computation was performed correctly in far less work than redoing it — optionally without learning anything about the inputs.
- Translation Validation Checker — Checks that one output of an untrusted transformer is semantically equivalent to its input for that specific translation, instead of proving the whole transformer correct.
- Untrusted Solver with Trusted Checker — Splits a hard task into a large untrusted solver that proposes an answer plus a certificate and a small trusted checker that validates it, so authority rests only in the checker.
- Veto-Point Review — Walks the decision path to find every actor or gate whose lone refusal can block the outcome, surfacing those necessary consents before a holdout can exploit them.
- Wholehood Threshold Test — Applies a stated cutoff to the strength of the binding relation and returns a clean one-whole / many-parts verdict for clear cases.
Alignment & Incentives¶
Solutions that make individual choices, rewards, responsibilities, or local objectives support a larger goal instead of working against it.
27 mechanisms · View full solution family
- Accountability Chain Review — Traces a failure back along its chain of ownership and decision authority, then routes responsibility to a legitimate forum and to repair.
- Anonymous Belief Pre-Poll — A private pre-poll that captures each person's independent view before social influence can manufacture agreement.
- Audit or Review Cycle — Periodically examines the agent's actual work against the record, on a cadence and depth scaled to how much the agent is trusted.
- Beneficiary Feedback Gate — Blocks a renewal, release, or sign-off until the people the agent is meant to serve have been consulted and their complaints answered in writing — turning their voice into a checkpoint that cannot be routed around.
- Blame Attribution Review Meeting — A convened meeting where a group makes its own blame attribution explicit and tests it against evidence, with the accused given a real voice.
- Boundary-Sharpening Review Map — Lays the raw field beside the sharpened output, marks which neighbors were suppressed, and scores whether the sharpening actually improved detection.
- Compensation Adequacy Review — Evaluates whether proposed offsets, transfers, phased support, or mitigation measures are credible, reachable, and proportionate to identified losses.
- Concern Validity Review — Classifies each avoidance driver as legitimate constraint, reducible barrier, or distorted appraisal — and protects the valid ones from being 'overcome.'
- Equity Guardrail Test — Checks whether any subgroup falls below declared minimum floors or receives a burden that violates proportionality, procedural fairness, or priority-group commitments.
- Externality and Spillover Inventory — Searches beyond the formal decision boundary for displaced, delayed, or third-party costs and benefits, registering each so no spillover escapes the welfare account.
- Failure Debrief Without Global Label — Reviews a setback by separating strategy, conditions, effort, skill gaps, and constraints from identity-level conclusions.
- Just Culture Postmortem — A blameless failure review that draws the line between honest error, at-risk behavior, and recklessness, so a system failure is not pinned on one operator.
- Link-Label Scent Audit — A recurring review pass that walks every label, heading, button, and link and checks it against what an agent actually finds after clicking, flagging weak, ambiguous, or mismatched cues.
- Metric Gaming Review — A recurring audit that asks whether a metric improved because the real outcome improved, or because someone found a cheaper way to move the number.
- Nonrandom Sample Audit — A checklist that interrogates who the visible sample actually is — and who it silently leaves out — before their agreement is read as the population's.
- Obstacle Function Review — Examines what the obstacle protects, what it costs, whether it is real or modifiable, and what support or boundary would make effort safer.
- Procedural Fairness Review — A standing process that checks a constraint is applied consistently and neutrally, and gives anyone it was misapplied to a real, independent route to contest the decision.
- Product Purpose Review — Audits a product's features, roadmap, and growth targets against the user outcome it exists to serve, flagging the ones that grow engagement while failing the beneficiary.
- Ranking or Shelf-Placement Audit — Assesses whether list rank, screen location, shelf placement, search position, or queue order creates advantage independent of intrinsic quality.
- Resistance Signal Review — Treats backlash, workarounds, and complaints as diagnostic data — sorting genuine reactance from valid objection, capability gap, or bad incentive before anyone labels it defiance.
- Revenue Source Audit — A periodic independent examination that traces an agent's revenue past its intermediaries to its true sources and flags which streams bypass the constituency it is meant to serve.
- Scapegoat Risk Triage Checklist — Scores an emerging blame situation against a few fast risk flags — how quickly blame is converging and how vulnerable the named target is — to catch a scapegoating dynamic before the story hardens.
- Structural Harm Scan — Surfaces the systemic conditions a simple blame story hides — incentives, resource gaps, design defects, hidden beneficiaries — and gives omitted stakeholders a voice.
- Subgroup Disaggregation Audit — Breaks down aggregate impacts by subgroup, geography, role, income, exposure, access, or vulnerability to reveal hidden losses and uneven gains.
- System Health Review — Puts local scorecards next to whole-system outcomes on a cadence to catch local wins that quietly harm the whole.
- Systems Engineering Review — Checks at design gates that component and interface choices add up to the performance the whole system must deliver.
- Terrain or Topology Position Review — Reviews the physical, relational, computational, or institutional topology that creates positional value.
Allocation & Prioritization¶
Solutions that distribute scarce attention, effort, money, capacity, or opportunity among competing claims and make the order of service explicit.
12 mechanisms · View full solution family
- After-Action Concentration Review — After a concentration episode, reconstructs whether massing at the chosen point actually paid off, updates the model of how return scales with concentration, and feeds the lesson into the next decision.
- Anonymous Preference Poll — Collects private preferences without attaching responses to public identity.
- Capability-Promotion Review — A recurring review that spots the same capability being rebuilt locally across teams and decides whether it should be promoted into a supported host or shared layer — turning repeated duplication into an owned, escalated decision.
- Independent Rationing Equity Audit — Tests whether stated criteria, actual decisions, enforcement, and appeal outcomes align, including disparate burdens, proxy discrimination, privileged bypass, and missing claimant populations.
- Post-Integration Contribution Review — A scheduled look-back that compares a contribution's promised value against what it actually delivered — hidden coordination cost, work displaced, upkeep incurred — and feeds the verdict back into intake criteria.
- Privacy Impact Review — A pre-release assessment that maps what a source record actually contains and what a recipient could infer or re-identify from a proposed disclosure, before the disclosure is designed.
- Recusal, Delegation, or Separation Gate — Tests integrity, competence, authority, information, continuity, and replacement before changing occupancy.
- Reprisal Risk Audit — Identifies formal and informal costs that make truthful expression expensive.
- Role-Conflict Recurrence Audit — Samples workload, decisions, handoffs, exceptions, distress, and harm after redesign.
- Role-Expectation Conflict Matrix — Crosses roles and expectations by time, authority, resources, loyalty, information, ethics, and affected parties.
- Scarcity Declaration and Activation Protocol — Verifies shortage evidence, identifies the accountable declaring authority, publishes scope and duration, activates the criterion version, and starts mandatory review clocks.
- Shadow-Platform Audit — Inspects embedded systems for host-like facilities, duplicate authoritative state, and unbounded local extension growth, and registers each shadow platform it finds.
Anticipation & Forecasting¶
Solutions that look ahead, surface plausible futures, identify leading indicators, or prepare options before a consequential state arrives.
29 mechanisms · View full solution family
- Add/Remove Symmetry Audit — Measures, tooth by tooth, how much easier a system makes adding than removing — turning a vague sense of creep into a scored, side-by-side asymmetry map.
- Affect–Evidence Split Prompt — Separates the emotional response from the evidence and asks what the judgment would be if the affective cue were removed.
- Announcement Effect Audit — Measures, after the fact, how much of the intended effect leaked away during the window between announcement and effective date — the pre-emptive response provoked by advance notice alone.
- Avoided-Loss Counterfactual Review — Judges a forecast that appears to have 'failed' by estimating the loss it prevented, so a warning that averts its own prediction is credited as a success rather than a false alarm.
- Blind Independent Valuation Review — Has an evaluator estimate value with recent price, popularity, and sponsor identity hidden, producing a valuation signal that cannot simply be an echo of the momentum it is meant to test.
- Blinded or Masked Review — Hides the irrelevant cues during judgment so the relevant signal is evaluated without substitution pressure ever reaching the evaluator.
- Cue-Validity Audit — Tests whether a psychologically active cue has a genuine evidential relation to the target claim, and of what kind.
- Forecast Backtesting Cadence — A recurring ritual that pulls up what the organization predicted at each past horizon, compares it to what actually happened, logs the error and its direction, and recalibrates the confidence bands used going forward.
- Forecast Backtesting Review — After a project closes, compares what was forecast to what actually happened, records the signed error, and fires a recalibration so the next plan inherits the correction.
- Forecast Impact Audit — Examines, after release, how a forecast actually moved behavior — comparing the reaction that occurred against the reaction that was modeled, and testing whether anyone gamed it — to tell a self-defeating forecast apart from a merely wrong one.
- Horizon Forecast-Error Trigger and Adaptation Audit — Compares forecast intervals, signals, gate decisions, actual closure, distributed harm, reversal execution, and post-crossing adaptation.
- Hype Deflation Checklist — A fixed set of interrogations applied to a near-term impact claim to detect inflation by salience, novelty, selective sampling, promotional incentive, or pilot-to-production extrapolation — assembling the counter-evidence beside the hype.
- Incentive Compatibility Review — Reviews the design for the moves that pay targets more than compliance does, mapping each actor's incentive to offset and issuing patches that make the honest path the profitable one.
- Leakage Scan — Systematically interrogates a candidate feature set for information that would not be available in real use — future outcomes, post-decision fields, or forbidden proxies — before any of it ships.
- Negative Prediction Error Review — A recurring review of outcomes that came in worse than expected — separating genuine negative surprises worth learning from, from failures that were already priced in, without turning the lesson into punishment.
- Overserved Segment Research Sprint — Finds and profiles the overserved or ignored users whose current solutions overshoot their real needs, budgets, skill, access, or context — the segment where a disruptive entrant can take root.
- Positive Surprise Capture — A standing practice for catching outcomes that beat expectations before they are normalized away, and turning each genuine upside surprise into a concrete change that makes it repeatable.
- Proxy-Relevance Audit — Checks whether a proxy metric is target-faithful enough to support the weight of the update it is being asked to carry.
- Quote Survivability Test — Reads each likely excerpt entirely on its own and asks whether it stays accurate, attributable, and bounded once nothing around it remains.
- Red Herring Filter Checklist — Screens the moves in a live deliberation for issue-shifting, affective activation, or narrative cues that quietly replace the relevant evidence.
- Reward Signal Red Team — A standing adversarial team that tries to break a reward signal before it trains anyone — hunting for ways to score high while defeating the intent, and for who gets hurt in the process.
- Signal Scoring Rubric — Separates plausibility, impact, evidence direction, and response cost so ambiguous signals are not flattened into one misleading score.
- Social Card and Snippet Preview — Inspects and tunes the platform-generated previews — share cards, search snippets, thumbnails — that most audiences will see instead of the artifact itself.
- Stale Tooth Review — A recurring review that re-justifies each aging tooth against present need and prunes the ones whose reason has lapsed, giving the de-ratcheting owner a standing forum to remove.
- Technology Impact Base-Rate Review — Before accepting a forecast, positions the focal technology inside a reference class of analogous past adoptions — including flops and slow-burn successes — and lets the class's realized spread set the anchor and the uncertainty band.
- Three-Horizons Impact Review — A diagnostic that interrogates whether one impact narrative is silently blending run-the-core-now, manage-the-transition, and bet-on-the-future claims — and forces each into its own horizon with its own action posture.
- Transition Harm Review — Surfaces the users, workers, dependencies, and public goods a disruption could harm as it displaces the incumbent, and designs the mitigations and guardrails before scale locks the harm in.
- Value-Curve Crossing Review — Periodically tests whether the entrant is closing on, crossing, or stalling short of mainstream value thresholds, and fires the scale-up, hold, or stop decision on that evidence.
- Watchlist Review — Revisits signals assigned to watch or prepare status and decides whether to maintain, probe, escalate, retire, or archive them.
Attention, Salience & Focus¶
Solutions that direct limited attention toward what matters, protect focus from interference, or deliberately change what becomes noticeable.
15 mechanisms · View full solution family
- Alert-Fatigue Review — Periodically audits whether alarms and cues have been fired so often that people have stopped noticing them, and retunes their intensity before a real one is tuned out.
- Attention-Capture Inference Test — Traces why an item captured attention — which channel, design, or sponsor made it prominent — and tests whether that reason has anything to do with why it would matter.
- Counterexample Surface Scan — Deliberately hunts the disconfirming cases a vivid story leaves unshown, so the counterexamples get weighed too.
- Drug Interaction Screening — Checks whether medications, treatments, or supplements create harmful combined effects before they are co-prescribed or co-used.
- Evidence Weighting Rubric — Scores evidence against explicit significance criteria fixed before the evidence is seen, so vividness cannot smuggle in weight it has not earned.
- Executive Attention Review — A recurring review that recalibrates how leadership agenda time is spent across strategy, operations, risk, people, and learning, so urgent status updates stop crowding out everything else.
- Lead-Support Mix Check — Checks the balance between a lead channel and its supporting channels over time, so support frames the lead without either vanishing or swelling into a second competing figure.
- Near-Miss Notice Review — Studies the times a signal was almost missed — the catches that only just happened — and feeds what nearly failed back into the readiness, scan design, and cues that let it slip.
- Notification Priority Review — Re-examines an alerting system so that what pages a human is governed by significance and escalation criteria, not by how loud or how often an alert happens to fire.
- Red-Team/Blue-Team Comparison — Places opposed analyses or interpretations in the same review frame so assumptions, blind spots, and disagreements become visible.
- Salience Ladder Review — Ranks a field's elements by how strongly each actually pulls the eye, then lays that order against the intended task priority to catch what wrongly dominates.
- Separation-of-Duties Review — Prevents one actor or role combination from holding powers that interfere destructively with accountability, oversight, or independent judgment.
- Shown-vs-Unshown Audit — Sets a display's visible items beside the relevant ones it leaves out, so the gap between what is shown and the full field becomes something you have to look at.
- Stimulus Audit Walkthrough — A structured walkthrough of a space, interface, or workflow, taken from the point of view of the target task, that names every cue competing for attention and turns a vague 'too many distractions' into a concrete list of changes.
- Variant Review Board — Reviews proposed variants, exceptions, promotions, retirements, and updates to the core.
Boundary & Scope Control¶
Solutions that define, move, or police what is inside a problem, system, role, claim, or responsibility and what remains outside it.
24 mechanisms · View full solution family
- Ad Hoc Boundary-Shift Probe — Flags when a category's boundary was moved only after a counterexample appeared — the tell-tale post-hoc, circular shift that rescues a universal claim by redefining it.
- Capability Handoff Checklist — A signed-off transfer checklist that proves the receiving team can actually perform each captured task before the handoff is allowed to complete.
- Claim Strength Ladder Review — Reviews a claim's asserted force against its support and moves it up or down the all–most–some–none ladder until the two match.
- Counterexample Admissibility Test — Decides whether a proposed counterexample is a genuine member of the category by testing it against accepted edge cases rather than against the claim it threatens.
- Domain-Bound Checklist — Audits a quantified claim to confirm its domain is declared, its exceptions are named up front, and it never silently expands or contracts mid-argument.
- Encounter Surface Observation Walk — A structured field walk that watches who actually uses a contact surface and who is quietly kept out, turning direct observation into a refresh agenda.
- Environmental Impact Scoping — Expands a project's boundary to expose environmental pathways, cumulative effects, affected communities, and the authority responsible for them before the design is locked.
- Ethical Review — Judges whether a boundary excludes people, duties, rights, consent, or harms that a decision-maker is morally obligated to weigh — not a general ethics checklist, but a test of the boundary's moral standing.
- Exact-N Count Audit — Verifies a cardinality claim by fixing what counts as one unit and running an exhaustive census against that basis.
- Figurative Language Review Checklist — An editorial pass that scans a near-final draft, comparison by comparison, for figures that are unmarked, missing a named feature, or likely to lose their boundary when summarized.
- Impact Assessment — Measures the consequences a boundary pushes outside itself — the externalized costs, harms, and burdens — and tests which are material enough to change the decision.
- Inclusion/Exclusion Register Review — Audits the documented in/out record itself — the register of who and what was formally included or excluded — against evidence, to catch exclusions that were logged but never justified.
- Independent Needs Assessment — Establishes, independently of the role holder, what the underlying need actually is and who benefits from keeping it unmet.
- Inheritance Lint or Static Analysis — Scans an inheritance graph statically for structural smells — chains too deep, overrides that shadow nothing, exceptions past their budget — and flags them before they reach runtime.
- Model Scope Review — Audits what a model, dataset, or metric leaves out of its frame — and how those exclusions inflate the claims made from it.
- Negative-Claim Exhaustion Check — Tests a 'none/never' claim by asking how exhaustively the domain was searched and recording the coverage that backs the absence.
- Policy Scope Audit — Audits whether a policy's boundary excludes affected populations, jurisdictions, or implementation burdens — and routes the findings to an authority that can revise or re-audit it.
- Post-Exit Dependency Audit — A follow-up audit, run after exit, that checks whether the old dependency has quietly re-formed and protects those who report it.
- Precedent Consistency Audit — Samples recurrent decisions to test whether similar cases were treated alike, citations were complete, exceptions were equally available, and status stayed fresh.
- Red-Team Scoping Review — Adversarially attacks a proposed scope to see whether the boundary survives challenge or was quietly drawn to fit someone's convenience.
- Schema Extension and Override Check — Gates a schema that extends or overrides a base, verifying the descendant stays substitutable for the base — and, when a base change would break that, requiring a migration and backfill plan.
- Second-Source Review — Qualifies a genuine second source for a captured function so the organization is never captive to a single provider.
- Stakeholder Exclusion Audit — Checks which affected parties sit outside the boundary of evidence, participation, or remedy — and gives them a channel to put that exclusion on the record.
- Symmetric-Case Application — Checks that the membership test is applied with equal rigor to confirming and disconfirming cases, catching the asymmetric scrutiny that hides a boundary shift.
Buffering & Reserves¶
Solutions that absorb variability, delay, shocks, or temporary imbalance through slack, queues, inventories, reserves, or intermediate storage.
31 mechanisms · View full solution family
- Accountability-Link Audit — Checks whether an unearned inflow has loosened the link between a system's rewards and its accountable performance — the coupling that quietly goes slack when money arrives regardless of results.
- Base Image Provenance Attestation — Verifies and records where a base image actually came from — who built it, from what sources, by what process — so the layer everyone builds on is a checked origin rather than assumed-clean background.
- Calendar Capacity Audit — Totals the real time that meetings, deadlines, prep, travel, and recovery already claim against the hours actually available — before another commitment is added to the calendar.
- Calm-Period Readiness Review — Audits, on a schedule, whether readiness and slack have quietly eroded while nothing was going wrong — turning "we're probably fine" into a checked claim.
- Commitment Burndown Review — Periodically reconciles what was promised against what has been completed, cancelled, deferred, and newly accepted — so the true commitment load is tracked, not assumed.
- Configuration Baseline Diff — Compares an inherited system's live configuration against a known-good baseline and flags every setting that differs — surfacing inherited defaults and drift that no one on the current team consciously chose.
- Dependency-Safe Delete Check — A pre-deletion gate that traces every live inbound reference to a layer and refuses removal until the layer is proven an orphan nothing still depends on.
- End-of-Life and Maintainer Activity Check — Assesses whether an inherited substrate is still alive — within its support window and actively maintained upstream — so a component everyone assumes is cared-for isn't quietly abandoned.
- Exception Queue Audit — Periodically sweeps the queue for hidden work — blocked, duplicate, abandoned, mis-scoped, or unowned items — to check that the visible backlog is the honest one.
- Hidden Accumulation Probe — Hunts for stock that has quietly displaced across a boundary or piled up off the books, explaining a level that the visible flows cannot.
- Hidden Load Audit Sampling — Estimates how much hidden burden a set of reservoirs actually holds by inspecting a representative sample of them — surfacing accumulated load that event-by-event tracking never sees.
- Inherited Permission Review — Examines the privileges, roles, and access an inherited substrate silently grants the new system — surfacing over-broad rights that came bundled with the platform rather than being deliberately granted.
- Legacy Substrate Architecture Review — A structured human review of an inherited system's architecture — its real boundaries, coupling, and failure spread — to understand a legacy substrate as a whole before trusting anything built on it.
- Minor-Stressor Learning Review — Harvests every small stressor and near-miss for the lesson it carries — and turns each into a fresh drill scenario — so the cheap warnings are spent before the expensive failure arrives.
- Missed Trigger Review — Periodically audits cues that fired but went unacted-on, recovering stale intentions and feeding the misses back into better cue design.
- Mix-Shift and Base-Effect Audit — Tests whether composition, denominator, price, seasonality, selection, or comparison base creates apparent divergence.
- Order-Penetration Point Audit — Walks the actual flow to measure where customer-order information really starts governing work, versus where policy claims it does.
- Paired Confidence-Band Review — Reviews uncertainty in both trajectories and in their directional relationship, including shared-data dependence.
- Patient Flow Pathway Review — A structured multidisciplinary walk-through of the care pathway that traces where patients stall, showing that an upstream jam is usually a downstream sink constraint — and reallocates flow while protecting safety and dignity.
- Post-Release Rework Retrospective — Reviews whether the borrowed quality margin created enough learning, timing value, or continuity to justify its repayment cost.
- Quality or Health Scan — An automated pass over the system that surfaces candidate debt — smells, stale records, risky dependencies, manual workarounds — and measures its drag, feeding provisional items into the register for human triage.
- Refresh Burden and Accumulation Audit — Tallies the side-effects renewal creates — attention fatigue, accumulation, channel congestion, energy use, semantic drift, and obsolete-message persistence — against an explicit budget.
- Release Threshold Checklist — Prompts a reviewer to confirm, item by item, that the event record, risk signal, decay evidence, threshold, exceptions, and audit record are all present before any control is lifted.
- Robust Tail Statistic Review — Checks whether a heavy-tailed quantity is being summarized with means, variances, and normal intervals its tail makes meaningless — and prescribes robust, tail-sensitive replacements.
- Sales and Operations Boundary Review — A recurring cross-functional forum that owns the push-pull boundary, reconciles promises to reality, and decides when to move the point.
- Sales Capacity Alignment Review — Checks what sales wants to promise a customer against what delivery, implementation, and engineering can actually supply, before the promise is made.
- Stock–Flow Balance Reconciliation — Closes the books on a stock by reconciling its measured level change against the net of every inflow and outflow, and flags the unexplained residual.
- Tail Incident Review — Treats each extreme observation as a sample from the tail — evidence about the distribution and the controls — rather than a one-off anomaly to be explained away.
- Template or Policy Origin Audit — Traces an inherited template, policy, or config back to its origin and tests whether the assumptions its author baked in still hold in the context now using it.
- Transitive Vulnerability Scan — Checks a substrate's full transitive dependency set against known-vulnerability data, surfacing inherited flaws that live several hops below anything the local team wrote.
- Windfall Dependency Audit — Traces which functions, budgets, and habits now lean on the easy inflow rather than on earned performance — so hidden dependence is exposed before the windfall fades.
Calibration & Tuning¶
Solutions that compare behavior with a reference and adjust parameters, thresholds, mappings, or tolerances until performance falls within an acceptable range.
40 mechanisms · View full solution family
- Benchmark Deduplication Scan — Searches the training and development corpus for copies or restatements of the evaluation benchmark, so a memorised answer can't masquerade as a solved problem.
- Benchmarked Feedback — Explains a performance gap against an explicit rubric or standard, stating what the evidence shows and the confidence update it warrants.
- Blinded Assessment Script — A masking protocol that hides group and hypothesis from assessors and routes the reading through a masked central panel.
- Bullwhip Effect Review — Checks whether ordering, forecasting, or inventory feedback at one tier is amplifying variability at another tier of a supply chain.
- Checkpointed Convergence Review — Re-snapshots the approximation at fixed checkpoints to confirm it is still converging on the target — and to trigger a stop-or-escalate when it is not.
- Close-Call Review Protocol — Investigates a specific almost-event as evidence — surfacing what nearly went wrong — while leaving the actual no-harm outcome recorded exactly as it happened.
- Confidence Bucket Review — Bins past judgments by their stated confidence label and audits, in a recurring review, whether each bin's realized hit rate matches the label.
- Control Condition Fidelity Checklist — An item-by-item verification that the control arm, as actually delivered, matched its specification — that the intended differences were present and the required equivalences held.
- Counterfactual Plausibility Filter — Admits a counterfactual as a valid near-miss only if the better-or-worse alternative was genuinely reachable given what was known at the time, screening out hindsight stories.
- Cross-Scale Retrospective — Brings participants from multiple levels together after a cycle, disruption, or intervention to identify mismatched signals, timing, gain, and escalation rules.
- Cross-Scale Side-Effect Table — Audits a proposed intervention for benefits and harms it pushes above, below, and beside the scale it acts on, so success is not claimed by exporting damage.
- Dimensional Consistency Check — Audits the units on both sides of the scaling law to confirm the exponent is dimensionally possible and not an artifact of mismatched measures.
- Dimensionless Small-Parameter Check — Forms the dimensionless ratio that decides whether a departure is genuinely small — the go/no-go check that a perturbative expansion is even allowed at the operating point.
- Downstream Cache Context Audit — Checks exports, caches, screenshots, dashboards, reports, and model features for artifacts separated from their context.
- Ecological Validity Screen — Tests whether the environment a heuristic runs in is learnable enough — regular cues, prompt feedback — to justify any confidence at all before calibration even begins.
- Environmental Condition Checklist — A pre-measurement checklist that verifies the physical setting and instrument setup are within spec before any reading is taken.
- Expert Disagreement Calibration — Uses the spread among several independent experts on the same case as a live reliability signal — high disagreement caps confidence and triggers escalation.
- Feature Availability Audit — Walks every candidate input and asks whether its value would truly have been known at decision time, cataloguing the fields that would not.
- Follow-Up Repair Check — Revisits a difficult exchange after the fact — hours or days later — to confirm the message actually landed and the working relationship survived it.
- Fraud Risk Cutoff Review — Runs a recurring review of a fraud-score cutoff, splitting decisions into allow / review / block bands and re-tuning the band edges from monitored outcomes like caught fraud, chargebacks, and false declines.
- Label Proxy Screen — Scans every candidate feature for the tell-tale signature of a target proxy — a column that is suspiciously predictive because it is really a downstream trace of the outcome — and files the suspects for confirmation.
- Learning Challenge Band — Sets task difficulty within a productive learning range.
- Multi-Level KPI Review — Reviews local, intermediate, and system-level indicators together so a correction that improves one level is checked for consequences at the others.
- Norm Recalibration Review — A scheduled review that re-examines an established norm against current evidence, consent, and drift, and pulls the trigger to revise it when it no longer earns its pressure.
- Norm Source Mapping Workshop — A facilitated session that traces a taken-for-granted norm back to whose practice it actually is and what, if anything, that reference group knows.
- Normalized Metric Check — Builds a fair, comparable rate or ratio and checks whether it stays inside a tolerance band across scales, so raw totals do not make different scales look alike or unalike.
- Organizational Complexity Review — A recurring review that examines how governance layers, role count, decision rights, and meeting load are growing with the organization — and whether a restructure is due.
- Paired Half-Life Probe — Measures or estimates how long each component of a signal bundle remains salient, valid, or operationally influential.
- Peer Review — Brings the external judgment of domain peers to bear on someone's work, supplying an outside perspective the person cannot see from the inside — while guarding against slippage into status judgment.
- Policy Intensity Review — Routes a weakening policy return to a governance review that weighs burden, fairness, and protected duties, so a low margin triggers deliberation rather than an automatic cut.
- Portable Transfer Standard Comparison — Compares a fielded device or process against a portable reference standard without removing the fielded asset from its operating context.
- Post-Outcome Recalibration Review — A scheduled loop that ingests newly-resolved outcomes, re-fits the heuristic's confidence controls, and reassigns owned follow-up as the world drifts.
- Pressure Channel Audit — A systematic inventory of every route through which aligning is rewarded and diverging is punished, sorting each into informational versus normative pressure.
- Process Scalability Audit — Walks a specific workflow step by step to find the approvals, queues, exceptions, and handoffs that become intolerable as volume or variety rises — and lists the redesigns that would relieve them.
- Residual Tail Washout Check — Confirms that prior-condition residue has dissipated enough before a later condition is interpreted.
- Rolling Forecast Review — A scheduled and event-triggered ritual that re-forecasts where the target is heading and refreshes the scenario spread, so plans always ride current evidence rather than a fixed period boundary.
- Salience Overweighting Check — An audit that flags when a vivid near-miss has captured attention and response out of proportion to its calibrated value and proximity.
- Side-by-Side Target Delta Review — Places the intended target and the current approximation next to each other, dimension by dimension, so every consequential delta becomes visible and nameable.
- Skills Assessment — A formal, domain-scoped evaluation that scores actual performance against an explicit standard, producing the evidence a calibration loop compares self-assessment to.
- Tolerance-Band Gap Scoring — Scores each divergence against its acceptable-error band, separating harmless simplifications from out-of-tolerance gaps that actually need repair.
Causal Diagnosis¶
Solutions that distinguish symptoms from causes, compare explanations, localize a fault, or identify the intervention point responsible for an outcome.
6 mechanisms · View full solution family
- Autocorrelation and Whiteness Test — Checks whether residuals, read in order, are serially uncorrelated 'white noise'; leftover autocorrelation is evidence the model missed time- or sequence-dependent structure.
- Cause-Role Worksheet — Forces each proposed factor to earn its place by pinning it to the bounded outcome and assigning it one defensible causal role — or striking it.
- Cross-Disciplinary Causal Review — Convenes causal explanations from several disciplines or stakeholders on one outcome and fuses their partial accounts into a single weighted, uncertainty-marked synthesis.
- Cross-Validated Error-Slice Report — Breaks out-of-sample error down by data slice and ranks it, so the segments where the model is quietly worst — invisible in the headline metric — become explicit targets.
- Heteroscedasticity and Scale Test — Tests whether residual spread stays constant or grows with the fitted value or a predictor; scale-dependent variance means the model's error structure — not just its mean — is misspecified.
- Residual Root-Cause Review — A structured review that works a flagged residual pattern through candidate causes with domain experts and commits to one bounded, testable model change.
Classification & Taxonomy¶
Solutions that sort cases into meaningful classes, establish membership criteria, or organize concepts so distinctions can guide action.
12 mechanisms · View full solution family
- Appeals Case Review — A workflow for reconsidering an individual contested classification when the default criteria fail to represent the case, and for feeding recurring appeals back into the boundary.
- Boundary Critique Review — Interrogates a category boundary with structured critical questions about who is inside, outside, privileged, silenced, and externalized — surfacing the power and assumptions the line quietly encodes.
- Cascade Error Audit — Analyzes false positives, false negatives, delays, and reviewer disagreement by stage.
- Classification Disagreement Audit — Measures where classifications diverge — reviewer vs reviewer, human vs model — to expose systematic bias and human-model misalignment.
- Classification Fairness Review — Measures how a classification's errors — false inclusions and false exclusions — distribute across affected groups, exposing the burden and invisibility a formally neutral boundary can still produce.
- Coarse Screening Checklist — Gives human reviewers a short high-recall set of initial cues before deeper review.
- Inclusive-OR Membership Test — A per-element predicate that answers 'is this a member?' with yes the moment the element appears in at least one admissible source, without building the whole set.
- Ontology Audit — Checks whether a category and its boundary still cohere with the wider domain model of entities, relations, and contexts it is supposed to live inside.
- Similarity Dimension Rubric — Names the dimensions along which resemblance to the prototype is judged, sets their weights (which can shift by context), and fences off the dimensions that must never count.
- Taxonomy Review — Inspects the structure of a classification scheme — its levels, labels, sibling splits, and groupings — for the cross-cutting cases and unstable seams that a clean hierarchy quietly hides.
- Type Compatibility Checklist — A pre-union gate that checks each candidate source's elements are the same kind of thing, in the same universe, before it is allowed to contribute members.
- Union Delta Review — A version-over-version review of the union that separates genuine membership change from source outages, using provenance timestamps to explain every add and drop.
Communication & Signaling¶
Solutions that convey meaning, intent, state, or credibility across people or systems while accounting for interpretation, noise, and strategic response.
15 mechanisms · View full solution family
- Assumption Audit — Sweeps a whole plan or decision for the assumptions it silently rests on, keeps the load-bearing ones, tests their support, and names what would have to be true instead where support is thin.
- Binary Validity Test — Adjudicates whether a two-way choice is a genuine hard binary or a false dilemma — and, when the binary survives, records the real constraint that keeps the middle closed.
- Common Ground Checklist — Enumerates the background facts a message silently counts on, then checks each is actually shared with the audience before it goes out.
- Context-Condition Testing — Tests whether the conditions a convention requires before participation may count as acceptance are actually met here — and, when one fails, names the layer where the coupling breaks.
- Counter-Narrative Red Team — Challenges the story with alternative frames, stronger objections, and affected-group interpretations.
- Escalation Ladder Integrity Audit — Periodically checks that each rung of a severity or priority ladder still maps to a genuinely distinct level of seriousness, catching tier inflation before every case creeps to the top rung.
- Exhaustive Partition Audit — Treats the offered choices as a formal partition and tests whether the named cells, along their dividing axis, actually cover the whole option space with no gap between them.
- Implicature Audit — Examines a message for what it implies beyond the literal words — what's suggested by what's said, unsaid, emphasized, or softened — and flags the risky implications.
- Metaphor Drift, Harm, and Downstream-Decision Audit — Samples reuse reinterpretation translation policy incidents identity effects and outcomes to trigger revision or retirement.
- Narrative Ethics Review — Checks truthfulness, agency, disclosure, vulnerability, stigma, emotional coercion, and overgeneralization risk against explicit legitimacy boundaries.
- Projected-Entailment, Non-Mapping, and Causal-Overreach Audit — Derives every inference a mapping invites, grades each as supported, uncertain, generative, misleading, or prohibited against target evidence, and fences the source features and causal claims that must not transfer.
- Receiver Fatigue Survey — Asks receivers directly how worn-down and inattentive a signal stream has made them — capturing the subjective fatigue and trust erosion that behavioral metrics alone miss.
- Red-Team Missing-Alternatives Review — A structured adversarial pass in which a designated team attacks the claim that the option list is complete, surfaces the alternatives a hostile critic would name, and logs why each had been left off.
- Standing-Condition Preflight — Runs through scope, procedure, quorum, timing, and evidence before an act is treated as valid, catching accidental or premature constitution before the state goes live.
- Wording Test — A sender-side check that vets a question, notice, or clause before it goes out — asking whether every permitted response would concede the same buried premise, and returning a neutral rewrite when it does.
Comparison & Evaluation¶
Solutions that place alternatives, cases, or outcomes against shared criteria so differences become visible and judgments become defensible.
6 mechanisms · View full solution family
- Confusion Audit — Works backward from real mistakes — misclassifications, wrong substitutions, ambiguous reads — to find which distinctions are actually failing and route them for sharpening.
- Consistency Audit — Measures decisions already made across reviewers, units, and time to surface unexplained variation — treatment that shifted when only the decider or the date changed, not the case.
- Differential Diagnosis — Enumerates the plausible explanations for a case in hand and eliminates among them by the features that would distinguish one from another.
- Distributional Impact and Tail Audit — Compares benefit, burden, access, and error across parties and distribution tails.
- Equal-Treatment Checklist — A fixed set of questions a reviewer works through on every case — what treatment must stay invariant, what difference would justify departing, and what to record — so the same discipline lands on each decision as it is made.
- Relevant-Difference Challenge Test — Requires differential treatment to connect to purpose and survive proxy, counterexample, and necessity review.
Compression & Simplification¶
Solutions that reduce complexity, detail, or dimensionality while retaining the structure needed for the current decision or task.
12 mechanisms · View full solution family
- Approximation Validation — Checks that a simplified approximation still lands within the error tolerance the decision can absorb, by measuring it against an exact or higher-fidelity reference.
- Evidence Grade Rubric — A fixed set of criteria that rates how good the evidence behind a claim actually is — direct or indirect, replicated or single-source, current or stale — so a confidence level is earned against transparent rules instead of being asserted by tone.
- Forecast After-Action Review — After the forecasted future has arrived, scores what was predicted against what happened, records the error and its owner, and feeds the lesson back into how the next forecast is made.
- Lean Design Review — A structured review that asks whether a design has unnecessary features, steps, dependencies, interfaces, or documentation burden.
- Model Simplification Audit — Reviews a simplified model against its residuals and known validity limits to find where dropped variables or structure now bias its outputs, and couples each finding to a revision or escalation.
- Model Validation Ladder — Organizes validation as an ordered ladder of tests — from cheap sanity checks against the core model up through increasingly demanding empirical and edge-case trials — that a layer must climb before it is trusted.
- Omission Checklist — A standardized prompt sheet that forces reviewers to name what a simplification removed — the variables, cases, stakeholders, and steps dropped for simplicity — before anyone judges whether the loss matters.
- Quality Control Review — Inspects finished output against acceptance limits on a defined sampling plan, then accepts, rejects, or reworks — gating what leaves the process so out-of-tolerance results do not reach the customer.
- Rotating Tail Attention Cycle — Puts neglected low-volume categories on a scheduled rotation so each gets deliberate periodic attention, without the system permanently shifting focus off its main work.
- Scope Reduction Review — Examines whether proposed work packages, requirements, or deliverables exceed what the task requires.
- Simplification Review — The end-to-end workflow that takes a simplified artifact through preserved-function, relevance, and consequence checks and ends in a concrete disposition — keep it, caveat it, add an exception, or revise it.
- Stakeholder Review — Asks the people who actually use, operate, or are affected by a simplified artifact which omitted cases and constraints they consider important — surfacing losses invisible to its designers.
Constraints & Guardrails¶
Solutions that prevent unacceptable states or actions by encoding limits, invariants, preconditions, safe envelopes, or error-proofing rules.
44 mechanisms · View full solution family
- All-Conditions Checklist — Operationalizes the necessary-condition set as a checklist where every hard requirement must be satisfied or handled explicitly.
- Anti-Pattern Review — Checks the case against a catalog of the archetype's known look-alikes — situations that show the surface markers but carry a disqualifying feature — so a familiar-looking failure isn't mistaken for the pattern it mimics.
- Appeal and Rapid Restoration Workflow — Gives a wrongly-engaged legitimate party a fast, independent path to contest the action and have the harm reversed before it hardens into permanent loss.
- Appeal, Waiver, or Manual Access Channel — Gives an affected party a real route to contest, waive, or bypass a separable condition — and still reach essential access — while the tie is reviewed.
- Attribution Check — Prompts decision makers to separate current effect, original cause, actor intent, foreseeable harm, maintenance choices, and accountability claim.
- Back-Translation Review — Translates adapted content back into the source language to reveal meaning loss, added claims, altered obligations, or missing qualifications.
- Balanced Scorecard Review — Tracks multiple value dimensions together so one metric, such as speed, cost, growth, or efficiency, does not silently overwhelm other required values.
- Case Comparison Matrix — Arrays the case's features against the candidate archetype and its nearest neighbors in one grid, so where the case actually lines up — and where it doesn't — is visible at a glance.
- Coercion Safeguard Review — Tests whether an apparent acceptance is actually free — or is produced by dependence, scarce alternatives, authority pressure, or unacceptable loss on refusal.
- Contradiction Search Checklist — A diagnostic list of the standard forms impossibility takes, run against a supposition to find, name, and validate a genuine contradiction rather than a mere surprise.
- Cross-Cultural Copy Review — Reviews examples, metaphors, idioms, politeness cues, cultural references, and tone for target-community interpretation and access risk.
- Cue-Hijack Red-Team Review — Tasks an adversarial reviewer with actively finding ways a design could capture attention, appetite, fear, or reward-seeking beyond user intent, focusing on vulnerable slices.
- Design History Review — Examines design records, implementation decisions, roadmaps, and change logs to determine whether current use aligns with documented design intent.
- Differential Pattern Review — Holds the proposed archetype against its nearest rivals and asks which features would tell them apart, refusing the match until the evidence favors it over the alternatives.
- Ideal Comparator Filter — Catches comparators that have smuggled in perfection and quarantines them, so a real option is never rejected for failing to match something no one could have chosen.
- Intent Audit — Reviews records, incentives, choices, and communications for evidence that a function was deliberately pursued or knowingly maintained.
- Internationalization Check — Checks whether the underlying product or content system can support different scripts, text expansion, number/date formats, plural rules, sorting, and locale-specific conventions.
- Interpretation Recovery Review — Hands the record to someone who was not there and checks whether they can reconstruct its meaning without inventing the missing context.
- Language Accessibility Review — Checks whether target-language content is usable by intended audiences with different literacy levels, disabilities, education levels, or access channels.
- Legal Finality Review — A pre-signature review that tests exactly which rights, claims, and future options a legal instrument surrenders forever, routes high-finality ones to independent counsel, and records the basis for signing.
- Localization Review — Reviews a message, interface, form, policy, or document for target-language fit, nontransferable assumptions, and adaptation requirements before release.
- Member Check Session — Takes provisional interpretations back to the people who were studied and asks whether the account rings true from the inside.
- Multilingual UX Audit — Evaluates whether interface text, layout, forms, navigation, errors, help content, and accessibility affordances work across language contexts.
- Necessity/Proportionality Checklist — For each condition attached to access, forces a documented answer to whether it is truly necessary and whether a narrower or separable alternative would do — with a higher bar when the access is essential.
- Pattern Fit Checklist — Lists the structural features a named archetype requires and checks the case against them one by one, so a match must clear a fixed bar rather than a feeling of familiarity.
- Pattern Fit Scoring Rubric — Scores a candidate match on weighted fit criteria to produce a graded degree-of-fit, turning 'it kind of resembles X' into a defensible number with its reasoning attached.
- Peer Proof Review — A human referee scrutinizes a finished indirect proof for scope drift, hidden premises, and circularity, and records whether a direct or constructive proof would serve better.
- Post-Incident Autoimmune Review — Treats each confirmed false self-engagement as a coupled classifier-actuator design failure and feeds it back into thresholds, self-boundaries, and permissions.
- Post-Release After-Action Review — A structured backward-looking review held after a release completes — comparing what was predicted to what happened and converting the gap into a reusable lessons record.
- Post-Resolution Debrief — After the cycle closes, tests whether the resolution's value was actually earned by the preceding tension — and feeds that verdict into how future cycles are spaced.
- Preflight Review — Runs a time-sensitive all-condition check before a high-consequence action.
- Primitive Sufficiency Review — A structured test of whether the current primitive alphabet and grammar can express every distinction the work actually requires — before scarcity forces a one-off exception.
- Proof Assistant Script — Encodes an indirect proof as code checked by a trusted kernel, so every inference and the discharge are mechanically verified and each classical axiom is forced into the open.
- Rebundling Drift Audit — Periodically re-checks a decoupled bundle to catch conditions that have crept back through defaults, pricing, renewal friction, degraded alternatives, or quiet policy edits.
- Recusal and Conflict Screening — Checks each decision-maker for a personal stake in the matter before they act, and removes the conflicted one from the decision, so the enforcer is held to the same impartiality standard they impose on others.
- Red-Team Precondition Challenge — Challenges omitted, assumed, unverifiable, or falsely green preconditions before commitment.
- Root-Cause Explanation Review — Checks whether a causal explanation has collapsed into a purpose-like story without specifying the mechanism that produced the observed function.
- Self-Status Cross-Check — Before acting on a threat flag, independently corroborates whether the target is really protected self using signals disjoint from the classifier that raised the alarm.
- Shared-Burden Comparison Table — Forces every option onto the same dimensions under the same constraints, so none gets to be abstract and exempt from burdens the others carry.
- Supernormal Cue Audit — Systematically reviews a product, environment, or interface against a checklist of known cue channels, flagging any that exceed a natural or validated calibration range.
- Take-It-or-Leave-It Term Audit — Stress-tests a nonnegotiable package for whether 'leave it' is a real choice — probing the affected party's dependency, hidden add-ons, excessive waivers, and the absence of any exit.
- Termination & Totality Proof Review — Stress-tests a proposed procedure against two claims: that it halts for every input in scope, and that when it halts it returns one of the answers it is allowed to return.
- Vocabulary Drift Audit — A recurring review that checks whether shipped artifacts still obey the approved primitive grammar, or have quietly drifted back toward one-off forms.
- Weakest-Link Postmortem — Traces a failure to the absent or weakest necessary condition and updates the condition set.
Containment & Isolation¶
Solutions that keep faults, hazards, conflicts, contamination, or overload from spreading by separating regions, flows, or responsibilities.
23 mechanisms · View full solution family
- Administrative Burden Audit — Walks an existing entry process step by step from the applicant's side, itemizing every cost it imposes and flagging which ones do no protective work.
- Barrier Impact Statement — Forecasts, before a proposed entry requirement is adopted, whom it will keep out, whether it tracks the real qualification, and whether incumbents escape the same cost.
- Before–After–Elsewhere Evaluation — Measures the target outcome before and after at the intervention site and — the defining addition — at the places the hazard could have moved to, so a local win cannot pass as reduction until 'elsewhere' clears too.
- Below-Replacement Confirmation Test — Confirms the target's reproduction has fallen below replacement — telling durable decline apart from a suppression that will rebound the moment pressure lifts.
- Blanket Variable Quality Audit — Audits an established blanket for governance quality — that it collects no more than the minimal sufficient interface, and that the same interface holds across subgroups.
- Boundary Expansion Review — Deliberately widens the evaluation boundary until it contains the whole system that generates and receives the hazard, so a control cannot score a win by pushing the hazard just past where anyone is counting.
- Cross-Boundary After-Action Review — A structured retrospective over a campaign that spanned several authorities, deciding what to restore, when to exit, and how to respond if the source rebounds.
- Cross-Jurisdiction Incident Review — A recurring convening where separately-accountable jurisdictions pool their incident data, so a hazard that slips across the seam between them gets caught, owned, and made good instead of falling into the gap no one answers for.
- Exception Log Review — Periodically re-opens the standing log of granted exceptions and overrides to the containment rules, so bypasses that quietly became permanent leaks are re-decided, re-owned, or revoked.
- Hazard Analysis — Enumerates the hazards a control leaves behind — including the ones it displaces — and holds each residual against an explicit tolerance rather than against whatever the current design happens to achieve.
- Independent Appointment, Budget, and Tenure Test — Tests whether a reviewed actor can select, starve, dismiss, or cut off the reviewer meant to check it — the appointment, budget, tenure, and information levers that quietly make oversight dependent.
- Leakage Path Walkthrough — Walks the actual boundary of a container end to end, with the people who operate it, to name every path a constrained quantity can escape through — before any of them starts losing.
- Mass-Balance Audit — Reconciles what entered, what legitimately left, and what remains across a bounded control volume, attributing the unexplained gap to leakage.
- Mutual Oversight Effectiveness Audit — Compares each check's formal mandate against what actually happens — real access, capacity, timeliness, remedy completion, outcomes, and retaliation — to reveal which checks constrain and which only appear to.
- Post-Seal Displacement Check — After a leak is sealed, verifies that total loss actually fell rather than merely relocating to the next-easiest path.
- Power Concentration and Conflict Scan — Scores combinations of powers that let one actor authorize, conceal, review, or remedy its own action, ranking the concentration risks worth breaking up.
- Protected-Zone Exception Review — A governance review that adjudicates requests to act inside a protected sanctuary — guarding legitimate refuges from wrongful action while denying the source a place to hide behind 'protected' status.
- Rescue-Effect Audit — Periodically tests whether a sink's apparent health is genuine local recovery or merely a rescue effect — persistence borrowed from a source — by asking what it would do if the support were removed.
- Role Reclassification Review — A standing review that watches for role-change triggers and, on a set cadence, formally re-labels any unit whose source or sink status has shifted — so the classification the whole system trusts never silently goes stale.
- Sanctuary Reachability Audit — Checks, source by source, whether the controller can actually reach and lawfully act there — and separates a genuine refuge that must be spared from a blind spot the target is exploiting as cover.
- Side-Channel Scan — Systematically sweeps for covert, unintended paths through which the quantity bleeds out indirectly — the routes the boundary model never listed.
- Stigma Escalation Review — Checks whether a purity response has hardened into identity-marking, scapegoating, or disproportionate harm — and forces it back within bounds.
- Visual or Sensor Fouling Inspection — Reads the fouling state of the interface — by eye or sensor — and confirms whether a clean actually restored function.
Coordination & Synchronization¶
Solutions that align interdependent actors, tasks, clocks, states, or handoffs so joint work progresses without collision or drift.
40 mechanisms · View full solution family
- Adoption Analytics and Field Review — Combines usage data with field evidence about burden, workarounds, trust, outcomes, and unintended consequences.
- After-Action Coordination Review — Closes a coordination episode by extracting transferable lessons and transferring residual obligations, so the architecture improves and no commitment vanishes when the coalition disbands.
- After-Action Learning Cycle — A recurring, blame-free review that turns what actually happened into concrete revisions of the model and the next action.
- After-Action Reentry Review — A retrospective run after a reentry that harvests what the phase map, gates, and dependency assumptions got wrong and rewrites them into the recovery playbook for next time.
- After-Action Repertoire Review — A blame-free retrospective that asks, after each handled or mishandled event, whether the system had the right response available — turning recurring gaps into candidate new options and judging whether past additions actually worked.
- Appeal and Exception Protocol — A bounded route by which someone subject to a rule can contest how it was applied to them, or ask for a justified exception — without renegotiating the rule itself.
- Architecture Dependency Graph Review — Maps the artifact's actual module-and-dependency structure — what calls, imports, or depends on what — so its coupling can be read off and matched against the teams that own the pieces.
- Authority Envelope Review — Periodically re-examines whether each unit's delegated authority is still the right size, and widens, narrows, or revokes it on the evidence.
- Boundary Review Checklist — A checklist that audits who is included, excluded, pressured, silenced, scapegoated, or harmed by the current cohesion design.
- Bounded Context or Domain Boundary Review — Draws the boundaries the problem domain itself implies — where the language, rules, and models change — to define the architecture the artifact should have, independent of who currently builds it.
- Budget Variance Review — Compares planned against actual spending or revenue on a fixed cadence and routes each material variance to the owner who can reallocate, rescope, or retime — while keeping the money signal honest against gaming.
- Capture and Conflict Audit — A periodic investigation that checks whether an institution has quietly started serving narrow interests, and surfaces the role conflicts and conflicts of interest that let it happen.
- Communication Pattern Review — Reads the collective's real communication network — who actually coordinates with whom — from its meetings, messages, and handoffs, so the social topology can be compared against the architecture it will imprint.
- Consistency History Checker — Records the real interleaving of operations a system produced and mechanically checks whether that history is admissible under the claimed consistency model.
- Contribution Review Meeting — Creates a regular review of contribution patterns, blocked contributors, invisible work, uneven load, and recognition gaps.
- Coordination Health Review — A standing review that watches interface- and outcome-level health signals and re-tunes the coordination architecture before degradation hardens into failure.
- Corrective Action Review — After a corrective action has been taken, verifies that the deviation actually shrank and that no compensating failure appeared elsewhere — escalating when the fix did not hold.
- Coupling Review Ritual — A scheduled review that steps back from the running system to re-examine the whole dependency map and re-decide which couplings should now be tighter, looser, or mediated.
- Cross-Tier Learning Review — Gathers escalations, overrides, exceptions, and near-misses from across the tiers and turns the recurring ones into boundary, interface, and capacity redesigns — fixing the architecture rather than blaming the operator.
- Cycle-Time and Lag Retrospective — Reviews finished work by comparing predicted against actual durations, waits, and feedback lags, then feeds the gaps back to recalibrate the next cycle's temporal estimates and rules.
- Decision Latency Scorecard — Breaks a decision loop into sensing, analysis, approval, handoff, execution, and feedback stages and times each one, so the slowest stage stops hiding inside a single 'we're too slow'.
- Effect Review Checklist — Prompts designers or operators to ask what shared state an action can change beyond the declared interface.
- Equity Impact Assessment — An ex-ante test of a proposed policy, program, or design that estimates how its benefits and harms would fall across groups, measured against the alternative of not doing it.
- Handoff Readiness Check — A check that verifies whether a recurring handoff is complete, fresh, and timed for downstream use.
- Institutional Barrier Review — Inventories the barriers an institution's own design throws up — its hours, forms, staffing, eligibility rules, and accountability gaps — and pins each to the point where a rule could change.
- Integration Review — A periodic checkpoint where specialized streams bring their outputs together, are checked for fit, and have cross-stream conflicts and bottlenecks surfaced and reconciled before they compound.
- Loop Polarity Review — Checks whether link polarities and overall loop type have been assigned consistently and whether a balancing loop has been mistaken for a reinforcing loop or vice versa.
- Norm and Expectation Audit — Surfaces the gap between an institution's written rules and the expectations people actually hold — including where newcomers and insiders quietly operate by different norms.
- Peer Evaluation Process — Collects structured peer observations of contribution quality, reliability, collaboration, and support work, especially where supervisors cannot observe the work directly.
- Phase Margin or Dead-Time Test — Measures how much added delay a feedback loop can absorb before it turns unstable, converting 'is this loop safe?' into a quantified margin against oscillation.
- Platform Extension Review and Certification — A risk-tiered gate that combines automated evidence with human judgment to certify an extension safe and compatible enough to admit — with the depth of scrutiny scaled to the potential harm.
- Platform Team Bottleneck Test — Checks whether a shared platform or broker team has become the chokepoint every other team must queue behind, by comparing its throughput capacity against the coordination load routed through it.
- Post-Reorganization Architecture Impact Review — After an org change, traces which parts of the architecture now encode the old communication graph as debt, and maps the new external boundaries the change introduced.
- Pre-Refactor Operating-Model Check — Before an artifact refactor is greenlit, tests whether a real team could actually own and run each proposed new boundary — flagging any module no part of the organization can hold.
- Reentry Readiness Checklist — A local, self-administered list a single unit runs to confirm its own gate criteria are met before it asks to advance, with a waiver line for items it cannot meet but can safely compensate for.
- Role Compatibility Check — A pre-appointment screen that tests a proposed role assignment against the role's competence bar and against conflict and separation constraints, before the assignment is made.
- Role Review Retrospective — A recurring session that puts the role itself — not the person in it — on the table: is it still needed, still sane in scope, still bearable, and what should change?
- Safety Case Review — Examines whether technical controls, human practices, incentives, and governance together make the system acceptably safe.
- Silo Imprint Audit — Hunts the artifact for boundaries that fossilize an obsolete or accidental team silo rather than the domain, logging each imprint and the cross-boundary coupling that gives it away.
- Structural Audit — A systematic inspection of one organization's own rules, workflows, incentives, and resource flows to surface the arrangements that quietly generate harm.
Cost, Value & Pricing¶
Solutions that expose economic value, opportunity cost, price, return, or burden so choices reflect what is gained, spent, or displaced.
6 mechanisms · View full solution family
- Attention Budget Audit — Identifies what important work, learning, relationship, or risk monitoring is displaced by current demands on attention.
- Calendar Allocation Review — Makes the opportunity cost of meetings, deadlines, and recurring commitments visible in time and attention systems.
- Payback and Break-Even Cross-Check — Provides an interpretable secondary check for timing and reversal thresholds.
- Playbook Revision Cadence — A scheduled review that folds captured learning into the official playbook, pushes the update to everyone, and periodically asks whether to keep patching or redesign.
- Post-Auction Loss Review — Logs what you bid, whether you won, and how the asset actually performed across many contests, then reads the pattern of wins, losses, and regrets to reveal whether you are shading too little or too much.
- Yield and Defect Pareto Review — A recurring review that ranks defects and yield loss by the vital few, checking that cost gains are real quality-neutral savings and aiming improvement effort where the losses actually are.
Decomposition & Modularity¶
Solutions that split a difficult whole into coherent levels, modules, roles, or subproblems that can be understood and changed more independently.
16 mechanisms · View full solution family
- Batch Microstructure Audit — Pulls a representative sample from each production lot, quantifies its microstructure, and accepts or rejects the lot against a defect and arrangement spec.
- Bend Radius Check — A fast pass/fail check that every bend in a routed part stays at or above the minimum radius its material can take, below which it kinks, cracks, or delaminates.
- Comparator Set Audit — Interrogates who is in and out of the comparison set and why, hunting for opportunistically chosen peers, missing baselines, and self-serving inclusions — and records the membership decision for later challenge.
- Comparison Basis Checklist — A short intake gate that forces you to state the comparison's purpose, the frame that makes the items alike, the scope boundaries, and the dimensions you are choosing not to compare — before any scoring begins.
- Comparison Readout Annotation — Attaches to a finished comparison an explicit statement of what relation it actually supports — rank, dominance, trade-off, equivalence, or non-comparability — together with the uncertainty, scope limits, and uncompared dimensions, so the result cannot be over-read.
- Domain Invariant Review — A review with domain owners that tests whether proposed simplification preserves required distinctions and constraints.
- Essential-Accidental Complexity Audit — A structured review that classifies complexity sources as essential, accidental, mixed, or unresolved.
- Finite-Size Scaling Check — Tests whether an apparent power law or scaling signature persists across system sizes and observation windows, rather than being an artifact of one sample.
- Genre/Form Fit Checklist — Runs a form borrowed from another genre through a fixed list of fit questions to catch the assumptions it smuggled in from its home context.
- Hidden Shared-Substrate Audit — Searches for a common platform, infrastructure, market, or data layer both distant elements sit on, so an apparent nonlocal edge can be rediagnosed as shared exposure.
- Interface Surface Reduction Review — A review that trims exposed options, fields, APIs, or decision paths that do not correspond to essential problem distinctions.
- Intervention Echo Review — After a local action, traces what happened at the coupled remote element and checks it against what the coupling predicted — revalidating or retiring the edge.
- Pairwise Comparison Protocol — Judges items two at a time on one dimension at a time, in a controlled order, then aggregates the head-to-head verdicts into a ranking — trading the matrix's whole-grid view for sharper local discrimination.
- Post-Fold Integrity Inspection — After a fold or deployment, checks that the continuity the design promised actually survived — no crack, delamination, or broken connection where the curvature went.
- Residual Explanation Review — Reviews what the part-level account failed to explain and decides whether the residual is emergent, contextual, or a cue to escape reduction.
- Substance-over-Form Audit — Tests whether formal compliance still tracks substantive compliance, registering every place the form is technically valid but substantively hollow.
Decoupling & Interfaces¶
Solutions that reduce harmful dependency by inserting contracts, adapters, abstractions, or replaceable boundaries between interacting parts.
26 mechanisms · View full solution family
- Abstraction-Barrier Code Review — A code review read through a single lens — is anything here reaching past a component's public surface into its internals? — that sends reach-throughs back before the coupling hardens.
- Capacity Closure or Reversal Review — A workflow for reversing or constraining a capacity addition that causes systemic harm.
- Controlled Consolidation Gate — A checklist that permits mergers or aggregation only when boundary-cost savings outweigh lost diversity, resilience, and reversibility.
- Coupling-Efficiency Drift and Retuning Audit — Compares current useful transfer, rejected categories, stability, adapter health, and context with the approved operating envelope and triggers accountable action.
- Discourse Boundary Label Review — A review of labels such as radical, mainstream, taboo, settled, experimental, or out-of-bounds to see how they enforce or move the window.
- Displacement Impact Assessment — A pre-admission assessment estimating which incumbent uses will shrink when a new activity consumes shared substrate.
- Domain-Specific Trust Evidence and Exposure Matrix — Replaces one global trust label with a grid of specific behaviors crossed against separated trust dimensions, each cell carrying an evidence grade and its contrary evidence.
- Dual-Function Compatibility Test — Checks whether a feature can serve its new function without breaking its old one — and, when the two genuinely conflict, records the decision to split them.
- Feature Refunctioning Audit — A systematic sweep that finds features already being used for functions they weren't built for, draws a clear boundary around each, and grades how well the borrowed feature actually fits its new job.
- Independence Breach Review — A retrospective, case-specific investigation run by an independence officer into whether an affected party actually controlled, suppressed, or distorted a particular judgment — adjudicated and logged as precedent.
- Independent Reference, Claim, and Conflict Verification — Authenticates a trustee's claims by triangulating independent sources, weighting each by its provenance and manipulability, and hunting the conflicts and omissions the trustee would not volunteer.
- Interior-to-Edge Ratio Check — Measures the proportion of protected interior to exposed edge and tests it against a guardrail, flagging when a design has too much edge and too little core.
- Model Checker and Static Analyzer — Verifies that a model or program satisfies stated properties and pre/post-conditions by analysing its reachable states, returning a counterexample when it doesn't — proof over a bounded domain, not evidence from sample runs.
- Origin-Context Constraint Review — Reconstructs the context a feature was built for and catalogs the assumptions it silently carries, flagging the ones that will misfire once it serves its new function.
- Procurement Conformance Check — A transaction-level checklist that catches attempts to bypass procurement rules by splitting, relabeling, or subcontracting a purchase — and passes documented legitimate exceptions.
- Proof Checking — Independently re-verifies a decidability or impossibility proof step by step, so the boundary claim rests on a checked argument rather than on its author's authority.
- Reduction-Direction Checklist — A pre-flight check that a reduction runs from the known-hard problem into the target — the direction that actually proves hardness — with every assumption named before the verdict is trusted.
- Regulatory Boundary Review — Reviews a rule-regime difference for legality, intent, and harm before any regulatory mismatch is acted on — a guardrail with a veto, not a licence to exploit loopholes.
- Representation Leakage Probe — Hunts for behaviour clients can observe but the contract never promised — the accidental internals that quietly become an unofficial interface.
- Subsidy Dependency Assessment — Assesses how much of recipient performance depends on donor flow and which functions would fail without it.
- Target Granularity Review — A recurring review that asks whether the current number and scale of units still match the system’s purpose.
- Transfer Pricing Review — A forensic test of related-party prices against an arm's-length benchmark, pinpointing where internal prices move value out of the accountable context.
- Translation-Validation Harness — Instead of proving a translator correct once, it checks each individual translation after the fact — establishing that this output faithfully realizes this input against the source as oracle.
- Trust-Calibration and Dependency Audit — Looks back across a whole portfolio of reliance to compare each granted tier against its actual outcomes, monitoring cost, and how dangerously concentrated the dependence has become.
- User Appropriation Review — Examines how people have repurposed a feature on their own and turns that emergent, unsanctioned use into an explicit, consented, legitimate claim — or an informed refusal.
- Window Shift Retrospective — A post-shift review that asks what moved, what evidence mattered, who gained or lost voice, and whether the boundary should expand, contract, or stabilize next.
Deliberation & Conflict Resolution¶
Solutions that structure disagreement, negotiation, arbitration, or collective judgment so incompatible views can reach a workable resolution.
4 mechanisms · View full solution family
- Anchoring Bias Checklist — A checklist that prompts anchor identification, alternatives, and calibration questions.
- Calibrated Probability Elicitation — Elicits ranges, probabilities, or distributions while checking for overconfidence, incoherence, and calibration problems.
- Negotiation Anchor Review — A protocol for reviewing opening offers and strategic numbers before they define the negotiation range.
- Outsider Estimate Check — A procedure for obtaining an estimate or critique from someone not exposed to or invested in the original anchor.
Diversity & Exploration¶
Solutions that preserve variety, generate alternatives, widen the search space, or prevent premature convergence on one approach.
2 mechanisms · View full solution family
- Homogenization Pressure Audit — Surveys a converging system to map where homogenization pressure is collapsing variety and to name the dimensions of difference that actually matter, before a monoculture locks in.
- Two-Pass Evaluation — Evaluates in two ordered passes — a permissive first pass on potential and learning, then a strict second pass on cost and feasibility — so rough-but-promising ideas are not killed by the harshest filter first.
Emergence & Self-Organization¶
Solutions that shape local rules, interactions, or environmental cues so useful global order can arise without direct central specification.
23 mechanisms · View full solution family
- Adaptive Staffing Review — Periodically compares the formal role map against who is actually doing the work, and reallocates recognition and support where emergent responsibilities have appeared.
- Affordance Audit — Systematically inventories what an existing environment actually affords, to whom, and where its usable actions diverge from the intended ones.
- Autonomy/Dependency Review — An assessment that checks whether each holon has appropriate autonomy relative to its obligations and externalities.
- Belief-Update After-Action Review — Records what outside signal was encountered, whether the community represented it fairly, and what changed in its beliefs or practices.
- Blameless Postmortem — A post-incident review that deliberately holds off individual blame so the people closest to an error will describe what actually happened and why it made sense at the time.
- Caricature Detection Review — Checks whether the environment describes out-group or rival views in ways their informed holders would reject.
- Counterfactual Founder Intent Probe — Tests whether a claimed founder preference is a durable principle or a context-bound tactic, guarding against invented founder wishes.
- Counterfactual Origin and Omitted-Founder Probe — Tests how plausible alternative gates or omitted founders could have changed descendant composition, capabilities, and vulnerabilities.
- Distortion Review Cadence — Checks on a schedule whether amplification is quietly corrupting the pattern it was meant to spread — into imitation, metric-gaming, or hidden harm — and routes what it finds.
- External Grounding Check — A validation step that uses an independent anchor or higher-level authority to break circular self-validation.
- Founder Legacy Audit — Systematically surfaces and inventories the founder-originated influences still shaping the organization, so inherited legacy can be seen before anyone decides what to keep.
- Founding-Cohort Composition Audit — Compares founder composition, effective contribution, gate constraints, and source independence with a declared population or viability reference.
- Norm Drift Review — A recurring backward look that re-diagnoses what the group now treats as normal and flags where tolerated exceptions have quietly hardened into the new default.
- Peer Nomination and Validation — Asks the people who rely on a contributor to nominate and validate the role they are already performing, surfacing concerns about legitimacy and burden.
- Periodic Legacy Health Review — A recurring review that re-tests preserved and reinterpreted legacy elements over time, keeping institutional memory live against both fossilization and amnesia.
- Post-Bootstrap Artifact-Retirement Audit — After self-hosting is reached, checks off every bootstrap-only seed, cross-tool, and scaffold and confirms the running system depends on none of them.
- Responsibility Retrospective — A recurring reflection that asks which responsibilities have quietly appeared, overloaded someone, or should be retired.
- Rival Hypothesis Red Team — Assigns a team or role to identify missing evidence, out-of-sample cases, and alternative explanations.
- Seed-Artifact Signature Verification — Checks the starting seed's cryptographic signature and hash against a trusted reference before any stage is built on top of it.
- Self-Reference Audit — A structured review that identifies where rules, claims, models, categories, measurements, or systems refer to themselves.
- Source Diet Audit — Reviews what sources, channels, authorities, and evidence classes actually enter the environment over a defined period.
- Stage-Output Diff and Semantic-Equivalence Test — Diffs a stage's output against a reference and, when the bytes differ for benign reasons, decides whether the two are still the same program.
- Versioned Self-Modification Review — A review process that treats self-governing rule changes as version transitions subject to higher-integrity checks.
Error Prevention & Correction¶
Solutions that remove opportunities for mistakes, detect invalid states, repair deviations, or make failures easier to reverse.
4 mechanisms · View full solution family
- Boundary Escape Sampling — Spot-checks a random sample of items presumed unaffected by a change, re-deriving each, to estimate whether the scope boundary actually held.
- Cache Invalidation Review — Walks the store of previously-derived results after a change and rules, item by item, which are now stale and must be recomputed versus which may still be trusted.
- Independent Recomputation — Re-derives the same result by a deliberately different method and compares the two derivations, so a mistake in either path shows up as a disagreement.
- Infrastructure Condition Assessment — Sends an expert to rate a single physical asset against a standardized condition rubric, producing a defensible condition state, a repair priority, and an estimate of how much service life remains.
Evidence, Inference & Validation¶
Solutions that gather, test, triangulate, or qualify evidence so claims and decisions match what the observations can actually support.
102 mechanisms · View full solution family
Because this form-and-solution-family intersection contains more than 100 mechanisms, it is further divided by solution archetype.
Archetype overview
| Solution archetype | Mechanisms | Description |
|---|---|---|
| Aggregation Bias Detection and Correction | 1 | Protect decisions from misleading aggregate summaries by disaggregating the data, comparing subgroup and overall patterns, correcting composition effects, and restating only the claims the evidence can support. |
| Alternative-Hypothesis Generation | 2 | Before treating a conclusion as settled, generate credible alternative explanations and identify the evidence that would distinguish them. |
| Appearance vs. Reality Distinction Audit | 2 | Separate what is warranted by experience, perception, report, or instrumented appearance from what is being claimed about underlying or mind-independent reality. |
| Associative Transfer Warrant Audit | 6 | Do not let contact, co-membership, resemblance, endorsement, or proximity carry trust, blame, risk, quality, or credibility unless the link has a valid transfer warrant. |
| Assumption-Light Inference | 2 | Use inference methods that require fewer fragile assumptions when strong assumptions are unjustified. |
| Blinding and Expectancy Bias Reduction | 2 | Hide condition identity from the roles that could be biased by knowing it, while preserving safety, correct operation, and auditable exceptions. |
| Cascade Initiation Bias Diagnosis and Correction | 2 | Identify who set the cascade in motion, test whether they actually had better information, and re-expose the underlying evidence so later actors can decide independently. |
| Causal Mechanism Mapping | 2 | Map the mechanism connecting a proposed cause to an effect before intervening. |
| Comparative Benchmark Validation | 1 | Validate a claim by comparing the system against explicit reference standards, gold standards, incumbent alternatives, competitors, or benchmark suites under conditions that make the comparison meaningful. |
| Contrapositive Elimination Reasoning | 3 | Rule out a candidate by showing that a consequence it must produce is reliably absent. |
| Counterexample Search | 1 | Actively search for cases that would break a proposed rule, pattern, or generalization before treating it as reliable. |
| Counterfactual Comparison | 1 | Compare what happened with a plausible alternative to isolate causal effect or decision value. |
| Deductive Chain Validation | 5 | Validate that conclusions actually follow from stated rules and premises before acting on them. |
| Distributional-Assumption Governance | 1 | Make probability-distribution commitments explicit, evidence-grounded, consequence-aware, stress-tested, and revisable before they govern inference or action. |
| Effort-Based Vs. Inherent Ability Attribution | 2 | Interpret success and failure through controllable effort, strategy, practice, evidence quality, and luck/noise before treating the outcome as proof of inherent ability. |
| Emic-Etic Dual-Account Interpretation | 2 | Preserve insider and outsider descriptions as separately governed accounts, then use their mismatch as evidence instead of forcing premature translation into one frame. |
| Evidentiary Trace Warranting | 3 | Treat evidence as a defeasible relation between a trace and a claim, not as raw data or free-floating support. |
| Generalization Validation | 1 | Test whether a pattern learned from specific cases works on new cases outside the original fit. |
| Hypothesis Testing Frame | 5 | Frame a claim against a default alternative so evidence can change belief or action under explicit error risks. |
| Independent Convergence Evidence Appraisal | 3 | Treat repeated independent arrival at the same solution-shape as evidence of fit only after auditing independence, shared pressures, abstraction level, and alternative explanations for the convergence. |
| Independent Evidence Triangulation | 2 | Cross-check a scoped claim with multiple meaningfully independent evidence streams, using both convergence and divergence to calibrate confidence and expose hidden dependence, bias, or context. |
| Informal Fallacy Diagnosis and Repair | 4 | Repair arguments that can look formally valid but fail because their premises, context, relevance, or category moves are defective. |
| Information Set Specification and Completeness Verification | 1 | Do not ask whether a price or signal is simply “efficient”; specify the information set it should reflect, then test whether available information and residual opportunities show complete incorporation. |
| Knowledge-Warrant Audit | 4 | Audit what each belief rests on, classify the strength and type of its warrant, and adjust confidence or action accordingly. |
| Longitudinal Follow-Up Validation | 1 | Treat validation as a time-extended claim by checking whether outcomes, harms, and operating assumptions still hold after deployment and accumulated exposure. |
| Metanarrative Coherence and Internal Consistency Check | 4 | Turn a sweeping story into an auditable claim structure, then test whether its claims, exceptions, evidence links, and implied conclusions can all hold together. |
| Minimal-Disclosure Verification | 1 | Make a verifier confident that a bounded claim is true without handing over the underlying witness, record, identity attributes, or computation trace. |
| Missingness-Aware Estimator Selection | 2 | Choose the missing-data estimator only after stating why values are absent and what assumption makes the target estimand recoverable. |
| Null Finding Warrant Calibration | 2 | Treat a failure to find something as evidence of absence only after calibrating whether the search would probably have detected it if it were present. |
| Parallel Independent Inspection Design | 6 | Find more hidden defects by having multiple independent and diverse inspectors examine overlapping parts of the same artifact before their findings are reconciled. |
| Pattern Detection with Validation | 3 | Detect recurring patterns while guarding against seeing patterns that are not really there. |
| Propositional Mode Governance | 2 | Keep propositions in the right epistemic mode and permit only the operations that mode licenses. |
| Recursive Triangulation of Triangulation | 1 | When a conclusion already rests on triangulation, audit the triangulation itself by checking whether its evidence streams are independent, its convergence logic is valid, and its confidence claim survives a second-order triangulation layer. |
| Regression-to-the-Mean Guardrail | 2 | Prevent ordinary reversion after extreme observations from being credited to an intervention, person, punishment, reward, or event without a credible counterfactual. |
| Representative Sampling Design | 1 | Select observations so the sample can credibly stand in for the population or system being judged. |
| Shared-Source Variance Isolation | 1 | Prevent a single hidden source from making multiple supposedly independent dimensions look more correlated than they really are. |
| Source Distortion Modeling | 2 | Treat a report from a systematically distorted source as a biased channel to be modeled, not as either transparent truth or useless noise. |
| Source Provenance Triangulation | 4 | Evaluate an account by tracing source type, origin, proximity, perspective, corroboration, and confidence before treating its claims as settled. |
| Theory-Responsive Case Sampling Design | 2 | Select the next case because it can sharpen, challenge, extend, or saturate the emerging account—not because it statistically represents a population. |
| Use-Time Source Attribution Calibration | 6 | Before using a commingled memory, note, claim, trace, or generated output, classify where it came from and how certain that attribution is. |
| User Context Validation | 2 | Validate a solution against actual user behavior, needs, constraints, and context of use. |
| Warranted Belief Formation | 2 | Turn a proposition into a responsible belief only after clarifying its meaning, warrant, confidence, scope, action consequences, and conditions for revision. |
Aggregation Bias Detection and Correction¶
Protect decisions from misleading aggregate summaries by disaggregating the data, comparing subgroup and overall patterns, correcting composition effects, and restating only the claims the evidence can support.
1 mechanism · View full solution archetype
- Representativeness and Nonresponse Review — Checks whether differential participation or missingness has skewed the aggregate away from the population it claims to describe, and bounds the claim accordingly.
Alternative-Hypothesis Generation¶
Before treating a conclusion as settled, generate credible alternative explanations and identify the evidence that would distinguish them.
2 mechanisms · View full solution archetype
- Counter-Narrative Probe — Builds the single strongest opposing account of the same facts — the version a sharp skeptic would defend — derives what it predicts we should see, and checks, so the leading story has to beat a real challenger instead of a strawman.
- Red-Team Rival Explanation Review — A structured review in which an assigned adversary must generate and defend rival explanations against the group's favored conclusion, and the team must answer them on the record before confidence is allowed to settle.
Appearance vs. Reality Distinction Audit¶
Separate what is warranted by experience, perception, report, or instrumented appearance from what is being claimed about underlying or mind-independent reality.
2 mechanisms · View full solution archetype
- Appearance/Reality Audit Checklist — Prompts reviewers to ask whether a statement describes experience, measurement, inference, social convention, or mind-independent reality.
- Claim Tagging Matrix — Lists claims in rows and tags each by source, claim type, warrant level, bridge assumptions, and calibrated wording.
Associative Transfer Warrant Audit¶
Do not let contact, co-membership, resemblance, endorsement, or proximity carry trust, blame, risk, quality, or credibility unless the link has a valid transfer warrant.
6 mechanisms · View full solution archetype
- Associative Claim Red Team — Challenges a proposed property transfer by asking what would have to be true for the association to be warrant-bearing and what evidence would refute it.
- Category-Membership Attribution Audit — Tests whether a property has been attributed to an individual or item merely because it belongs to a category, class, cluster, or population.
- Contact/Contagion Warrant Test — Distinguishes actual transmission or shared exposure from symbolic contact, mere proximity, or imagined contamination — and bounds any real channel by distance and decay.
- Endorsement Scope Checklist — Determines whether association with a person, brand, institution, funder, publisher, or platform is an endorsement, a neutral conduit, or an irrelevant co-location — and scopes what a real endorsement covers.
- Guilt-by-Association Review — Checks whether blame, risk, or disqualification is being assigned because of contact, affiliation, or co-membership without a valid transfer rule.
- Trust Transitivity Breakpoint Review — Identifies where trust, reputation, or certification stops transferring across a dependency or intermediary chain and renewed verification is required.
Assumption-Light Inference¶
Use inference methods that require fewer fragile assumptions when strong assumptions are unjustified.
2 mechanisms · View full solution archetype
- Assumption Audit Checklist — Enumerates the assumptions a planned inference rests on and flags which ones would change the conclusion if they failed — before any test is run.
- Diagnostic Plot Review — Reads fitted-data graphics to see whether a method's distributional and scale assumptions actually hold, catching violations a summary statistic hides.
Blinding and Expectancy Bias Reduction¶
Hide condition identity from the roles that could be biased by knowing it, while preserving safety, correct operation, and auditable exceptions.
2 mechanisms · View full solution archetype
- Blind Integrity Questionnaire — A questionnaire that asks masked roles what condition they believe they encountered and why.
- Blinded Outcome Adjudication — A procedure in which evaluators judge outcomes from evidence packets that omit condition or source identity.
Cascade Initiation Bias Diagnosis and Correction¶
Identify who set the cascade in motion, test whether they actually had better information, and re-expose the underlying evidence so later actors can decide independently.
2 mechanisms · View full solution archetype
- Common Source Citation Check — Traces repeated citations backward until they collapse to their origin, revealing how many endorsements share a single source.
- Evidence Provenance Checklist — A checklist for classifying whether cited reasons are primary, secondary, independent, current, relevant, and verified.
Causal Mechanism Mapping¶
Map the mechanism connecting a proposed cause to an effect before intervening.
2 mechanisms · View full solution archetype
- Causal Inference Review — Audits the identification assumptions, comparison groups, confounders, and evidence behind a causal claim before it is accepted.
- Contribution Analysis — Builds a plausible contribution story — assembling evidence and weighing other influences — when a clean control or randomized comparison is unavailable.
Comparative Benchmark Validation¶
Validate a claim by comparing the system against explicit reference standards, gold standards, incumbent alternatives, competitors, or benchmark suites under conditions that make the comparison meaningful.
1 mechanism · View full solution archetype
- Expert-Adjudicated Reference Panel — Convenes independent domain experts to adjudicate a defensible reference answer for each case — the ground truth a candidate is scored against — resolving rater disagreement by structured deliberation instead of trusting a single fallible authority.
Contrapositive Elimination Reasoning¶
Rule out a candidate by showing that a consequence it must produce is reliably absent.
3 mechanisms · View full solution archetype
- Eligibility Element Exclusion Review — Rules an applicant ineligible by showing that one mandatory element of a conjunctive requirement is absent — while fixing the exact program and period the exclusion binds and the waivers that could defeat it.
- Negative-Evidence Reliability Review — Scrutinizes a claimed absence before it is allowed to eliminate anything — asking whether the missing footprint could actually have been detected, whether the right place was searched, and whether the absence is strong enough to count.
- Requirements Traceability Exclusion — Rules out the claim that a requirement is satisfied when its mandatory downstream trace — the test or evidence it must link to — is missing, scoped to a specific build or baseline.
Counterexample Search¶
Actively search for cases that would break a proposed rule, pattern, or generalization before treating it as reliable.
1 mechanism · View full solution archetype
- Exception Search — Hunts the histories, subgroups, and edge conditions where a rule is most likely to have already broken, and captures the violating cases it finds.
Counterfactual Comparison¶
Compare what happened with a plausible alternative to isolate causal effect or decision value.
1 mechanism · View full solution archetype
- Counterfactual History Review — Uses historically plausible alternatives to test whether an outcome depended on a decision, constraint, accident, or structural condition without treating imaginative speculation as proof.
Deductive Chain Validation¶
Validate that conclusions actually follow from stated rules and premises before acting on them.
5 mechanisms · View full solution archetype
- Diagnostic Logic Check — Checks whether a case actually meets the stated classification criteria and labels the evidential uncertainty that remains, so a criteria-based label is not mistaken for certainty.
- Legal Syllogism Review — Verifies the material facts, hunts for exceptions and defenses, and bounds the holding of a legal argument so the conclusion is no broader than the proven facts and surviving rule support.
- Logic Checklist — Runs a fixed set of prompts over any argument — hidden premises, equivocal terms, invalid steps — so common reasoning faults are caught by routine rather than by luck.
- Policy Eligibility Review — Traces an approval or denial back to the exact governing policy and the verified case facts, so an eligibility conclusion follows from the rule rather than from discretion.
- Requirements Traceability Check — Links a 'complete', 'safe', or 'compliant' claim down to the specific requirements, assumptions, and tests that ground it, flagging every link that rests on an unverified assumption.
Distributional-Assumption Governance¶
Make probability-distribution commitments explicit, evidence-grounded, consequence-aware, stress-tested, and revisable before they govern inference or action.
1 mechanism · View full solution archetype
- Support, Shape, and Tail Diagnostic Suite — Assembles plots, quantile comparisons, boundary checks, and tail summaries into one profile of a distribution's support, shape, and tails — with no single view allowed to decide.
Effort-Based Vs. Inherent Ability Attribution¶
Interpret success and failure through controllable effort, strategy, practice, evidence quality, and luck/noise before treating the outcome as proof of inherent ability.
2 mechanisms · View full solution archetype
- After-Action Learning Review — A structured group retrospective that maps the causes of a completed effort across the whole team and feeds the lessons forward through a mentor channel.
- Success Debrief Luck–Skill Separator — Splits a win into repeatable skill versus luck and noise, so a single good outcome does not inflate confidence past what the evidence supports.
Emic-Etic Dual-Account Interpretation¶
Preserve insider and outsider descriptions as separately governed accounts, then use their mismatch as evidence instead of forcing premature translation into one frame.
2 mechanisms · View full solution archetype
- Dual Codebook Audit — A periodic conformance check on two separately maintained codebooks — one emic, one etic — that verifies their closure rules stayed distinct and no local category was quietly laundered into an analytic one.
- Member Checking Session — A working session that takes draft interpretations back to the very participants who supplied the data, so they can confirm, correct, or contest whether the analyst's reading still means what they meant.
Evidentiary Trace Warranting¶
Treat evidence as a defeasible relation between a trace and a claim, not as raw data or free-floating support.
3 mechanisms · View full solution archetype
- Evidence Strength Ladder — Labels evidence strength while preserving scope, uncertainty, and defeasibility.
- Evidence Update Review — Revisits evidence relations when sources, context, measurement, or rival explanations change.
- Relevance and Alternative Explanation Check — Tests whether a trace actually discriminates among hypotheses or is also expected under alternatives.
Generalization Validation¶
Test whether a pattern learned from specific cases works on new cases outside the original fit.
1 mechanism · View full solution archetype
- External Validity Check — Compares the conditions that produced a pattern against the conditions where it is meant to be used, and turns each mismatch into a scoped boundary or a demand for fresh evidence.
Hypothesis Testing Frame¶
Frame a claim against a default alternative so evidence can change belief or action under explicit error risks.
5 mechanisms · View full solution archetype
- A/B Test Interpretation Protocol — Reads a live randomized experiment against a pre-declared primary metric and launch criteria, turning the measured difference into a ship, hold, or iterate decision.
- Equivalence or Noninferiority Test — Implements a variant where the goal is to show sufficiently small difference or no unacceptable loss rather than superiority.
- Inspection Pass/Fail Test — Applies predefined criteria to classify an item, process, or condition as acceptable or unacceptable.
- Null Hypothesis Significance Test — Implements a default-versus-alternative comparison with a formal statistical threshold under specified assumptions.
- Quality Acceptance Test — Uses predefined acceptance criteria to decide whether a product, batch, process, or deliverable meets a required standard.
Independent Convergence Evidence Appraisal¶
Treat repeated independent arrival at the same solution-shape as evidence of fit only after auditing independence, shared pressures, abstraction level, and alternative explanations for the convergence.
3 mechanisms · View full solution archetype
- Blind Pattern Comparison Round — Has independent judges rate whether candidate solution-shapes truly match, with lineage identities and the convergence claim masked, so the similarity score is not manufactured by expectation.
- Common-Cause and Copying Audit — Runs a fixed checklist of shared sources, incentives, regulations, vendors, and social proof to see whether any of them explains the repeated solution better than independent fit.
- Pressure–Solution Fit Rubric — Scores, case by case, how well the specific solution-shape answers the specific pressure — the mechanism story that says why this form solves this problem.
Independent Evidence Triangulation¶
Cross-check a scoped claim with multiple meaningfully independent evidence streams, using both convergence and divergence to calibrate confidence and expose hidden dependence, bias, or context.
2 mechanisms · View full solution archetype
- Blinded Parallel Analysis — Has multiple analysts evaluate the same claim behind an information barrier and reveal results only after each commits, so that later agreement counts as corroboration rather than echo.
- Convergence–Divergence Rubric — A precommitted rating scale that classifies how a set of streams relate — full agreement, partial compatibility, material conflict, or unresolved divergence — before the favored result is known.
Informal Fallacy Diagnosis and Repair¶
Repair arguments that can look formally valid but fail because their premises, context, relevance, or category moves are defective.
4 mechanisms · View full solution archetype
- Burden Shift Detection — Catches when the obligation to prove quietly moves from the claimant to the critic, so 'you can't disprove it' stops passing as evidence.
- Category Boundary Stability Check — Holds a key term or category to one fixed meaning across the whole argument, catching definitions that drift to dodge counterexamples.
- Feasible Alternative Comparison — Scores a real option against the best achievable alternative instead of an idealized one, exposing rejections driven by the nirvana fallacy.
- Premise Relevance & Acceptability Test — Screens each premise for whether it is acceptable in its own right and actually relevant to the conclusion it is offered to support.
Information Set Specification and Completeness Verification¶
Do not ask whether a price or signal is simply “efficient”; specify the information set it should reflect, then test whether available information and residual opportunities show complete incorporation.
1 mechanism · View full solution archetype
- Event-Study Information-Response Test — Tests whether a price or signal reacts to a defined information event within the expected window.
Knowledge-Warrant Audit¶
Audit what each belief rests on, classify the strength and type of its warrant, and adjust confidence or action accordingly.
4 mechanisms · View full solution archetype
- Claim-Confidence Warrant Review — A structured check that asks whether the confidence attached to each claim is justified by its warrant strength and stakes.
- Source-Independence Cross-Check — A check that distinguishes genuinely independent support from repeated citations of the same underlying source or model.
- Update-Trigger Checkpoint — A scheduled or event-based checkpoint that reopens a belief when pre-defined evidence, contradictions, or expiry conditions appear.
- Warrant-Decay Review — A recurring check for beliefs whose supporting evidence is stale, context-dependent, or vulnerable to drift.
Longitudinal Follow-Up Validation¶
Treat validation as a time-extended claim by checking whether outcomes, harms, and operating assumptions still hold after deployment and accumulated exposure.
1 mechanism · View full solution archetype
- Scheduled Revalidation Review — A calendar-forced governance checkpoint that re-reads the original validation claim against accumulated evidence and issues a recertify, restrict, or retire decision at a hard gate.
Metanarrative Coherence and Internal Consistency Check¶
Turn a sweeping story into an auditable claim structure, then test whether its claims, exceptions, evidence links, and implied conclusions can all hold together.
4 mechanisms · View full solution archetype
- Contradiction Scan — Applies explicit consistency criteria pairwise across the narrative's claims to flag genuine incompatibilities — X asserted here, not-X implied there — and records each as a logged tension rather than a passing impression.
- Red-Team Coherence Review — Convenes an adversarial reviewer whose job is to break the narrative's coherence from the outside — overreaching its own scope, reading it as a hostile stakeholder would, and pitting rival accounts against it — surfacing incoherences insiders have stopped seeing.
- Revision Diff Review — Compares successive versions of a narrative against the repair each revision was supposed to make, catching the edit that renamed a contradiction, quietly absorbed a counterexample, or reworded a tension instead of resolving it.
- Term-Stability Review — Pins each load-bearing term to a single definition and tracks it through the whole narrative, flagging the passages where a word quietly changes meaning to keep an argument alive — semantic drift used to dodge a contradiction.
Minimal-Disclosure Verification¶
Make a verifier confident that a bounded claim is true without handing over the underlying witness, record, identity attributes, or computation trace.
1 mechanism · View full solution archetype
- Anonymous Membership Proof — Proves that the prover belongs to an authorized set without identifying which member they are.
Missingness-Aware Estimator Selection¶
Choose the missing-data estimator only after stating why values are absent and what assumption makes the target estimand recoverable.
2 mechanisms · View full solution archetype
- MCAR Diagnostic Test and Balance Review — Compares complete and incomplete cases and uses MCAR-oriented tests where appropriate while treating non-rejection as limited evidence rather than proof.
- Process-Based Missingness Audit — Uses field knowledge, collection logs, device records, administrative rules, or interview protocols to infer why data became absent.
Null Finding Warrant Calibration¶
Treat a failure to find something as evidence of absence only after calibrating whether the search would probably have detected it if it were present.
2 mechanisms · View full solution archetype
- Coverage Map and Blind-Spot Review — Maps searched and unsearched regions so absence claims stay within evidence boundaries.
- Detection Power Checklist — Prompts reviewers to check scope, timing, sensitivity, thresholds, masking, and failure modes before interpreting non-detection.
Parallel Independent Inspection Design¶
Find more hidden defects by having multiple independent and diverse inspectors examine overlapping parts of the same artifact before their findings are reconciled.
6 mechanisms · View full solution archetype
- Blind Document Proofing Passes — Splits a locked document among proofers who each hunt one class of defect blind, so no single reader's fatigue or reading-for-meaning hides a whole category of error.
- Dual or Triple Diagnostic Read — Has a fixed few equally qualified readers each inspect the whole artifact blind, then routes every disagreement to a designated arbiter.
- Independent Checklist Variant Rounds — Runs the same artifact through different checklist variants across rotated rounds so reviewers don't all walk the same mental path into the same blind spot.
- Independent Security Review Lenses — Inspects one system through several specialist lenses at once — threat, dependency, configuration, access — so different classes of flaw are found by the reviewer trained to see them.
- Multi-Inspector Manufacturing Sort — Routes critical production units through more than one technician with risk-weighted overlap, pulling and re-verifying nonconformities and feeding field escapes back.
- Parallel Code Review Round — Multiple maintainers independently review the same version-locked change before comments are merged, so a bug one reviewer misses another can still catch.
Pattern Detection with Validation¶
Detect recurring patterns while guarding against seeing patterns that are not really there.
3 mechanisms · View full solution archetype
- Diagnostic Pattern Checklist — A structured list that forces a suspected signature to be named precisely, weighed against how common it is, and set beside the look-alikes that would explain the same cues — before the label is allowed to stick.
- Multiple-Testing Review — Audits how many patterns were searched before one looked meaningful, then raises the evidence bar to match the size of that search — while watching that the correction does not go so far it buries the real effects.
- Trend Validation Review — A recurring review that stops an apparent upward or downward movement from becoming a trend story until it has been checked against ordinary seasonal variation, against changes in how the data was collected, and against whether it holds up in later observations.
Propositional Mode Governance¶
Keep propositions in the right epistemic mode and permit only the operations that mode licenses.
2 mechanisms · View full solution archetype
- Epistemic Mode Linter — A tool or review pass that flags mode mismatches, such as treating an assumption as a verified fact or citing a conjecture as settled evidence.
- Premise Discharge Checklist — A checklist that ensures temporary premises or proof assumptions are either discharged, scoped, or explicitly carried into the conclusion.
Recursive Triangulation of Triangulation¶
When a conclusion already rests on triangulation, audit the triangulation itself by checking whether its evidence streams are independent, its convergence logic is valid, and its confidence claim survives a second-order triangulation layer.
1 mechanism · View full solution archetype
- Method Provenance Review — Traces backward how each method, source, and interpretation entered the triangulation so circular or copied lineage cannot masquerade as independent corroboration.
Regression-to-the-Mean Guardrail¶
Prevent ordinary reversion after extreme observations from being credited to an intervention, person, punishment, reward, or event without a credible counterfactual.
2 mechanisms · View full solution archetype
- Attribution-Claim Review Gate — A sign-off gate that refuses to approve a causal success or failure claim until selection, counterfactual, expected-reversion, uncertainty, subgroup, and persistence evidence are all on the table.
- Extreme-Selection Risk Flag — Marks an evaluation as triggered by extreme selection, so its before-after story is treated as regression-suspect before any effect is credited.
Representative Sampling Design¶
Select observations so the sample can credibly stand in for the population or system being judged.
1 mechanism · View full solution archetype
- Audit Sample — Selects records from a transaction universe by risk-weighted probability so findings support a bounded assurance opinion, with a documented trail any reviewer can re-walk.
Shared-Source Variance Isolation¶
Prevent a single hidden source from making multiple supposedly independent dimensions look more correlated than they really are.
1 mechanism · View full solution archetype
- Source Variance Audit Matrix — Lays the output dimensions against every shared source in a grid so that each place a common source touches more than one dimension is written down before any correlation is trusted.
Source Distortion Modeling¶
Treat a report from a systematically distorted source as a biased channel to be modeled, not as either transparent truth or useless noise.
2 mechanisms · View full solution archetype
- Motive-Opportunity-Bias Analysis — Checks whether a proposed distortion pattern is plausible given the source's incentives, opportunity, and known bias profile.
- Narrator Reliability Matrix — Scores or describes reliability by claim type, evidence base, motive, vantage, consistency, and corroboration.
Source Provenance Triangulation¶
Evaluate an account by tracing source type, origin, proximity, perspective, corroboration, and confidence before treating its claims as settled.
4 mechanisms · View full solution archetype
- Audit Trail Review — Inspects logs, version histories, document histories, custody records, or system traces to identify edits, gaps, and handling anomalies.
- Citation Lineage Review — Traces a claim through references and derivative accounts to determine whether sources are independent or reproducing the same origin.
- Source Criticism Protocol — Uses structured questions about authorship, purpose, audience, context, proximity, and transmission to evaluate a source before accepting its claims.
- Witness / Source Comparison — Compares firsthand accounts or records by role, access, incentive, timing, memory risk, and corroboration against non-testimonial evidence.
Theory-Responsive Case Sampling Design¶
Select the next case because it can sharpen, challenge, extend, or saturate the emerging account—not because it statistically represents a population.
2 mechanisms · View full solution archetype
- Saturation Review Memo — Documents whether newly sampled cases have stopped changing the model, and convenes the decision to stop.
- Transferability Claim Check — Audits the final claims against what the sampled cases can actually support, trimming overreach.
Use-Time Source Attribution Calibration¶
Before using a commingled memory, note, claim, trace, or generated output, classify where it came from and how certain that attribution is.
6 mechanisms · View full solution archetype
- Borrowed Idea Attribution Scan — Sweeps a shared store of notes and ideas for material that arrived from someone else but now feels self-generated, and routes each item back to the source that deserves the credit.
- Chain-of-Custody or Lineage Check — Reconstructs an item's unbroken trail back to its origin — every handoff and transformation logged beside the content — so its source class is established rather than assumed when it is used.
- Provenance Lookup Before Publication — A last-gate check that, claim by claim, traces a draft back to where each piece actually came from and credits anything borrowed before it goes public.
- Reality Monitoring Checklist — A short cue-by-cue checklist run at the moment of recall to decide whether an item was actually perceived from the world or generated inside your own head.
- Source Attribution Confidence Rubric — A graded scale that scores how sure you are of an item's source — separately from whether the content is true — and trips a corroboration gate when the grade is low and the stakes are high.
- Source Confusion Matrix Review — A retrospective review that tabulates which source classes get mistaken for which — reading the off-diagonal cells to find systematic, directional misattributions and feed the fixes back.
User Context Validation¶
Validate a solution against actual user behavior, needs, constraints, and context of use.
2 mechanisms · View full solution archetype
- Accessibility Review — Checks the solution against inclusion standards and the full range of sensory, cognitive, physical, and linguistic abilities, so no user is excluded by an assumption the design never examined.
- Analytics Behavior Review — Reads the whole population's behavioral traces — abandonment, errors, retention, search — to test a design assumption at scale and to check whether narrower evidence actually generalizes.
Warranted Belief Formation¶
Turn a proposition into a responsible belief only after clarifying its meaning, warrant, confidence, scope, action consequences, and conditions for revision.
2 mechanisms · View full solution archetype
- Belief Adoption Checklist — A run-once pass/fail gate that blocks a claim from becoming an action-guiding belief until proposition, warrant, confidence, scope, action implication, and a revision trigger are all in hand.
- Claim-Warrant Matrix — A side-by-side grid that puts many competing claims on rows and their evidence, source quality, and counter-evidence on columns, so warrant can be compared across rivals before any one is believed.
Feedback & Regulation¶
Solutions that sense the effects of action and use the result to stabilize, steer, damp, amplify, or otherwise regulate subsequent behavior.
19 mechanisms · View full solution family
- Action-Effect Feedback Review — A recurring review that attributes what an action did and did not change, updating the actor's read on what is now within their control.
- Activation Outcome Calibration — Reviews activations, over-activations, missed events, and handoffs after the fact to move the threshold and currency dials — tuning the gate from outcomes instead of leaving its setpoints frozen at their first guess.
- Appeal or Review Process — A governed, independent route for someone hit by a forward decision to have it reconsidered by a reviewer who didn't make the original call — run within a bounded caseload and time budget so the path back stays real.
- Baseline Validation Review — A scheduled governance review that decides — before a baseline is reused to set the next round of targets, quotas, or alerts — whether it still describes the world well enough to keep, and records the verdict.
- Blind Review — Withholds identity, reputation, and prior scores at the point of evaluation so a judgment forms before the expectation can steer it.
- Budget Variance Correction Cycle — A periodic governance review that compares actual spending and revenue against an approved plan, judges whether the variance is material, and orders corrective decisions when it is.
- Controllability Mapping Checklist — Sorts a situation into controllable, influenceable, constrained, and uncontrollable parts before any action is chosen.
- Desire Path Walkthrough — Traverse the designed route and the worn-in one side by side, on site, to make the official path explicit and mark exactly where lived use departs from it.
- Expectation Audit — Traces where an expectation, label, or score enters a process and maps the behavior channels through which it may be quietly manufacturing its own confirmation.
- Expectation Calibration Review — Compares what was predicted against what actually happened while controlling for the treatment the prediction itself caused, separating warranted forecasts from prophecies.
- Organizational Review — Periodically examines an organization's own routines, metrics, norms, commitments, and outcomes to revise how it operates.
- Policy Assumption Audit — Re-examines the behavioral and environmental assumptions a standing rule or policy was built on, and narrows or pauses the rule when the world it assumed no longer holds.
- Postmortem Review — Uses a failure, incident, near miss, or major outcome as evidence for revising future behavior and safeguards.
- Prediction Impact Audit — Checks whether a risk score, forecast, or warning label is changing how a system treats its subjects in ways that help bring about the very outcome it predicts.
- Re-Entry Red-Team Review — Before a misleading signal is released, an independent reviewer war-games every way it could loop back through friendly systems and hardens the containment until those paths are closed.
- Safety and Accessibility Review — Tests a candidate accommodation against the non-negotiables — safety, accessibility, dignity, privacy, environment — before anyone decides to pave, reroute, or block the revealed path.
- Self-Assessment Tool — Helps an actor compare its own performance, process, or state against criteria before external judgment or final outcome.
- Teacher / Manager Expectation Check — Prompts an authority figure to compare their own expectations against how they actually distribute attention, challenge, and feedback — and to change the interaction where the two diverge.
- Team Retrospective — Creates a recurring space for a team to inspect its own work process, coordination patterns, and improvement commitments.
Flow & Routing¶
Solutions that direct material, information, demand, work, or traffic through paths and stages to improve movement and avoid congestion.
8 mechanisms · View full solution family
- Address or Endpoint Validation — Checks each endpoint's identity, location, eligibility, connectivity, and access prerequisites before anything is dispatched, so effort is only spent on endpoints that can actually be served.
- Appeal Process — Gives an affected party a defined route to move a contested decision up to a higher review tier empowered to affirm, reverse, or remand it.
- Compliance Signoff — Certifies on the record that legal, regulatory, safety, or policy criteria have been met — with a named signer and any deviations logged — before work is allowed to proceed.
- Educational Mastery Assessment — Requires a learner to demonstrate prerequisite competence, not seat-time, before advancing — and routes those who fall short into targeted remediation rather than forward.
- Fairness Audit by Stratum — Checks whether differential treatment is producing intended fit without unacceptable disparate harm, exclusion, or hidden under-service.
- Path-Trace Audit — Reconstructs a completed walk from its recorded log to see which boundaries it touched and whether its path was actually governed — or merely lucky.
- Release Readiness Review — Aggregates readiness evidence across tests, monitoring, rollback, security, and support before a release, permitting a staged or conditional rollout rather than an all-or-nothing ship.
- Walk-Budget Review — Periodically checks how much of the exploration budget the wandering has burned and rules on whether continued drift is still buying enough discovery to justify its cost.
Governance & Accountability¶
Solutions that allocate decision rights, oversight, responsibility, transparency, and consequences so power remains answerable and action-owned.
40 mechanisms · View full solution family
- After-Action Proportionality Review — Reviews whether the response produced intended safety, fairness, deterrence, repair, or learning without excessive collateral burden.
- Answerability Review Meeting — Creates a recurring or event-triggered forum where owners explain decisions, reviewers test reasoning, and repair commitments are assigned.
- Appeal and Dispute Process — Gives a participant hit by a suspension, delisting, or access denial a real channel to contest it before a reviewer who didn't make the original call — with a path back if it was wrong.
- Appeal and Reconsideration Workflow — A defined route for an affected party to contest a discretionary decision and have it independently re-examined — with a good-faith safe harbor that shields sound judgment from being punished for an unlucky outcome.
- Appeal and Waiver Process — Corrects misclassification, evidence error, and disproportionate application through an independent review path.
- Appeals Process — A structured procedure for challenging a decision and seeking reconsideration or correction.
- Architecture Dependency Review — A gate placed before migrations, launches, and deprecations that forces the technical, data, and operational dependencies a proposed change would touch into the open before the change ships.
- Audit and Enforcement Workflow — The adjudication engine that collects evidence, tests whether the condition is truly met and the consequence warranted, applies it consistently, and records the review so decisions can be checked.
- Authority Boundary Review — Periodically compares actual decision delays, conflicts, overrides, exceptions, and outcome quality against the current rights map, and fires a revision where the two have drifted apart.
- Calibration Review Cycle — A recurring session where several decision-makers judge shared cases, compare results, and reconcile divergence — keeping their reading of the criteria aligned so like cases stay treated alike.
- Compliance Review — A structured check against governing standards, policies, laws, controls, or risk requirements.
- Conflict-of-Interest Disclosure Review — A procedure that requires decision participants to disclose their outside interests, then checks the disclosures for undisclosed or asymmetric conflicts before a decision proceeds.
- Contract and SLA Review — Reads the contracts and service-level agreements behind external providers to expose what is actually guaranteed, what happens on breach, and how little recourse the fine print really leaves.
- Counterfactual Control Test — Asks whether an agent actually had a feasible, foreseeable alternative that would likely have changed the outcome — the line between real control and mere presence at a result driven by luck.
- Disciplinary Board Review — Determines whether conduct violated a standard and what proportionate response or repair should follow.
- Entrenchment Audit — Tests, after a handover, whether authority actually moved — probing for the shadow signals that show the old holder still runs the role in everything but name.
- Ethics Checklist — Prompts reviewers to ask value, harm, consent, fairness, transparency, and responsibility questions. It implements the archetype only when answers are recorded and contestable.
- Evidence Sufficiency Rubric — Grades whether a body of evidence is strong, diverse, and relevant enough that the chain of 'but what backs that?' can stop — calibrated to the evidentiary regress specifically.
- Execution Handoff Checklist — Confirms a closed decision reaches an accountable executor with resources, a start condition, first actions, dependencies, and communication in place.
- Independent Project Audit — Puts a live commitment in front of reviewers with no stake in the original bet, to test its assumptions, remaining value, and sunk-cost reasoning from the outside — diagnosing, not deciding.
- Independent Review — A review conducted by an actor not controlled by the decision-maker or operating unit under review.
- Least-Restrictive Alternative Screen — Requires reviewers to consider whether a less restrictive but still effective response would achieve the same purpose.
- Metric Value Review — Examines what a metric rewards, ignores, normalizes, or sacrifices, especially when the metric is treated as objective evidence of success.
- Moderation Appeal — A platform-specific workflow for challenging content, account, or community enforcement decisions.
- Moderation Appeal Process — Reviews contested platform enforcement decisions using evidence, rules, reasons, and remedy options.
- Needs Assessment Rubric — Structures how decision-makers assess need, barrier severity, available supports, and relation to the preserved standard.
- Nonpunitive Workaround Review — A facilitated, protected review that reconstructs a recurrent deviation with the practitioners who use it and the parties who bear its consequences, assigning an owner and a route to contest.
- Omission–Commission Parity Check — Holds a duty-bound failure to act to the same standard as a visible action, so blame doesn't fall only on whoever did something.
- Permission–Entitlement Crosswalk — Maps technical permissions against substantive entitlements to catch capabilities with no claim behind them and claims the system cannot actually execute.
- Post-Decision Conflict Audit — Risk-based retrospective testing of past decisions — disclosures, access, communications, and outcomes — to catch undisclosed conflicts, control failures, and institutional patterns after the fact, and to trigger remedy.
- Post-Investment Review — Runs after a committed effort ends or pauses, converting the time and money already spent into reusable lessons and a dignified way to have stopped.
- Remedy Traceability Review — Follows a breach from detection through notice, review, state-change, and restoration to confirm the remedy can actually change the outcome — not just explain it.
- Representation and Access Audit — Tests whose memory is visible, who can contribute and encounter it, which barriers persist, and which harms or distortions have emerged.
- Responsibility Diffusion Check — Tests whether 'the system,' 'the team,' or 'the process' has been used to dissolve responsibility until no agent or duty remains answerable — and forces an explicit partition back.
- Reversibility and Exit Check — Classifies reversal costs, locates points of no return, and confirms a rollback path and the emergency authority that can invoke it before commitment.
- Sampled Exception Consistency Audit — A retrospective, sampled review that pulls materially comparable decided exceptions — including adverse ones — and tests whether like cases were treated alike, reasons held up, scope was proportionate, and access was equitable across subgroups.
- Scapegoat Screening Review — Checks whether a salient, low-power, or last-in-chain actor is absorbing more blame than their actual contribution and the available evidence support.
- Transparency Impact Review — Periodically asks whether all the disclosure is actually producing accountability, and at what burden, rather than just accumulating published volume.
- Value Audit — Reviews a policy, model, metric, or process to identify hidden value priorities, displaced alternatives, affected parties, and unsupported legitimacy claims.
- Workaround Failure-Mode and Effects Review — A structured review of how a workaround and each proposed disposition can fail locally and downstream, classifying the effects and specifying the compensating controls that catch them.
Identity, Reference & Matching¶
Solutions that establish what an entity is, bind records to the right referent, resolve names, or match cases without confusing near-equivalents.
19 mechanisms · View full solution family
- Absence-Evidence Calibration Test — Rates how informative a non-detection actually is — by asking how likely the channel would have seen the entity if it were there — so a weak-coverage silence can't be read as strong evidence of absence, and only a genuinely informative absence is allowed to trigger retirement.
- Binding Error Audit — Reviews completed bindings after the fact against their rationale records to find false merges and false splits and feed the corrections back.
- Capacity-Fit Matrix — Matches a proposed occupant against a site's capacity and constraints before anyone is placed, so mismatches are caught on paper rather than in place.
- Case Similarity Rubric — A fixed, weighted scoring sheet that grades how well one candidate exemplar fits the new case and flags the mismatches that should veto reuse regardless of the score.
- Certificate Chain Validation — Establishes that a certificate's key really belongs to the named subject by walking the signed chain from leaf to a trusted root, enforcing each hop's validity, scope, and revocation, and returning a graded verdict.
- Chain-of-Custody Evidence Review — Authenticates an artifact by reconstructing its unbroken, documented custody trail — proving the thing in hand is the same one collected at origin, handled intact and untampered.
- Challenge-Response Authentication — Proves a claimant holds a secret by having them compute the correct answer to a fresh, unpredictable challenge — so possession is demonstrated without the secret crossing the wire, and a captured exchange can't be replayed.
- Collision Detection Review — Scans existing bindings for identifiers that point at the same entity twice — or one identifier stretched across two entities — and routes each conflict to a steward for a merge-or-split decision.
- Consent and Autonomy Review — Checks whether recipients can understand the persuasive intent, reject the appeal, and retain meaningful choice.
- Credential Verification Workflow — Runs an asserted eligibility or identity claim through a defined sequence of primary-source evidence checks — with a staffed exception lane for the cases the rules can't settle — before a protected offer or access is granted.
- Digital Signature Verification — Confirms that a specific message was signed by the holder of a given key and hasn't changed since — binding content to its signer's key, with tamper-evidence built in, while deliberately leaving key-to-identity trust to a separate step.
- Expert Case Recall Checklist — Forces an expert's tacit 'this reminds me of a case' into an explicit, auditable comparison — which case, why it's close, and where the resemblance breaks.
- Formal Decidability Probe — For a question handed to an automated or formal decider, tests whether it actually admits a terminating decision procedure — or whether the promised verdict is impossible.
- Identity and Unity Test Checklist — A fixed set of same-as, part-whole, persistence, and edge-case questions a reviewer must answer before an entity model is accepted.
- Identity Continuity Review — A periodic judgment that tests an entity's accumulated changes — not just the latest one, but the whole drift — against an explicit persistence criterion, and returns a verdict on whether it is still the same entity.
- Provenance Chain Review — Authenticates an artifact by tracing its origin and every handoff — accepting it only when the lineage back to a trusted source is complete and unbroken.
- Site Audit Walkthrough — A periodic on-the-ground pass that reconciles the site records against physical reality and resolves every discrepancy it finds.
- Stereotype / Tokenism Red Team — Reviews whether the identity appeal relies on caricature, mascot examples, demographic essentialism, or borrowed legitimacy.
- Value-Language Alignment Rubric — Checks whether wording, examples, metaphors, and calls to action fit the audience's own value vocabulary without distortion.
Integration & Composition¶
Solutions that assemble parts into a functioning whole, reconcile interfaces, and verify that combined behavior preserves required properties.
2 mechanisms · View full solution family
- Legal Clause Composition Review — A structured read of an assembled legal instrument for the effect its clauses, definitions, and provisos produce together — catching scope leakage and emergent meaning no single clause signals.
- Supplier or Model Homologation — Formally certifies an alternate supplier, model, material, or procedure as role-equivalent under specified conditions, on the record, with an accountable owner and a re-approval trigger.
Knowledge, Memory & Provenance¶
Solutions that capture, retain, retrieve, transfer, and trace knowledge or records so later users can recover both content and origin.
33 mechanisms · View full solution family
- Abstract–Full-Text Alignment Review — Walks an abstract claim by claim back into the full text, demanding a specific supporting passage for each — and flags the findings the abstract quietly leaves out.
- Audience Knowledge-State Walkthrough — Steps a stand-in reader through the presentation one beat at a time, recording what they now know, infer, and misunderstand, to catch where reveal order misleads.
- Category Language Audit — Reviews labels, reports, forms, dashboards, and interfaces for wording that turns classifications into essences or facts beyond their warrant.
- Certainty & Causality Inflation Check — Catches the summary that upgrades the substance's certainty or causality — a hedge hardened into a fact, an association reported as a cause, a subgroup generalized to everyone.
- Checksum or Hash Validation — Detects unintended alteration, transmission error, or corruption by comparing a freshly computed hash against a trusted reference value.
- Condition Assessment Survey — Systematically scores the condition of a whole population to diagnose how it is decaying and rank which objects get scarce treatment first.
- Counterexample Case Review — Uses cases that contradict the abstraction to test whether the abstraction should be revised, limited, or retired.
- Credibility Audit — Reviews whose testimony is believed, discounted, overburdened, or treated as merely anecdotal across meetings, datasets, reviews, investigations, or decision records.
- Debrief Annotation Replay — Replays an event while tagging each step with its source, confidence, and interpretation limits — so the debrief consolidates a defensible causal sequence instead of a confident but distorted story.
- Digital Fixity Check and Repair — Verifies each stored digital object against a saved cryptographic baseline and repairs any corruption from a known-good copy.
- Expert Compression Red Team — Has a second reader adversarially hunt the expert's draft for compressed reasoning, skipped steps, and unstated assumptions the author can no longer see.
- Headline–Body Consistency Check — Isolates the single claim a headline asserts and tests whether the body actually supports it — at that scope, tense, and force — before it goes out.
- Inclusive Taxonomy Review — Examines whether categories, labels, eligibility classes, problem definitions, or model features erase important lived distinctions or embed dominant-group assumptions.
- Legacy Health Review Cadence — A recurring checkpoint that re-examines each integrated legacy element to confirm it still earns its place — or has quietly turned into drag to retire.
- Map–Territory Review Checklist — Prompts reviewers to ask where the abstraction diverges from the substrate, when direct observation should override it, and which uses exceed its scope.
- Member Checking Validation — Returns synthesized findings to participants or represented groups so they can correct misinterpretation, missing nuance, or unauthorized generalization.
- Multi-Resolution Change-Point and Trend Comparison — Compares persistence and candidate breaks across windows, scales, measures, locations, and groups to see which change claims survive a change of resolution.
- Narrative Focal-Actor Audit — Compares how much of the record an actor occupies against how much causal evidence actually supports them, surfacing archive and commemoration bias and the contributors the record erased.
- Novice Walkthrough — Walks the material step by step in the shoes of a first-time recipient, probing at each step whether a novice would know what to do next and whether they had succeeded.
- Plain-Language with Precision Review — Rewrites expert prose to a recipient-appropriate reading level while a subject expert guards each edit against stripping out the precision or uncertainty the recipient needs to act.
- Plural Causal Synthesis Review — Holds several competing causal models open at once, restates the scoped target, and publishes a bounded, versioned synthesis that separates causal contribution from praise and blame.
- Policy Language Review — Checks whether high-stakes rule language still carries its intended meaning for the people it governs, and sets how much divergence triggers action.
- Post-Transition Legacy, Loss, and Regime Audit — Compares promised and realized continuity, rupture, harms, benefits, preserved functions, recovery, and affected-party experience after a transition.
- Press-Release Claim Review — Reads a promotional summary — a press release or announcement — against the study or report it publicizes, grading each headline claim as supported, overstated, or unsupported with the author's incentive to amplify held in view.
- Qualifier-Drop Scan — Inventories the hedges, scope limits, and conditions in the substance that fix when a claim is true, then flags the material ones the summary silently dropped.
- Re-grounding Review Cadence — Puts an abstraction on a scheduled requalification clock, forcing a periodic decision to recalibrate, demote, or retire it whenever the substrate, context, or use has drifted since it was last grounded.
- Safety and Consent Screening Protocol — Screens the target, the person, and the setting before any reactivation, gating the intervention behind confirmed consent, safety, and a stopping plan so a malleable pattern is never opened where it could harm.
- Stakeholder Interpretation Check — Asks named user groups what a term means to them, surfacing interpretive divergence that text analysis alone would miss.
- Summary-Diff Review — Reviews the change between two versions of a summary, so an edit that quietly flips a modal verb or drops a not is caught at the diff rather than after it ships.
- Teach-Back Protocol — Asks the recipient to explain the idea or plan back in their own words, so a gap between what was delivered and what was understood surfaces — and, in high-stakes settings, is recorded — before anyone acts on it.
- Terminology Audit — Cross-checks a term's official definition against a sampled snapshot of how it is actually used, and classifies the shape of any drift.
- Timeline Disclosure Diff — Compares two revisions of an account to flag edits that quietly changed what happened, what caused what, or when it was known.
- Turning-Point Opportunity Analysis — Tests whether a narrow option window or an inherited path made one decision unusually consequential, and how quickly the window opened and closed.
Learning & Scaffolding¶
Solutions that sequence practice, feedback, examples, and support so capability grows and transfers beyond the original learning setting.
27 mechanisms · View full solution family
- Blend Coherence Review — A critical read-through that hunts a candidate blend for internal contradictions, unsupported transfers, hidden assumptions, and imported risks before it ships.
- Boundary Condition Checklist — Enumerates the conditions under which the source knowledge applies as-is, must be adapted, or must be dropped — a standing gate that stops a good practice from being carried where it no longer holds.
- Confidence Rating Rubric — Converts felt certainty into a graduated, evidence-anchored scale, so confidence is reported against what the evidence actually supports — and a low rung mandates more checks before commitment.
- Consequence Design Review — Reviews proposed rewards, penalties, feedback, recognition, and natural consequences for alignment, proportionality, timing, fairness, and side effects.
- Decision-Process Review — Examines how one decision was reasoned — assumptions, alternatives, evidence, confidence — and grades the process quality separately from how the outcome happened to turn out.
- Design Discovery Task — A pre-solution investigation that forces a team to surface and suspend its assumptions about users, gather evidence about real needs, and reframe the problem before anyone designs an answer.
- Disconfirming Evidence Search — Deliberately hunts for the observation that would break the leading completion, turning verification into an attempt to falsify rather than confirm.
- Field Investigation — Situated evidence-gathering — observation, measurement, and interviews taken at the real site — paired with a discipline for judging which of those findings are trustworthy enough to build on.
- Hallucination Check — A review pass over generated or inferred content that flags every unsupported detail and verifies each nontrivial claim against a real source before it is trusted.
- Low-Stakes Quiz — Elicits a quick, ungraded read of current understanding across the material, timed early enough that the result can still change what happens next.
- Mastery Quiz — Samples prerequisite understanding with a short, low-stakes, freely retakeable check learners clear before moving to the next unit.
- Misconception Probe — Uses questions engineered so that each wrong answer reveals a specific misconception, turning a response directly into a named diagnosis rather than a score.
- Mixed Diagnostic Quiz — A delayed, unannounced-category assessment that requires classification or method selection in mixed order, to measure whether discrimination survives outside the block.
- Multiple Demonstration Format — Lets learners prove the same capability through different evidence formats, holding the standard constant while the demonstration varies.
- Portfolio Mastery Review — Judges mastery from an accumulated body of work when a single test cannot carry the evidence.
- Portfolio Review — Certifies competence by appraising a curated body of real accumulated work, guarding against curation that hides weak areas.
- Post-Training Recall Check — A delayed sample of recall after instruction, onboarding, or a policy rollout.
- Practice Review — Reviews recorded practice attempts after the fact to pinpoint the error or strategy flaw and prescribe the specific next drill to fix it, before it matters in competition.
- Prerequisite Test — Verifies the specific earlier capability a dependent task requires before admitting the learner into it — an entry ticket keyed to the dependency map.
- Readiness Review — Aggregates heterogeneous endpoint evidence into a single go / no-go release gate, scoped to who will rely on the launch.
- Reasoning Retrospective — After an effort is complete, reconstructs how the reasoning actually unfolded to decide what future strategy should change — guarding against tidy, outcome-driven hindsight.
- Relapse Trigger Review — Reviews the episodes where the old response came back to find which cue, context, or substitution failure was responsible — turning each recurrence into a targeted repair.
- Rubric Review — A structured scoring instrument that turns an outcome standard into observable performance levels so different raters reach the same judgment.
- Standardized Credentialing Exam — Certifies a comparable, portable credential at scale using a psychometrically validated exam with a standard-set cut score and fairness controls.
- Strategy Checklist — A fixed menu of failure-mode checks and candidate reasoning moves you scan when stuck, turning a vague sense that thinking has stalled into a concrete next adjustment.
- Structured Review Sequence — Splits a group review into ordered phases — orient, review evidence, interpret, challenge, synthesize, decide — so complex judgment cannot collapse into immediate advocacy.
- Transfer Debrief — After a real transfer attempt, compares what was expected to carry with what actually happened in the target, and feeds the difference back to revise the scaffold for next time.
Lifecycle & Maintenance¶
Solutions that manage creation, operation, upkeep, renewal, retirement, and accumulated burden across the useful life of an artifact or system.
5 mechanisms · View full solution family
- Allocation Rule Audit — Checks how burdens shared across co-products, recycled material, and multi-output processes are split between them, and whether that split is defensible and consistently applied.
- Environmental Product Declaration Review — Vets a third-party-verified environmental product declaration for trust and, above all, comparability — because two EPDs mean nothing side by side unless they rest on the same rules.
- Health Checkup Schedule — Applies recurring screening or condition review to people, teams, assets, or systems where early intervention can prevent larger harm.
- Policy Review Cycle — Revisits rules, procedures, or governance documents on a regular cadence so they do not drift out of fit with reality.
- Scanning Review Forum — A recurring cross-functional meeting where captured signals are interpreted together, filtered from noise, and dispositioned — escalated, deferred, or retired — so scattered observations become one shared, owned picture.
Mapping & Transformation¶
Solutions that translate between representations, coordinate systems, scales, formats, or states while preserving the relationships that matter.
54 mechanisms · View full solution family
- Adjacency-Matrix Preservation Test — Checks that pairs which are neighbors in the source stay neighbors on the substrate by differencing the two adjacency matrices directly — reporting the exact pairs the map tore apart or falsely joined, not just a score.
- Alternate-View and Section Validation — Checks a perspective view against independent plans, sections, models, or photographs, resolving every contradiction between them or disclosing it.
- Asymmetry Dimension Scorecard — Rates a relation's imbalance dimension by dimension — control, information, exit, exposure — so a vague 'they hold the power' becomes a scored, side-by-side profile.
- Asymmetry Sunset Review — A scheduled re-examination that forces every standing asymmetry to re-earn its warrant or be retired — closing the door on 'temporary' differences that quietly became permanent.
- Atlas Stewardship Review — The recurring governance pass that keeps an atlas from decaying as local domains drift, charts go stale, and owners change.
- Audit Log Review — Replays an append-only event history to reconstruct how two records drifted apart, classifying the cause so the correct prior state can be restored and the leak sealed.
- Basin Arrival Review — A post-crossing check that confirms the system actually settled into the intended basin — and did not merely dip through or drift into a different attractor.
- Chain-of-Custody Cross-Check — Compares process-imprint attribution against explicit provenance or custody evidence without conflating them.
- Chemical & Isotopic Signature Test — Uses material composition or isotopic ratios as an origin-imprint evidence channel.
- Common-Cause Dependency Audit — Challenges the independence the redundancy math assumes by hunting the shared upstream driver that would fail several 'separate' barriers in the same instant.
- Commutative Diagram Review — Draws the two composition paths — transform-then-map and map-then-transform — as a diagram whose closure is the equivariance claim, surfaced before a line of code is written.
- Conserved Quantity Audit — Enumerates the quantities a system should keep constant and checks — before and after a transformation — that each one actually stays put, flagging any invariant the reformulation quietly broke.
- Context Sampling Audit — Samples real usage across relevant communities, channels, documents, and situations to reveal which meanings are actually active and where transfer risk lives.
- Coordinate-Frame Consistency Check — Verifies that when the reference frame moves, geometric outputs transform by the same rigid motion — so a pose or velocity means the same thing in every frame.
- Cross-Scale Impact Review — A checklist-style review that takes a proposed action and asks, at the level above and the level below the target, whether it quietly shifts burden onto them.
- Custody Chain Reconciliation — Reconstructs an unbroken sequence of who held an item when, confirming each handoff refers to the same sealed object and assigning any gap to an accountable owner.
- Dependency Constraint Check — A design-time procedure that tests an artifact's dependency edges against architectural rules — no cycles, no forbidden cross-boundary or lower-tier edges — and prescribes fixes for edges that already violate them.
- Duplicate Target Scan — A scan that detects target values assigned to multiple distinct sources.
- False Symmetry Review — A standing review that hunts for rules which treat unequal sides identically, and tests whether that even-handedness quietly loads the cost onto the weaker side.
- Geodesic or Path-Distance Audit — Checks whether points that look close on a flat map or embedding are actually close along the paths that respect the terrain.
- Graph Schema Validation — A conformance check that judges whether the nodes and edges of a graph satisfy a declared schema of allowed labels, edge types, directions, and structural rules.
- HAZOP Joint-Deviation Review — Walks a multidisciplinary panel through guide-word deviations taken in combination, surfacing the joint deviations a single-parameter review would miss and owning the residual-risk call.
- Identity Preservation Checklist — Screens a proposed change against the attributes that define the work — content, structure, function, authorship, interpretation, obligations — to catch, before it ships, whether identity survives or a new work has begun.
- Inventory Reconciliation — Periodically counts physical stock against the book record and resolves the difference, so shrinkage, miscount, and unrecorded movement surface as a measured, explained adjustment rather than a silent drift.
- Ledger Reconciliation Workflow — Matches an internal ledger against an external statement transaction by transaction, explaining every gap as a reconciling item until the two balances tie out.
- Map Difference and Integrity Check — Diffs two snapshots of a context's map to prove that switching away and back left it uncorrupted — and that no other context's activity leaked in.
- Map Fold and Collision Scan — Sweeps a finished map for the two categorical ways locality breaks — folds where the ordering reverses and collisions where distinct source items share one cell — and logs each to a register.
- Model Checking and Reachability Analysis — Exhaustively explores a system's reachable states to prove the hazard state can never be reached — or returns the exact sequence that reaches it.
- Multi-Level Model Check — Re-runs a modeled relationship at each level — individual, group, organization, region, system — to find where it holds, transforms, or reverses, and bounds the level at which it can be trusted.
- Neighborhood Preservation Probe — Checks whether an embedding or projection keeps each point's true near-neighbors near, rather than inventing false ones at folds.
- Occlusion and Silhouette Check — Verifies that front-to-back order, intersections, and object-identifying silhouettes in the view match the real depth relations of the scene.
- Organizational Path Preservation Review — Maps a reorganization's informal social pathways — communication, escalation, expert-consultation, decision — as real topology and scopes which of them must be treated as load-bearing, so a cleaner org chart does not quietly sever the routes that actually carried the work.
- Orphan Target Scan — A scan that detects target members with no source member mapped to them under the intended bijection.
- Periodic Coverage Recertification — On a fixed cadence, re-proves from scratch that every required target still has a valid witness — with an independent sign-off — so coverage that quietly decayed since last time is caught before it is assumed.
- Periodic Relation Granularity Review — A scheduled recurring review that re-examines whether the current class granularity still fits, catching slow drift and holding open the path to revert a change that aged badly.
- Phase Portrait Comparison — Draws the trajectory portraits of a system before and after a transformation side by side, confirming the flow's qualitative shape — fixed points, orbits, separatrices — survives the change of variables.
- Poisson-Bracket Identity Test — Certifies a proposed change of variables is canonical by evaluating the fundamental Poisson brackets of the new coordinates and checking they come out to the canonical values.
- Post-Installation Site Response Review — Returns to the finished work in place, over time, to check whether it actually responds to the site as intended — and documents what the site is really doing to it, so the record matches the built reality.
- Relational Data Migration Check — Validates that the links between migrated records — ownership, references, permissions, lineage, hierarchy — still resolve in the target system, because copying the values is not the same as preserving the relationships, and routes every broken link to a reconciliation queue.
- Relevant Asymmetry Test — Asks whether a real difference between the two sides is actually relevant to the treatment in question — the gate that separates a warranted asymmetry from bare prejudice or arbitrary privilege.
- Scale and Foreshortening Overlay — Overlays anchors and axes on a finished view to compare projected sizes, ellipses, and foreshortening against what the geometry predicts.
- Schema Mapping Review — A structured review of field-to-field, class-to-class, type-to-type, or entity-to-entity mappings across systems or datasets.
- Scope Change Review — A recurring review that gathers accumulated boundary violations and edge cases, decides deliberately whether the domain or codomain should change, and versions and announces any revision.
- Semantic Diff Review — Judges whether a change altered what the work MEANS — its function, its commitments, its recognizable identity — rather than only how it looks.
- Site Mapping Walkthrough — Walks the actual site at different hours and seasons to record its geometry, light, history, and lived use as active structure — the raw place-record every later design move reads from.
- Symplectic Form Preservation Check — Certifies a transformation is canonical by testing its Jacobian against the symplectic condition — that the map preserves the phase-space two-form and hence phase volume — across the domain.
- Synonym Merge Review — A review that examines terms which may mean the same thing and consolidates them when their distinction doesn't matter for the target use, keeping them apart when it does.
- Target-Space Difference Review — Diffs the required target set and mapping against their last certified baseline and treats every newly added or changed target as uncovered until a fresh witness proves otherwise.
- Toolmark Comparison Protocol — Compares striations, impressions, wear marks, or tooling defects across known and disputed artifacts.
- Translation Drift, Incident, and Revision Review — Samples real use, investigates misunderstanding and harm, watches both frameworks for drift, and decides whether to clarify, remap, split, suspend, roll back, or retire a mapping.
- Translation Memory Review — Reviews and reconciles competing phrase, label, concept, or terminology mappings across languages, teams, or historical translations.
- Translation-Loss, Ambiguity, and Power-Effect Audit — Traces what the bridge omits, adds, compresses, or distorts — and who gains authority, whose interpretation is excluded, and who bears the burden — then assigns disclosure and remedy.
- Variance Report — Summarizes each mismatch between expected and observed quantities, filters it by materiality, and routes it to an owner for explanation, escalation, or correction — turning a reconciliation gap into an accountable action.
- Viewpoint-Omission Audit — Reviews what the chosen station, crop, and projection hide, shrink, or flatter — and requires alternate evidence wherever an omission carries real consequence.
Measurement & Observability¶
Solutions that make hidden state inferable through instruments, indicators, probes, sampling, or diagnostic views with known limits.
20 mechanisms · View full solution family
- Blind-Zone Audit — Walks each mapped blind zone and asks two questions — could something material be hiding here, and does its absence from the record mean it isn't there — then flags the zones that matter and the residual risk that remains.
- Blinded Rater Assessment — When the instrument is a human judge, shields raters from identity, treatment, outcome, and prior-score cues so their scores reflect the target rather than what they expected to see.
- Construct Validity Argument — Assembles the reasoned case that a score deserves its interpretation — marshalling every strand of validity evidence into an explicit argument with a scoped claim and stated limits.
- Content-Domain Review Panel — A panel of domain experts that fixes what the construct includes and excludes and judges whether the items representatively cover that domain — content validity by expert judgment.
- Document-to-Practice Trace Matrix — Maps every documented control requirement to concrete execution evidence, exposing which requirements have no proof, a substitution, or a silent deviation.
- Exception, Waiver, and Override Log Review — Reads the waiver, override, and exception logs to find controls that are mandatory on paper but routinely set aside, and asks whether the exception path has become the real process.
- Explainability Review — Asks not whether a system is correct but whether its reasons are legible — whether the explanation it offers is understandable, and faithful, enough for the people who must rely on or contest the decision.
- Health Check — Runs a repeatable test that indicates whether a service, asset, process, or organism is functioning within an acceptable range.
- Incentive Impact Review — Maps the rewards, sanctions, and optimization pressure acting on a proxy to anticipate where actors will game the measure and hollow out its link to the target.
- Measurement Invariance Audit — Tests whether the measure means the same thing across subgroups — so a score gap reflects a real construct difference, not the instrument behaving differently by group.
- Measurement System Validation Study — A one-time, criteria-based study that tests the whole measurement claim against predeclared fitness rules and issues an approve / restrict / revise / reject decision on its intended use.
- Operator Shadowing and Contextual Inquiry — Sits beside the people who run a control to elicit the tacit steps, constraints, and hidden compensations that never reach the procedure — under protection that makes honest disclosure safe.
- Participatory Visibility Review — Brings the people inside the landscape into the room to mark their own invisibilities — surfacing blind zones only insiders can see, reconciling their view with the official one, and checking whether the burden of being observed falls fairly.
- Process Audit — Inspects the procedures, approval chains, and controls behind a system's outputs — catching the fragile or noncompliant process that a clean result can hide.
- Proxy Drift and Goodhart Audit — Periodically re-checks whether a proxy still tracks its construct once people are optimizing it — catching the moment a measure-turned-target decouples and needs revision.
- Reference-Standard Recalibration Review — Checks whether the reference standard used to judge the proxy has itself aged, and re-anchors or replaces it against a fresh, traceable yardstick.
- Signal/Noise Review — A human adjudication step where reviewers judge whether an extracted signal is real and fit for its use — or an artifact dressed up as signal — before it is allowed to drive a decision.
- Tiered Audit Protocol — Starts every case at the lightest, least-intrusive evaluation and widens internal access one tier at a time only when defined triggers fire — so scrutiny is spent where risk actually shows up.
- White-Box Audit — Opens the box and inspects the internals directly — code, configuration, records, controls, and decision logic — to find the causes and hidden risks that behavior alone cannot reveal.
- Work-as-Done Audit — Reconstructs how a control is actually performed under ordinary and pressured conditions, so the enacted version can be laid beside the documented one.
Negotiation & Strategic Interaction¶
Solutions that account for other agents' incentives, reactions, commitments, bargaining power, and counter-moves when outcomes are interdependent.
22 mechanisms · View full solution family
- Adaptive Mix Review — A recurring review that reweights the option mix based on drift, exploitation, switch costs, and observed counter-relations.
- Adversarial Editor or Red-Team Review — Assigns a reviewer whose job is to attack the claim — hunting the leaked interest, the buried counter-evidence, and the framing that makes a preferred conclusion look inevitable — before it reaches the audience.
- Antitrust or Competition Review — A standing authority that checks whether winning a contest has hardened into durable power over the arena itself, and imposes structural remedies when it has.
- Audit or Attestation Record — Has an independent examiner test a commitment against a defined standard and issue a relied-upon record, turning 'trust us' into a checkable attestation.
- Collateral Harm Review — Appraises each rung's action for damage to bystanders and for the legitimacy it costs you — holding side-effects within a guardrail so winning the exchange doesn't lose the standing you fight from.
- Cooperation Retrospective — A periodic, blameless look back at how the cooperation itself went — who carried what, who got left out, what strained — that adjusts the arrangement before the next cycle.
- Distributional Loss Review — Evaluates loser impact, proportionality, compensation, minimum floors, and due-process adequacy once a fixed-sum decision has already named its winners and losers.
- Escalation Ceiling Review — Sets and periodically re-examines the top of the ladder — the highest permissible rung and the rungs forbidden outright — and locks the upper band behind elevated authority.
- Fact-Checking Checklist — A pre-publication pass that walks every checkable assertion back to a source that supports it, flags what cannot be verified, and separates verified fact from interpretation and opinion.
- Fixed-Pie Boundary Audit — Stress-tests a claimed fixed-pie boundary — are all affected actors counted, are losses quietly shifted to outsiders, is the scope honestly drawn — before fixed-sum rules are allowed to apply.
- Headline and Lead Claim Consistency Review — Checks that the headline and opening lines assert no more than the body can warrant — pulling back verbs, certainty, and scope until a skimming reader's takeaway matches the evidence.
- Market-Power Screen — Tests whether an access point is genuinely a non-substitutable bottleneck — and pins down who controls exactly what — before any access duty is imposed.
- Narrative Momentum Stress Test — A one-off adversarial probe that asks whether a rising trend is climbing on fundamentals or purely because everyone expects everyone else to keep climbing it.
- Pairwise Dominance Audit — A review procedure that tests whether pairwise comparisons form a genuine cycle, a simple ranking, noise, or context-specific dominance.
- Post-Contest Impact Review — Looks back after the contest to check whether the winner actually delivered the intended value and what harms leaked out, then feeds the redesign of the next round.
- Post-Pilot Lock-In Audit — Checks whether a pilot has already created dependency, expectation, political commitment, or infrastructure that makes non-continuation unrealistic.
- Price-Cap or Rate Review — Constrains how much the controller can charge by tying the allowed price to a reviewed record of its costs, so a monopoly can't convert control of the chokepoint into unbounded rent.
- Regulatory Capture Audit — Periodically examines whether a regulator has drifted from serving the public to serving the industry it oversees — mapping who influences it, tracing whom its decisions actually benefit, and tracking that drift over time.
- Rent-Seeking Audit — Traces where a system's allocation rules are being turned into private tolls, sizes the rent each channel yields, and tallies the effort burned fighting over it.
- Rung Credibility Audit — Tests each rung of the ladder for whether the other party would actually believe you'd take it — weighing capability, will, and prior signaling — and flags the rungs that are bluff.
- Standardized Scoring Rubric — Fixes the criteria, weights, and required evidence of an allocation in advance and in public, so awards turn on stated, checkable merit rather than on who has the decider's ear.
- Zero-Sum Framing Challenge — Forces reviewers to test whether a zero-sum frame is structural, rhetorical, or masking a variable-sum alternative, and routes each slice accordingly.
Normalization & Standardization¶
Solutions that create comparable scales, shared formats, common baselines, or repeatable conventions across otherwise inconsistent cases.
7 mechanisms · View full solution family
- Cross-Scale Transfer Review — Rechecks whether a metric, rule, or equation that held at one scale still holds after it moves to another — and draws the boundary where its validity ends.
- Engineering Equation Sanity Check — Checks a formula and its computed result for both dimensional coherence and physically plausible magnitude before the number is trusted.
- Finance / Accounting Unit Check — Separates money-like quantities that share a currency symbol but are not interchangeable — nominal vs. real, one-time vs. recurring, cash vs. accrual — before they are added or compared.
- Nominal/Real Rate Pairing Rule — Checks that real cash flows use real discount rates and nominal cash flows use nominal discount rates.
- Spreadsheet Unit Audit — Walks an actual spreadsheet cell by cell — columns, hidden intermediate cells, and formula chains — to surface the unlabeled unit and denominator slips that spreadsheets breed.
- Stock / Flow Separation Check — Separates accumulated stocks from the flows that fill or drain them — balances from rates, prevalence from incidence — so a level is never compared directly with a speed.
- Unit Check — The first-line check that every input, output, and intermediate expression carries a compatible unit label before a calculation is trusted.
Optimization & Search¶
Solutions that explore alternatives under objectives and constraints, prune infeasible regions, and improve a candidate toward a chosen criterion.
16 mechanisms · View full solution family
- Artifact Red-Team Review — Convenes adversarial reviewers to hunt, before release, for the cheap cues, annotation artifacts, and gaming channels a learner might be exploiting — and to hand-inspect its confident errors.
- Baseline Comparison Table — Scores the candidate method head-to-head against a deliberately assembled ladder of reference points — trivial, incumbent, simple-but-strong, robust, domain-specific, and human-assisted — under identical conditions, so an apparent win has to survive comparison with what it claims to beat.
- Benchmark Refresh Audit — A recurring check that the benchmark tasks, reference data, and pass/fail thresholds still resemble the live problem distribution — refreshing them on a cadence before the evaluation quietly stops measuring reality.
- Data Leakage Audit — Traces the provenance of every feature and split to catch information that leaks from the future, the label, or duplicated rows into training or validation — and records where each leak entered.
- Dimension Budget Review — Reviews and limits the number of variables, latent dimensions, interactions, segments, or states allowed into the method.
- Distance Metric Audit — Audits whether distance, similarity, nearest-neighbor, and cluster relationships remain meaningful.
- Eligibility Screening — Applies formal, published eligibility criteria to applicants, cases, or bids — with an owner, an audit trail, and an appeals path — so exclusions are accountable and reversible, not just efficient.
- Field Calibration Review — A recurring meeting where field owners review misses, false activations, and boundary disputes, then retune thresholds and edges.
- Group-Stratified Validation — Reports performance broken out by subgroup, source, instrument, and annotator, so a healthy-looking aggregate can't hide the slice where the shortcut has quietly failed.
- Hash-Collision Budget Review — A periodic governance review that rechecks whether a hash or token length still meets its collision budget as volume grows and adversarial search improves.
- Heuristic Boundary Checklist — Confirms whether a shortcut is valid in the current domain, population, feedback regime, and risk level.
- Manifold / Embedding Validation — Checks whether an embedding or manifold assumption preserves task-relevant local and global relationships.
- No-Universal-Winner Claim Review — Stops any 'this method is simply the best' claim at the gate and sends it back until it names the reference class it applies to, the evidence behind it, and the boundary of problems where it actually holds.
- Optimization Target Review — Periodically reviews whether the current objective, metric, or reward target still produces the intended outcomes under observed behavior.
- Retrospective Error Calibration Review — Reviews outcomes and error patterns to tune thresholds, heuristics, algorithms, and hybrid pathways.
- Sample Audit of Exclusions — Re-examines a representative sample of what was pruned — not what was kept — to catch false negatives, bias, and drift before a filter quietly discards the answers that mattered.
Ordering, Sequencing & Dependencies¶
Solutions that arrange steps or events according to precedence, causality, readiness, or dependency so work happens in a valid order.
14 mechanisms · View full solution family
- All-or-Nothing Checklist — A checklist that refuses completion until every required transaction condition is verified.
- Batch Quality Review Window — A recurring review of grouped work sized to balance signal reliability against correction delay.
- Batch Release Gate — A release-control protocol that checks batch size, rollback capacity, risk, and downstream absorption before release.
- Checklist Confirmation — A human-facing procedure that confirms whether an action has already been completed before repeating it in operational, clinical, legal, or administrative settings.
- Counter-Script Review — A deliberate check that pits the working script against a library of rival readings and other participants' perspectives, forcing a stated confidence that this script — not a stereotype — actually fits.
- Expectation-Violation Review — A structured after-the-fact review that reconstructs a single encounter where the script was violated, tracing the causal chain and gathering each participant's account to explain what actually happened.
- Intake Checklist — A standardized, reusable list of readiness conditions an item must satisfy before it can proceed — applied identically to every request so 'ready' means the same thing every time, and revised from what keeps failing.
- Layer Disturbance Audit Checklist — Forces review of the disturbances — mixing, gaps, deletion, backfill — that could invalidate a naive layer-order interpretation.
- Misorder Incident Review — Analyzes cases where the order was violated or a sequence rule caused harm, then updates the constraints, rationale, and repair paths that govern future sequences.
- Production Lot Size Review — A review procedure for comparing production lot sizes against changeover, storage, quality, and downstream-flow costs.
- Switching-Cost Audit — Itemizes the full cost of leaving the current arrangement — migration, retraining, integration rework, exit penalties, and the commitments already sunk into it — to measure how much of the lock-in is exit friction rather than genuine preference.
- Temporal Precedence Screen — A check that rejects claimed lagged influence when the proposed cause does not reliably precede the effect.
- Threshold and Hysteresis Assessment — Assesses whether a constraint is reversible — how far the system sits from a tipping threshold, and whether crossing it snaps back on its own or stays flipped until the driver is pushed far past where it started.
- Throughput-Based Limit Review — Periodically re-checks the WIP limit against flow data — cycle time, throughput, blockage, breaches — so the number tracks real capacity instead of going stale.
Participation, Norms & Culture¶
Solutions that shape belonging, legitimacy, shared expectations, collective practice, and the willingness of people to contribute or comply.
36 mechanisms · View full solution family
- Access Criteria Audit — Reviews whether entry rules, gatekeeping markers, or eligibility filters match the stated purpose or instead reproduce outdated symbolic exclusions.
- Accessibility and Sensory Checklist — Checks room layout, timing, sound, lighting, translation, remote access, mobility, sensory load, rest, food, transport, and assistive needs.
- Anonymous Inclusion Pulse Check — Collects quick anonymous signals about access, safety, belonging, clarity, and voice balance during or after the activity.
- Appeal and Correction Workflow — Gives a subject a governed path to contest and fix reputational information that is false, irrelevant, malicious, or stale.
- Capture Risk Audit — Periodically assesses where and how strongly the institution is exposed to capture — mapping the channels of influence and scoring them against a defined risk threshold — so drift can be caught as a pattern before it becomes the culture.
- Category Audit — Pins down a single category — how it is defined, who assigns it, how it is recorded, and what it triggers — so its taken-for-granted boundaries become inspectable.
- Classification Impact Review — Traces what a category does once it is assigned — the access, standing, resources, scrutiny, and accountability that ride on the label — and how those effects land differently on differently placed people.
- Community Language Review — Invites members or representatives of the target community to review whether wording, examples, tone, and identity signals fit the intended audience.
- Contribution Review Cadence — Reviews obligations, exceptions, burden concentration, and provision health at a fixed interval so a contribution arrangement is recalibrated on evidence rather than on complaint.
- Cross-Cultural Ethics Review — Reviews whether an ethical standard, policy, or intervention remains legitimate when applied across cultural or community contexts.
- Culture Survey — Measures, across a whole population, what people take for granted, how fairly and legitimately they experience the arrangement, and where lived experience diverges by group.
- Detection Opportunity Audit — Checks whether the observer, sensor, search, or communication channel actually could have detected the expected event.
- Essential-Function and Method-Separation Review — Tests which outcomes and safety controls are essential and which methods are inherited or convenient.
- Ethical Impact Assessment — Captures foreseeable ethical consequences of applying or adapting a decision across contexts, including who benefits and who bears risk.
- Ethical Review for Taboo Topic — Reviews whether inquiry, discussion, publication, or intervention around a taboo topic is justified, proportionate, and adequately safeguarded.
- Exception-Lag Review Workflow — Reviews recurring benign lags and exceptions so thresholds and calendars stay realistic instead of firing on ordinary delay.
- Fact-Checking with Harm Awareness — Verifies a circulating claim to a defensible standard while preserving the legitimate concern underneath, so debunking does not slide into denial.
- Harm Containment Debrief — Follows taboo discussion with review, support, correction of misunderstandings, containment of sensitive information, and adjustment of safeguards.
- Hidden Curriculum Audit — Surfaces the unwritten rules, tacit criteria, and insider assumptions a setting uses to judge competent participation but never states out loud.
- Institutional Cue Walkthrough — Traverses a setting from several newcomers' standpoints to catch the signs, layouts, jargon, and rituals that quietly signal who belongs and how to act.
- Language Review — Walks the live forms, scripts, interfaces, policies, and training materials for the wording and category assumptions that quietly stabilize a constructed reality, and flags what to change.
- Learning-from-Error Postmortem — A blameless review run after an error that reconstructs what happened, extracts the lesson, and commits a specific change to future practice.
- Mediation-Layer Transparency Review — Exposes the stack of intermediaries — algorithms, gatekeepers, layers of process — sitting between a participant and the system, judges which add value versus only distance, and plans to make the necessary ones legible and cut the rest.
- Membership Standing Review — A scheduled collective review that reaffirms who remains a member in good standing and checks whether informal enforcement is actually protecting the members who comply.
- Norm Audit — Surfaces the unwritten expectations and quiet sanctions that keep people reproducing a shared reality with no formal rule behind it, then tests whether anyone actually endorses them.
- Norm Legitimacy Review — Periodically re-examines the norm itself — is it still justified, explainable, contestable, and free of coercion — so people are asked to internalize only standards that deserve it.
- Null-Result Power Check — Estimates whether a failed search or null observation had enough sensitivity to count as evidence of absence.
- Participation Equity Review — Reviews participation and outcome patterns to test whether a design quietly rewards people already fluent in the field — and whether supports are used without stigma.
- Person–Task–Environment Mismatch Analysis — Crosses capacity ranges with task, interface, environmental, and temporal demands and consequences.
- Post-Event Inclusion Debrief — Reviews who participated, who did not, what barriers appeared, and what design changes should be made before the next collective activity.
- Proportionality Review — Tests whether a proposed sanction, ban, or restriction is justified by the evidence and whether a narrower or reversible measure would do the same work.
- Repair or Reentry Reflection — After a breach or drift, a structured reflection that turns the violation into understood harm and renewed commitment — restoring standing without permanent shame.
- Style-Norm Explicitness Rubric — Scores each tone, dress, timing, and self-presentation expectation on whether it is justified, explicit, flexible, and actually tied to the role.
- Teach-Back Comprehension Check — Asks recipients to restate the adapted message or next action in their own words to verify uptake.
- Uncertainty Retrospective Prompt — A recurring review question that asks, after the fact, which uncertainties the group named, which it hid, which it resolved, and which it mishandled.
- Values-in-Action Review — Reviews real decisions to examine how stated values were enacted, compromised, neglected, or improved.
Planning & Staging¶
Solutions that turn an intended outcome into phases, milestones, option points, and coordinated preparations before execution.
18 mechanisms · View full solution family
- Balance-Closure Residual Audit — Interrogates the unexplained residual left after named channels are subtracted, deciding whether the balance closes tightly enough to trust the diagnosis or hides an unnamed channel.
- Barrier Gap Walkthrough — Leaves the desk to inspect each barrier where it actually operates, replacing hypothesized holes with the real exceptions, bypasses, and named owners found on the floor.
- Before/After Yield Reconciliation — Reconciles the whole yield balance before and after a change to confirm the aggregate genuinely rose and that recovered loss did not simply relocate, double-count, or hide in the denominator.
- Closability Scoring Rubric — Scores each portion of a decomposed gap on how closable it is — recoverable latent capacity versus irreducible limit — using a shared, explicit rubric instead of intuition.
- Common-Cause Layer Audit — Hunts on paper for the shared vendor, feed, power source, or credential that secretly couples defensive layers the organization treats as independent.
- Denominator Reconciliation Checklist — A pre-analysis gate that verifies each stage's counts agree across systems, definitions, time windows, filters, and de-duplication rules before anyone trusts the funnel.
- Impact Assessment Checkpoint — A required analysis step that, before any change is decided, traces its full downstream cost — capacity, dependencies, hidden follow-on work — and measures how far it moves scope from the original charter.
- Mission-Creep Audit — A periodic, backward-looking review — owned by the trajectory owner — that reconstructs how the effective objective has changed and names what has quietly crept in.
- Near-Miss Trajectory Review — Reconstructs the path each real near-miss actually took through the layers and treats it as hard evidence that holes are already starting to align.
- Opportunity-Cost Review — Prices what each proposed addition displaces — the next-best use of the same capacity — and puts that cost on the table beside the addition's benefit.
- Pathway Assumption Review — Periodically re-tests the assumptions and endpoint criteria the backcast rests on, firing when a monitoring trigger says the pathway may no longer hold.
- Post-Closure Gap Remeasurement — Re-runs the gap measurement after an intervention lands, updating both the realized outcome and its uncertainty band to confirm how much gap actually closed versus what was predicted.
- Post-Safeguard Incentive Audit — Re-maps who now pays, benefits, observes, and controls after a safeguard lands, exposing where the risk budget and accountability actually moved.
- Rebound Debrief — A retrospective that checks whether shielding tipped into over-suppression, catching the backlash a rival goal mounts once the pressure comes off.
- Stop-Rule Postmortem — Reviews a completed stopping decision after the fact to judge whether the boundary caused avoidable regret or bias, and recalibrates it for the next sequence.
- Sunk-Cost Reset Review — A recurring forward-only re-decision that erases everything already spent from the ledger and names out loud whether you are still fighting for the prize or only to avoid looking like you were wrong.
- Survivorship Bias Audit — Tests whether a funnel that looks healthy among the people it measures is quietly ignoring those excluded, abandoned, refused, or dropped before they were ever counted.
- Swiss-Cheese Barrier Review — Walks one hazard through the whole defensive stack at a table, asking layer by layer where the same scenario could slip through — the fast first screen for aligned holes.
Prediction & Simulation¶
Solutions that use models, scenarios, experiments, or synthetic environments to estimate behavior before committing in the real system.
6 mechanisms · View full solution family
- Frame Compatibility Review — A gate run before two probabilities are compared or pooled, checking that their events, denominators, time windows, and sampling rules are actually commensurable.
- Prediction Error Review — A standing review where people sit with the material misses — building the story of why each gap happened and deciding whether the model, the data, the action, or the boundary should change.
- Probability Integral Transform Check — Feeds each observation through its own predicted cumulative distribution; if the forecasts are calibrated the transformed values are uniform, so departures from flatness reveal exactly how the distribution is wrong.
- Proper Scoring Rule Comparison — Ranks competing probabilistic forecasts with a scoring rule that is optimized only by honest, accurate distributions, so the model that genuinely predicts best cannot be beaten by hedging or overconfidence.
- Rerun Checklist — Provides a lightweight confirmation list for rerunning the result path and comparing outputs against the reference.
- Shadow Raw-Channel Sampling — Quietly routes a sample of full observations down an independent audit path and compares them against what the predictor would have reconstructed, to catch what the residual pipeline silently drops.
Quality Assurance & Release¶
Solutions that verify fitness, coverage, conformance, and readiness before an output is accepted, shipped, or trusted downstream.
8 mechanisms · View full solution family
- Audit-Trail Sampling — A sampling method comparing producer assertions against trace records, transactions, logs, cases, or physical evidence.
- Blind Revalidation — A repeated analysis or test where reviewer exposure to producer identity, expected outcome, or contested labels is masked.
- First-Article or Setup Inspection — Inspects the first output after a setup or changeover to catch configuration errors before a large defective batch is produced.
- First-Pass Loss Audit — Isolates and books the loss at the first boundary the input must cross — the earliest, largest, most easily hidden drop, before any downstream stage can even see it.
- Stagewise Availability Assay — Measures how much of the input remains in usable form at each stage of the path, turning one supplied figure into a stagewise availability profile with error bars.
- Statistical Acceptance Sampling Plan — Samples completed lots using predefined sample sizes and accept/reject numbers to decide, with quantified risk, whether a lot can be released.
- Target-Site Sampling or Proxy Validation — Measures what is actually present at the point of action — by sampling the target directly, or by validating an accessible proxy that provably tracks it.
- Third-Party Audit — A review by an external assessor who inspects evidence, controls, compliance, safety, quality, or security claims.
Recovery & Restoration¶
Solutions that return a damaged, degraded, or interrupted system to service through repair, rollback, reentry, regeneration, or reconstruction.
9 mechanisms · View full solution family
- Alternative Readings Review — Lays the serious rival readings side by side and draws the line between those the evidence admits and those it rules out, so an interpretation is chosen against its live competitors rather than in a vacuum.
- Coupling Exposure Matrix — Crosses the protected relational variables against every environmental channel and exposure condition to enumerate where coherence can be attacked.
- Damage Assessment Survey — A field instrument that walks the damaged estate and grades each asset — separating visible damage from hidden incapacity and flagging the latent hazards that could still collapse.
- Documentation Review for Cooperative Expectations — Audits a document against the cooperative expectations — clarity, grounding, relevance, sufficiency — before any reader hits the breakdown, and bakes the fixes back into the template.
- Interpretation Red Team — Assigns someone to attack a favored reading — mounting the strongest rival interpretations and probing where it strains — so the interpretation earns its confidence instead of assuming it.
- Recovery After-Action Review — A structured retrospective that converts a completed recovery into durable memory and asks the hard question — rebuild the old state, or transform it so the same failure cannot recur.
- Stakeholder Meaning Check — Tests a reading against the people it is about or for — do the affected communities recognize the meaning as theirs? — before the interpretation is acted on.
- Sufficiency Calibration Checklist — A checklist that calibrates how much detail is enough for this audience and stake — pruning overload and filling gaps so a message is neither too thin nor too bloated to act on.
- Translation Backcheck — Verifies that meaning survived a translation by translating the result back into the source and comparing it to the original, surfacing exactly where the bridge leaked.
Redundancy & Fault Tolerance¶
Solutions that preserve service when parts fail by duplicating capability, diversifying failure modes, or providing independent alternate paths.
3 mechanisms · View full solution family
- Credential and Infrastructure Dependency Audit — Checks whether backup systems, emergency roles, and alternate channels still depend on the same identity provider, network, power source, cloud region, or access authority.
- Diverse Vendor Review — Assesses whether vendor diversity is real across ownership, infrastructure, code lineage, hosting, support, credentials, and failure response capability.
- Supply-Chain Dependency Review — Traces whether alternate suppliers, logistics routes, components, or raw materials share sub-tier vendors, regions, infrastructure, labor constraints, or regulatory chokepoints.
Reframing & Sensemaking¶
Solutions that change the interpretive frame, surface hidden assumptions, or organize ambiguous experience into a more useful account.
56 mechanisms · View full solution family
- Affordance Visibility Audit — Systematically inspects the surfaces users actually sample and catalogs every available capability that leaves no perceivable trace there — turning "nobody finds this" into a ranked visibility-gap list.
- After-Action Awareness Recalibration — Replays a closed episode to compare what the team perceived, understood, and projected against what actually happened, then retunes the perception field and interpretation for the next loop.
- After-Action Learning — Reconciles what a team expected against what actually happened, weighs the competing explanations, and records which belief, rule, or practice should change so the lesson survives past the meeting.
- After-Action Story Review — Audits the story that will become the official lesson after an incident, project, campaign, or crisis.
- Anachronism Scan — Tests whether an interpretation depends on concepts, objects, categories, or expectations unavailable or differently functioning in the relevant period.
- Anonymous Pre-Expression Poll — Collects a private signal before public speaking, visible voting, or sequential endorsement creates additional conformity pressure.
- Application Commitment Review — Checks whether training changed a concrete action, decision rule, communication plan, design choice, or evaluation rubric.
- Assumption Audit Worksheet — Enumerates, one row per premise, which assumptions must hold for two formulations to correspond and marks which of them fails in the regime where agreement broke.
- Assumption Ladder Worksheet — Traces a reaction from perception to interpretation to judgment to action, then asks which steps depend on the learner's cultural frame.
- Assumption Testing — Tests whether the conflict depends on hidden assumptions that can be revised, separated by context, or converted into conditional decision rules.
- Blinded Frame Review — Has reviewers evaluate competing presentations without knowing which one the team prefers or what result each produces, so the frame is chosen on stated criteria rather than on the answer it yields.
- Confidential Opinion Climate Survey — Measures private position, perceived majority, perceived sanction risk, and willingness-to-speak thresholds without public exposure.
- Conflict De-escalation Review — Separates anger or offense from the intent it assumes, testing the attribution against alternative explanations and a neutral observer's reading — without invalidating the grievance.
- Counterfactual Minimal-Change Checklist — A checklist for preserving relevant facts when using nearby alternatives to test necessity or contingency.
- Counterfactual Preservation Checklist — Walks every independent actual fact and confirms it is held fixed in the counterfactual unless the antecedent genuinely forces it to change.
- Dashboard Framing Review — Audits a live dashboard's display choices — units, baselines, sort order, default filters, missing denominators — for the ones that steer the operational decisions the dashboard actually drives.
- Distinction and Frame Audit — Interrogates the categories, boundaries, labels, and exclusions of an observational frame, surfacing what the chosen distinctions let count and what they render invisible.
- Double-Blind or Identity-Masked Review — Strips status and identity cues from the object of evaluation so judgment rests on the work itself, while preserving a governed path to unmask later for credit, conflicts, appeal, and accountability.
- Ecological Scale Review — Reads the characteristic scale off ecological evidence spanning organism, patch, habitat, landscape, watershed, and biome, so interventions target the scale where the process is actually generated, and marks the boundary where that process's dynamics no longer hold.
- Entailment Cascade Audit — Traces which downstream changes actually follow from the antecedent through the causal model, separating necessary consequences from smuggled-in embellishments.
- Era Label Review — Audits an inherited era label for teleology, presentism, and hidden continuities, holding the name accountable to evidence after the fact.
- Excluded Case Review — Collects cases that the narrative omits or treats as exceptions, then tests whether they are irrelevant, boundary-setting, or narrative-breaking.
- Field Observation Debrief — Turns observation into tested interpretation by separating what was seen, what was inferred, and what insiders say it meant.
- Gratuitous Change Challenge — Makes every alteration in the counterfactual justify itself, striking any change the antecedent did not entail.
- Hindsight Information Exclusion Test — Checks that the counterfactual uses only what was knowable at the time, not information that surfaced afterward.
- Incident Narrative Review Session — Uses a structured session to revisit incident details and whole account before lessons or narratives are finalized.
- Incident Phase Review — Segments a single incident into phases by what people could know or do at each stage, so lessons attach to the right moment instead of collapsing into 'during the outage.'
- Insider Narrative Review Panel — Invites people with situated knowledge to review whether the learner's interpretation is recognizable, respectful, and sufficiently qualified.
- Member Checking and Contestation Session — Returns draft claims to the people they describe for correction, context, and dissent, treating their response as evidence rather than mere courtesy.
- Metanarrative Audit — Reviews a sweeping account by listing claims, evidence, exclusions, assumptions, endpoints, and counterexamples.
- Modal Language Review Protocol — A protocol for reviewing must, may, can, cannot, should, would, and might in high-stakes language.
- Model-Use Impact and Performativity Review — Tests how putting a model to use — publishing, scoring, ranking, forecasting — changes the very system it measures, and whether that feedback has quietly invalidated the model.
- Observation-of-Observation Review — Puts a second observer onto the first, auditing how evidence was selected, interpreted, validated, and operationalized — an observation of the observing.
- Organizational Myth Audit — Applies grand narrative decomposition to a company, institution, team, product, or community origin story that explains too much too smoothly.
- Pattern Drift and Exception Audit — Samples deployed instances against the intended grammar to catch unauthorized mutations, semantic collisions, and one-off exceptions before they erode the family.
- Period Vocabulary Audit — Reviews whether terms, categories, roles, and meanings are period-appropriate and not silently translated into modern equivalents.
- Post-Intervention Climate Audit — Rechecks fear, willingness to speak, perceived majority, and visible expression after the recalibration intervention.
- Presentism Checklist — Checks whether modern values, categories, institutions, technical capabilities, or hindsight knowledge are being projected backward.
- Proxy Validity Audit — Checks whether a proxy or instrument actually tracks the target property, and logs its calibration and reliability over time.
- Red-Team Interpretation Review — A challenge process that tests the emerging narrative against alternative explanations, disconfirming signals, and blind spots.
- Risk Evidence Review — Weighs a felt sense of danger or safety against likelihood, consequence, controls, and reversibility, then sets a proportionate — often reversible — response.
- Ritual Access And Consent Review — A pre-observance checklist that tests whether every participant can genuinely understand, access, refuse, and exit a rite before it runs — so belonging pressure never stands in for consent.
- Ritual Drift And Harm Audit — A periodic, deliberately skeptical review that asks whether a repeated practice has drifted into rote habit, hypocrisy, coercion, exclusion, or harm — and whether its stated claim still matches lived conduct.
- Role Transition Review — At a role, identity, or mandate boundary, re-maps which responsibilities now hold and helps the person or team re-endorse a commitment that fits the new role.
- Scale-Drift and Exception Audit — Reviews implemented dimensions, ratio deviations, breakpoints, and outcomes against the controlled proportion system.
- Scale-Shift Review Prompt — A fixed question set run against a finished claim to ask what becomes visible, invisible, exaggerated, or smoothed when the analysis is deliberately shifted a scale finer or coarser.
- Scale-Specific Policy Analysis — Evaluates whether a policy problem and its intervention point sit at the person, program, institution, region, or system level.
- Selection / Omission Matrix — Places included material and plausible excluded material side by side so narrative scope and distortion risk can be reviewed.
- Sensory Walkthrough — Walks an imagined observer sense by sense through the object, cataloguing what each modality would encounter under stated conditions.
- Suppression Backfire Precheck — A pre-action checklist that scores visibility, audience inference, replication pathways, legitimacy, and proportionality before removal, denial, or legal escalation.
- Surface-Sampling Walkthrough — Walks the intended user's real journey in the first person, surface by surface, recording where attention actually lands and where people are pulled — the map of where a cue would be seen and where it would be missed.
- Teleology Checklist — Asks whether the account implies inevitability, destiny, natural progress, natural decline, moral culmination, or endpoint-driven interpretation.
- Timeline Review — Uses chronology to test whether the narrative confuses sequence with causality or hides temporal gaps, reversals, and delays.
- Tool-Mismatch Postmortem — After a tool-native success masks a real-world failure, reconstructs the mismatch and feeds it back into training, procurement, and repertoire expansion.
- Trust and Legitimacy Checklist — Verifies the credibility, consent, fairness, accountability, and repair conditions an adoption needs to be seen as legitimate — as a gate before launch, not an apology after.
- Workaround Observation Walkthrough — Reads the bypasses, renamings, and quiet modifications people already make to an imported artifact to infer where it actually clashes with how the work really happens.
Representation & Modeling¶
Solutions that construct schemas, models, diagrams, abstractions, or formal descriptions that make structure available for reasoning.
105 mechanisms · View full solution family
Because this form-and-solution-family intersection contains more than 100 mechanisms, it is further divided by solution archetype.
Archetype overview
| Solution archetype | Mechanisms | Description |
|---|---|---|
| Access-Optimized Redundant Representation | 1 | Create a governed redundant representation around a proven access path, keep one authority and an explicit derivation, bound divergence, verify the benefit, and make refresh, repair, schema change, privacy, and retirement part of the design. |
| Additive Measure-Space Design | 3 | Make size assignable and composable by declaring what subsets are measurable and how disjoint sizes add. |
| Aesthetic Coherence System | 1 | Coordinate visual and aesthetic elements so a system feels unified across contexts, surfaces, and interactions. |
| Cognitive Representation Externalization | 1 | Move complex mental structure into an external representation so it can be inspected, shared, and improved. |
| Coherent Linear Space Design | 3 | Declare a carrier, scalars, and linear operations so adding, scaling, decomposing, and interpolating elements have stable meaning. |
| Complement Space Mapping | 2 | Declare the universe, define the focal subset, and treat everything outside it as an explicit complement instead of an unexamined leftover. |
| Completeness Audit | 6 | Systematically search for missing cases, gaps, states, stakeholders, paths, records, requirements, or risks so the system does not fail in unhandled regions. |
| Composable Relation Modeling | 2 | Model a domain by objects, typed arrows, and valid compositions so structure-preserving pathways can be reasoned about independently of object internals. |
| Constraint Formulation | 1 | Turn implicit limits, requirements, and prohibitions into explicit constraints that shape the feasible solution space. |
| Correspondence Validation | 1 | Ensure a new model, theory, version, or system matches the old one within the old one’s valid domain before replacing it. |
| Discrete–Continuous Model Selection | 2 | Choose whether to model a process as discrete steps or continuous flow based on what must be measured, controlled, or decided. |
| Emergent Similarity Partitioning | 1 | Find provisional groups by similarity when labels are not given, then validate and interpret the partition before using it. |
| Essentialism Audit | 3 | Audit fixed-essence assumptions so categories, people, groups, roles, or artifacts are not explained as if they have an inherent nature when variability and context matter. |
| Event-Log-Centered Modeling | 1 | Preserve happenings as the primary record and derive entity state, relationships, places, periods, timelines, and summaries as reproducible projections of the governed event log. |
| Evidence-Grounded Persona Proxy Design | 2 | Turn complex user or stakeholder evidence into a memorable persona proxy while preserving the boundary, provenance, uncertainty, and refresh rules that keep the proxy honest. |
| Exhaustive Disjoint Partition Design | 4 | Turn a whole into named blocks that cover everything once and only once. |
| Formal Derivation System Design | 3 | Turn reasoning into an explicit symbolic machine by fixing symbols, well-formedness rules, axioms, inference rules, and derivation checks. |
| Generated Span Closure Design | 2 | Declare the primitives and allowed operations, then make the whole generated possibility space explicit and auditable. |
| Gestalt Grouping Design | 2 | Arrange information so people perceive the intended groups, relationships, boundaries, and continuities. |
| Grammar-Guided Structure Recovery | 1 | Recover the nested structure carried by a flat sequence by binding the input to a grammar, preserving spans, retaining competing parses when needed, and validating the selected hierarchy. |
| Implicit Assumption Surfacing | 2 | Make hidden assumptions explicit so they can be tested, revised, documented, or deliberately preserved. |
| Implicit Bias in Knowledge Structure | 5 | Audit how hidden assumptions in categories, schemas, or mental models bias what is noticed, valued, or ignored. |
| Incompatible Requirement Set Resolution | 1 | When individually defensible commitments cannot all hold together, prove and localize the incompatibility, choose the smallest legitimate relaxation, and publish the guarantees and losses that remain. |
| Independent Generating Set Design | 1 | Define the space and combination rules, then choose the smallest independent set of generators that covers it completely and yields stable, unique, transformable coordinates. |
| Independent Generator Validation | 2 | Keep a generator set honest by testing whether every retained member contributes a direction, signal, or degree of freedom that the others cannot reproduce. |
| Inductive Validity Extension | 5 | Validate that a rule, guarantee, or process that works in a base case continues to hold as it extends step by step, recursively, or at larger scale. |
| Informal Structure Mapping | 2 | Reveal the unofficial relationships, workarounds, and influence paths that determine how work actually gets done. |
| Material Literalness Foregrounding | 1 | Foreground the literal material or medium of a thing by suppressing decorative, symbolic, and illusionistic cues that would make the viewer treat it as something else. |
| Mental Model Mismatch Repair | 1 | Detect and repair mismatches between a person's mental model and how the system actually behaves. |
| Meta-Symbolic Rule Reflection | 4 | Examine and revise the symbol system, categories, or rules used for reasoning rather than only applying them. |
| Metric-Space Specification and Validation | 2 | Turn vague closeness into a validated distance function before using near/far relationships to search, cluster, route, threshold, or reason locally. |
| Negative Space as Structural Element | 1 | When more marks would weaken perception, make the unmarked field do structural work: separate, balance, emphasize, calm, and organize what remains. |
| Network Motif and Pattern Discovery | 1 | Discover functionally meaningful recurring local graph structures by comparing observed subgraphs to suitable baselines. |
| Ontology Clarification | 1 | Clarify what entities, categories, and relations exist in the problem domain before designing, deciding, measuring, or governing. |
| Other-Agent State Model Calibration | 4 | Model another agent as having its own partial knowledge, goals, attention, constraints, and interpretations, then update that model from evidence before routing action through it. |
| Overlap Exclusion Design | 3 | Declare which collections must not share members, then make that absence of overlap testable, maintained, and safe to rely on. |
| Patchwise Global Certification | 3 | Promote local checks to a global verdict only when the cover, witnesses, seam compatibility, and aggregation discipline are explicit. |
| Predicate Criterion Formalization | 1 | Make a vague condition usable by turning it into a domain-bound yes/no test with evidence, edge-case, and review rules. |
| Representation Fit Selection | 1 | Choose the representation that preserves the features needed for the task while minimizing distortion and burden. |
| Representational Reduction and Formal Abstraction | 1 | Reduce literal depiction by extracting what must remain and translating it into a controlled vocabulary of form, relation, color, material, rhythm, space, and process. |
| Reversible Operation Structure Design | 2 | Design the admissible operations of a system as a closed, associative, identity-bearing, invertible structure so composition and reversal stay reliable. |
| Sacred Boundary Stewardship | 1 | Define what is set apart, mark its boundary, govern how it may be approached or changed, and provide repair paths when reverence is violated. |
| Schema Conflict Resolution | 1 | Resolve conflicts when different schemas classify or interpret the same reality differently. |
| Schema Update Protocol | 1 | Revise an organizing schema when new evidence no longer fits its categories or assumptions. |
| Shared Subset Intersection Mapping | 2 | Declare the collections and identity rule, then extract the elements common to all of them as a traceable shared subset. |
| Sign–Meaning Alignment | 2 | Align the form of a sign, label, symbol, or message with the meaning people are intended to take from it. |
| Structural Inversion Design | 2 | Reverse a declared structure under explicit invariants, recoverability, boundary, and round-trip rules. |
| Structure-Preserving Embedding Design | 2 | Embed a source system into a richer host so the source remains distinguishable, structurally faithful, and usable inside the host rather than merely translated or compressed. |
| Symbol-System Coherence in Visual Art | 3 | Keep the same visual sign pointing to the same intended meaning unless the work makes the change visible and purposeful. |
| Tacit Knowledge Elicitation | 1 | Draw out expert know-how that is used in practice but not yet articulated. |
| Textual Close-Reading Mode | 3 | Suspend premature paraphrase, inspect the artifact at its meaningful grain, and bind every larger interpretation to exact marks, relations, repetitions, placements, and omissions. |
| Universality Extraction | 1 | Compare heterogeneous cases, vary alleged incidental details, and extract the smallest actionable macro-structure that survives—together with the class and boundaries within which it transfers. |
Access-Optimized Redundant Representation¶
Create a governed redundant representation around a proven access path, keep one authority and an explicit derivation, bound divergence, verify the benefit, and make refresh, repair, schema change, privacy, and retirement part of the design.
1 mechanism · View full solution archetype
- Checksum and Sample Reconciliation — Periodically compares a copy against its source — range checksums plus spot-sampled rows — to detect and quantify divergence, without re-reading every row every time.
Additive Measure-Space Design¶
Make size assignable and composable by declaring what subsets are measurable and how disjoint sizes add.
3 mechanisms · View full solution archetype
- Finite or Countable Additivity Test — Verifies the load-bearing axiom — that disjoint pieces' sizes sum to the size of their union, and the empty set has size zero — under the additivity regime the application actually needs.
- Measure Invariance Review — Checks whether the measure survives the transformations a decision assumes it survives — re-partitioning, coordinate or projection changes, unit or scale swaps — before those uses rely on it.
- Monotonicity Sanity Check — A cheap consistency check that a containing subset never receives less size than the subset it contains — catching sign errors, overlaps, and broken additivity before they reach a decision.
Aesthetic Coherence System¶
Coordinate visual and aesthetic elements so a system feels unified across contexts, surfaces, and interactions.
1 mechanism · View full solution archetype
- Coherence Review — A recurring human gate that judges whether a proposed instance reads as part of the system, still carries its cues' meaning, and — where it deviates — routes the exception to a decision.
Cognitive Representation Externalization¶
Move complex mental structure into an external representation so it can be inspected, shared, and improved.
1 mechanism · View full solution archetype
- Model Walkthrough Review — A structured review in which users or stakeholders step through an external representation and test its meaning.
Coherent Linear Space Design¶
Declare a carrier, scalars, and linear operations so adding, scaling, decomposing, and interpolating elements have stable meaning.
3 mechanisms · View full solution archetype
- Change-of-Basis Review — Re-expresses the same vectors in a second basis and checks which conclusions survive the switch and which were artifacts of the old coordinates.
- Linear-Axiom Verification Checklist — Walks a declared space through the vector-space axioms — closure, identity, inverse, associativity, distributivity — to catch operations that only look linear.
- Zero-Span Linearity Check — Checks offset, scale, and selected response points without running a full destructive or laboratory calibration sequence.
Complement Space Mapping¶
Declare the universe, define the focal subset, and treat everything outside it as an explicit complement instead of an unexamined leftover.
2 mechanisms · View full solution archetype
- Complement Sensitivity Checklist — A short pre-flight list of questions that forces a team to look at whoever falls outside the focal set before shipping — who is omitted, who gets harmed, and where non-membership is being misread as the opposite.
- Disjointness and Exhaustiveness Review — The audit that proves the two invariants over the whole universe — no case in both subset and complement, and no case in neither — with the boundary register as the ledger of what got adjudicated.
Completeness Audit¶
Systematically search for missing cases, gaps, states, stakeholders, paths, records, requirements, or risks so the system does not fail in unhandled regions.
6 mechanisms · View full solution archetype
- Coverage Checklist Walkthrough — Uses a structured checklist to walk through expected cases, states, criteria, or controls and flag omissions or ambiguous coverage.
- Data Completeness Check — Checks whether records, fields, observations, time periods, categories, or sources needed for valid use are present or explicitly marked missing.
- Policy Gap Analysis — Compares a policy framework against relevant actors, situations, exceptions, rights, obligations, or edge cases to locate missing treatment.
- Risk Register Review — Uses a risk register to reveal unlisted hazards, uncovered mitigations, ignored scenarios, or risk categories without owners.
- Stakeholder Inclusion Review — Examines whether the affected stakeholder set includes overlooked groups, boundary populations, indirect beneficiaries, or negatively affected parties.
- Test Coverage Audit — Checks whether tests cover intended functions, branches, conditions, requirements, risks, or user paths, and then identifies untested regions.
Composable Relation Modeling¶
Model a domain by objects, typed arrows, and valid compositions so structure-preserving pathways can be reasoned about independently of object internals.
2 mechanisms · View full solution archetype
- Source/Target Type Check — Verifies that every arrow is used and composed only where its declared source and target types actually match.
- Structure-Preservation Checklist — Checks, feature by feature, that a proposed mapping preserves identities, composition, and associativity before you rely on it.
Constraint Formulation¶
Turn implicit limits, requirements, and prohibitions into explicit constraints that shape the feasible solution space.
1 mechanism · View full solution archetype
- Constraint Review Checklist — Prompts reviewers to check hard/soft classification, conflicts, scope, enforcement, exceptions, and stale assumptions.
Correspondence Validation¶
Ensure a new model, theory, version, or system matches the old one within the old one’s valid domain before replacing it.
1 mechanism · View full solution archetype
- Model-Limit Validation — Checks whether a newer or more general model reduces to, approximates, or preserves the trusted older model under the older model's limiting conditions.
Discrete–Continuous Model Selection¶
Choose whether to model a process as discrete steps or continuous flow based on what must be measured, controlled, or decided.
2 mechanisms · View full solution archetype
- State Machine vs Flow Model — Puts a named-states-and-transitions representation head to head with a continuous-variable one and picks by which preserves the decision-relevant change.
- Transition Resolution Audit — Checks whether the chosen representation can actually detect transitions at the speed, scale, and consequence the task demands.
Emergent Similarity Partitioning¶
Find provisional groups by similarity when labels are not given, then validate and interpret the partition before using it.
1 mechanism · View full solution archetype
- Cluster Label Review Workshop — Convenes domain experts to inspect candidate clusters, name them cautiously, adjudicate boundary and outlier cases, and set the terms under which the labels may be used downstream.
Essentialism Audit¶
Audit fixed-essence assumptions so categories, people, groups, roles, or artifacts are not explained as if they have an inherent nature when variability and context matter.
3 mechanisms · View full solution archetype
- Category Review — Examines whether an existing category is being used as a fixed natural kind when it should be treated as pragmatic, graded, historically produced, and revisable.
- Situational Attribution Review — Checks whether a behavior or outcome has been attributed to a stable trait when situational causes — constraints, incentives, role, history, exposure — better explain it, and states the situational explanation the decision should use instead.
- Stereotype Audit — Scans labels, personas, narratives, rubrics, and model variables for generalized trait claims about a group — naming the claim, pinning exactly whom it targets, examining the wording that carries it, and tracing the decision it feeds.
Event-Log-Centered Modeling¶
Preserve happenings as the primary record and derive entity state, relationships, places, periods, timelines, and summaries as reproducible projections of the governed event log.
1 mechanism · View full solution archetype
- Projection Rebuild and Diff — Rebuilds a projection from the log and diffs it against the live view, treating any disagreement as evidence the view is wrong, never the log.
Evidence-Grounded Persona Proxy Design¶
Turn complex user or stakeholder evidence into a memorable persona proxy while preserving the boundary, provenance, uncertainty, and refresh rules that keep the proxy honest.
2 mechanisms · View full solution archetype
- Counterpersona Review — Introduces contrasting or edge-case personas to expose failures hidden by the central proxy.
- Representativeness Review Checklist — Checks sampling coverage, selection bias, salience bias, stereotype risk, and overgeneralization before use.
Exhaustive Disjoint Partition Design¶
Turn a whole into named blocks that cover everything once and only once.
4 mechanisms · View full solution archetype
- Coverage Gap Audit — Reconciles what is actually assigned against the declared universe to surface the units that fall into no block — the exhaustiveness half of the partition promise, checked against real data.
- Overlap Detection Join — Joins a partition against itself to surface every unit assigned to two or more blocks — the disjointness invariant turned into a query that should return zero rows.
- Partition Refinement/Coarsening Review — Periodically re-decides block granularity — splitting blocks that hide distinct cases and merging blocks too thin to matter — while keeping the partition mutually exclusive and exhaustive.
- Stratified Partition Sampling Check — Certifies that a partition is safe to use as sampling strata — every unit in exactly one stratum and the strata covering the whole frame — before any estimate is drawn from it.
Formal Derivation System Design¶
Turn reasoning into an explicit symbolic machine by fixing symbols, well-formedness rules, axioms, inference rules, and derivation checks.
3 mechanisms · View full solution archetype
- Mechanical Proof Checker — Independently re-checks a supplied derivation step by step against the rules and returns a pass/fail verdict plus a certificate that the conclusion lies inside the system's closure.
- Metatheory Review Checklist — A structured human review that interrogates the whole formal system for its meta-properties — soundness, completeness, decidability — and polices the line between formal derivability and real-world truth.
- Well-Formedness Linter — Mechanically scans candidate expressions and flags every one that violates the declared grammar, before it can enter derivation.
Generated Span Closure Design¶
Declare the primitives and allowed operations, then make the whole generated possibility space explicit and auditable.
2 mechanisms · View full solution archetype
- Basis Sensitivity Review — Swaps the generator set and compares the resulting spans, exposing which downstream claims are robust to basis choice and which are not.
- Span Membership Certificate — For a specific target, exhibits an explicit generator combination that produces it — a checkable witness that it really is reachable.
Gestalt Grouping Design¶
Arrange information so people perceive the intended groups, relationships, boundaries, and continuities.
2 mechanisms · View full solution archetype
- Dashboard Layout Review — Reviews dashboard panels, charts, alerts, and labels so operational relationships and priorities are perceived correctly.
- Grouping Audit Checklist — Guides reviewers through intended grouping, cue consistency, false grouping, closure risk, and accessibility checks.
Grammar-Guided Structure Recovery¶
Recover the nested structure carried by a flat sequence by binding the input to a grammar, preserving spans, retaining competing parses when needed, and validating the selected hierarchy.
1 mechanism · View full solution archetype
- Semantic Schema Validation — Checks a recovered structure against a versioned semantic schema — not whether it parsed, but whether it means something admissible — and records a version-tagged conformance audit.
Implicit Assumption Surfacing¶
Make hidden assumptions explicit so they can be tested, revised, documented, or deliberately preserved.
2 mechanisms · View full solution archetype
- Design Critique — A critique session that surfaces assumptions embedded in a design choice or user model.
- Red-Team Assumption Review — Challenges assumptions from a skeptical or adversarial perspective.
Implicit Bias in Knowledge Structure¶
Audit how hidden assumptions in categories, schemas, or mental models bias what is noticed, valued, or ignored.
5 mechanisms · View full solution archetype
- Bias Review Checklist — A fixed, reusable set of prompts that lets any maintainer screen a knowledge structure for hidden bias in a single pass and decide whether a deeper review is warranted.
- Category Impact Assessment — Traces, for each category choice, how it changes concrete downstream decisions — eligibility, ranking, routing, funding — and who holds the authority those choices feed.
- Inclusive Classification Review — Reviews a classification with the affected groups themselves, asking whether each can see itself accurately, safely, and without stigma in the categories.
- Stakeholder Category Review — Convenes maintainers and affected users around concrete categories to adjudicate changes together, producing either revisions or a recorded reason they were declined.
- Taxonomy Bias Audit — A deep, evidence-driven investigation of a single taxonomy — its labels, residual buckets, and missing distinctions — that traces how its category choices shape downstream outcomes.
Incompatible Requirement Set Resolution¶
When individually defensible commitments cannot all hold together, prove and localize the incompatibility, choose the smallest legitimate relaxation, and publish the guarantees and losses that remain.
1 mechanism · View full solution archetype
- Impossibility-Theorem Instantiation Review — Checks whether the requirement set is a disguised instance of an already-proven impossibility theorem, so a known 'you cannot have all of these at once' result settles the conflict without a fresh search.
Independent Generating Set Design¶
Define the space and combination rules, then choose the smallest independent set of generators that covers it completely and yields stable, unique, transformable coordinates.
1 mechanism · View full solution archetype
- Experimental Design-Matrix Rank Check — Checks the design matrix of a planned experiment for full rank before any data is collected, so every effect of interest can be estimated separately rather than confounded.
Independent Generator Validation¶
Keep a generator set honest by testing whether every retained member contributes a direction, signal, or degree of freedom that the others cannot reproduce.
2 mechanisms · View full solution archetype
- Independent-Axis Design Review — Checks a proposed set of design axes for hidden redundancy before anything is built, so every retained axis contributes a control direction the others cannot reproduce.
- Variance-Inflation Review — Audits a fitted model for collinearity by scoring how much each candidate's redundancy inflates the variance of its estimated effect, flagging the ones that make attribution untrustworthy.
Inductive Validity Extension¶
Validate that a rule, guarantee, or process that works in a base case continues to hold as it extends step by step, recursively, or at larger scale.
5 mechanisms · View full solution archetype
- Recursive Decomposition Check — Checks that repeatedly decomposed subproblems preserve the assumptions needed to recombine results or continue decomposition safely.
- Recursive Process Validation — Checks that a repeated or self-referential process preserves required properties each time it calls, repeats, delegates, or extends itself.
- Scalable Policy Rule Audit — Reviews whether a policy rule that works in the base population or initial jurisdiction remains valid as cases, exceptions, or administrative load increase.
- Staged Rollout Validation — Validates that a policy, service, product, or process continues to satisfy its guarantee as it expands from pilot to later stages.
- Training Progression Validation — Checks that each step in a learning or skill progression prepares for the next step without losing the core capability being extended.
Informal Structure Mapping¶
Reveal the unofficial relationships, workarounds, and influence paths that determine how work actually gets done.
2 mechanisms · View full solution archetype
- Shadow Process Audit — Takes the documented procedure as an audit baseline and systematically hunts for undocumented steps, bypasses, exception routes, and unofficial approvals, then diagnoses why each exists.
- Workaround Review — A recurring review that takes the inventory of repeated workarounds and, for each, classifies it and decides a disposition: support, replace, formalize, or retire.
Material Literalness Foregrounding¶
Foreground the literal material or medium of a thing by suppressing decorative, symbolic, and illusionistic cues that would make the viewer treat it as something else.
1 mechanism · View full solution archetype
- Unskinned Prototype Review — Reviews an object, interface, or system before cosmetic skinning so teams can inspect structure, affordances, and material constraints directly.
Mental Model Mismatch Repair¶
Detect and repair mismatches between a person's mental model and how the system actually behaves.
1 mechanism · View full solution archetype
- Incident Mental-Model Review — Reconstructs what operators believed during a real failure, infers what the system actually did from triangulated traces, and diagnoses why the two diverged.
Meta-Symbolic Rule Reflection¶
Examine and revise the symbol system, categories, or rules used for reasoning rather than only applying them.
4 mechanisms · View full solution archetype
- Category Boundary Audit — Tests a category system at its edges — running the borderline, excluded, and anomalous cases against each line to find where the boundary itself, not the classifier's judgment, is drawn wrong.
- Governance Rule Review — Reviews the decision rules, eligibility definitions, and authority categories of an institution for whether they are producing distorted or illegitimate outcomes — and owns the governance of any change.
- Language / Rule Critique — Examines how a durable vocabulary — its terms, labels, and definitions — quietly makes some interpretations easy to reach and others hard to express.
- Paradigm Review — Inspects whether a field's governing worldview or explanatory model still supports reliable reasoning — and turns the doubt into a testable revision proposal rather than rhetoric.
Metric-Space Specification and Validation¶
Turn vague closeness into a validated distance function before using near/far relationships to search, cluster, route, threshold, or reason locally.
2 mechanisms · View full solution archetype
- Distance Threshold Review — Turns a raw distance cutoff into a reviewable action boundary, checking what the threshold means and when it must be redrawn.
- Domain Expert Calibration Panel — Convenes domain experts to judge which pairs are genuinely near or far, calibrating the metric's semantics against human expertise.
Negative Space as Structural Element¶
When more marks would weaken perception, make the unmarked field do structural work: separate, balance, emphasize, calm, and organize what remains.
1 mechanism · View full solution archetype
- Affordance Preservation Check — The validation gate that confirms a reduced design still affords action, keeps required context, scales without collapse, and reads correctly for its audience — before sparseness ships.
Network Motif and Pattern Discovery¶
Discover functionally meaningful recurring local graph structures by comparing observed subgraphs to suitable baselines.
1 mechanism · View full solution archetype
- Domain Expert Motif Review — Convenes domain specialists to walk representative motif instances and judge whether the graph's construction and the pattern's meaning hold up before any motif claim is trusted.
Ontology Clarification¶
Clarify what entities, categories, and relations exist in the problem domain before designing, deciding, measuring, or governing.
1 mechanism · View full solution archetype
- Ontology Review Workshop — Brings relevant actors together to compare entity assumptions, category meanings, relation claims, edge cases, and revision rules.
Other-Agent State Model Calibration¶
Model another agent as having its own partial knowledge, goals, attention, constraints, and interpretations, then update that model from evidence before routing action through it.
4 mechanisms · View full solution archetype
- Consent and Privacy Boundary Checklist — Gates whether it is legitimate to build, keep, share, and act on a model of another agent's private state — before the model is used, not after.
- Counterparty Model Red Team — Attacks a working model of a strategic counterparty by manufacturing rival explanations for their motives, constraints, and moves, to break the single story the actor has settled on.
- False-Belief Check — Tests the single assumption that the other agent knows what you know — catching curse-of-knowledge errors before they distort an explanation, interface, or instruction.
- Interaction After-Action Review — A recurring retrospective that asks where the model of the other agent helped, failed, surprised, or harmed — and rewrites the interaction rules accordingly.
Overlap Exclusion Design¶
Declare which collections must not share members, then make that absence of overlap testable, maintained, and safe to rely on.
3 mechanisms · View full solution archetype
- Holdout Leakage Test — Tests a train/evaluation split for hidden shared cases — exact duplicates, near-duplicates, and label-carrying features — so a reported score reflects generalization instead of memorized overlap.
- Pairwise Intersection Audit — Certifies disjointness by computing every collection pair's intersection under a fixed identity rule and confirming each one is empty — turning 'they don't overlap' from a claim into a checked result.
- Segregation-of-Duties Check — Reconciles who holds which duties against a matrix of incompatible role pairs, detecting any single actor who has accumulated two conflicting responsibilities that must never rest with one person.
Patchwise Global Certification¶
Promote local checks to a global verdict only when the cover, witnesses, seam compatibility, and aggregation discipline are explicit.
3 mechanisms · View full solution archetype
- Coverage Completeness Audit — Maps the union of the patches against the declared domain to prove no in-scope region is left unwitnessed, and logs every gap it finds.
- Local Witness Checklist — Defines what counts as valid evidence that the global property holds inside one patch, and records it the same way everywhere, so patch verdicts are comparable.
- Overlap Compatibility Test — Checks that local verdicts agree wherever patches meet, walking the seams in a fixed order, so the boundaries between patches cannot hide a global failure.
Predicate Criterion Formalization¶
Make a vague condition usable by turning it into a domain-bound yes/no test with evidence, edge-case, and review rules.
1 mechanism · View full solution archetype
- Eligibility Criteria Checklist — Turns a qualifying condition into an ordered list of evidence-backed criteria a reviewer applies to one candidate at a time.
Representation Fit Selection¶
Choose the representation that preserves the features needed for the task while minimizing distortion and burden.
1 mechanism · View full solution archetype
- Graph–Table Comparison — Compares whether relational, trend, and pattern perception should be supported by a graph or whether exact lookup and auditability require a table.
Representational Reduction and Formal Abstraction¶
Reduce literal depiction by extracting what must remain and translating it into a controlled vocabulary of form, relation, color, material, rhythm, space, and process.
1 mechanism · View full solution archetype
- Representational Distance Ladder — Orders studies from literal to nonrepresentational and tests where intended invariants remain.
Reversible Operation Structure Design¶
Design the admissible operations of a system as a closed, associative, identity-bearing, invertible structure so composition and reversal stay reliable.
2 mechanisms · View full solution archetype
- Axiom Checklist for Group Structure — A lightweight pass/fail review that walks the four group axioms in order, so a claim of reversible structure is confirmed item by item rather than assumed.
- Homomorphism Check — Verifies that a map between two operation structures preserves composition and identity — so a translation, optimization, or re-representation is provably structure-preserving rather than merely value-matching.
Sacred Boundary Stewardship¶
Define what is set apart, mark its boundary, govern how it may be approached or changed, and provide repair paths when reverence is violated.
1 mechanism · View full solution archetype
- Sacralization Risk Review — Checks whether sacred status is suppressing critique, accountability, or plural access.
Schema Conflict Resolution¶
Resolve conflicts when different schemas classify or interpret the same reality differently.
1 mechanism · View full solution archetype
- Taxonomy Reconciliation Review — Walks two hierarchical or faceted category trees node by node and decides, for each, whether it should be merged, split, translated, or preserved as a distinct branch.
Schema Update Protocol¶
Revise an organizing schema when new evidence no longer fits its categories or assumptions.
1 mechanism · View full solution archetype
- Classification Audit — Samples already-classified items and re-judges them to measure how often the current schema misfits, producing the violating cases and named mismatch that justify a revision.
Shared Subset Intersection Mapping¶
Declare the collections and identity rule, then extract the elements common to all of them as a traceable shared subset.
2 mechanisms · View full solution archetype
- Empty-Result Review Gate — Halts action on an empty or surprisingly small intersection until someone confirms it means true incompatibility rather than a stale source or an over-strict filter.
- Membership-Predicate Audit — Inspects each collection's inclusion rule before any intersection runs, checking that the predicates are documented, compatible, and mean what their labels claim.
Sign–Meaning Alignment¶
Align the form of a sign, label, symbol, or message with the meaning people are intended to take from it.
2 mechanisms · View full solution archetype
- Labeling Audit — Surveys labels across a system to find inconsistent, ambiguous, stale, or misleading sign forms.
- Naming Review — Reviews terms, labels, feature names, program names, or category names for misleading connotations, hidden assumptions, and audience misreadings.
Structural Inversion Design¶
Reverse a declared structure under explicit invariants, recoverability, boundary, and round-trip rules.
2 mechanisms · View full solution archetype
- Inversion Failure-Mode Review — Deliberately hunts a proposed inversion for false symmetry, information loss, nonuniqueness, singularities, semantic drift, and path-dependent harm before it is trusted.
- Reverse-Order Workflow Walkthrough — Walks a process from its finished state back toward its prerequisites, surfacing the hidden state and one-way steps that a forward reading hides.
Structure-Preserving Embedding Design¶
Embed a source system into a richer host so the source remains distinguishable, structurally faithful, and usable inside the host rather than merely translated or compressed.
2 mechanisms · View full solution archetype
- Embedding Collision Probe — Hunts for distinct source items that landed on the same or near-identical host location, exposing the identity collapses that make an embedding quietly merge things that should stay separate.
- Nearest-Neighbor Audit — Samples an embedding's neighborhoods and checks, with human judgement, whether each item's nearest host neighbors are genuinely related in the source — catching false neighbors and missing ones.
Symbol-System Coherence in Visual Art¶
Keep the same visual sign pointing to the same intended meaning unless the work makes the change visible and purposeful.
3 mechanisms · View full solution archetype
- Compositional Semantics Review — Checks whether scale, position, contrast, framing, and relation among symbols support the intended interpretation.
- Cultural Iconography Review — Uses domain, community, or art-historical expertise to identify unintended associations and interpretive conflicts.
- Symbol Collision Checklist — Reviews whether two symbols look too similar, signal incompatible meanings, or compete in the same composition.
Tacit Knowledge Elicitation¶
Draw out expert know-how that is used in practice but not yet articulated.
1 mechanism · View full solution archetype
- Decision Trace Review — Reconstructs an actual decision sequence from the records and artifacts it left behind, then walks the practitioner through the timeline to recover what they knew, and chose, at each step.
Textual Close-Reading Mode¶
Suspend premature paraphrase, inspect the artifact at its meaningful grain, and bind every larger interpretation to exact marks, relations, repetitions, placements, and omissions.
3 mechanisms · View full solution archetype
- Counterreading Stress Review — Builds the strongest rival reading on purpose and makes the favored one either explain the marks it resists or narrow its own claim.
- Omission and Negative-Evidence Audit — Tests whether something absent is meaningfully missing by first establishing why it should have been present, then ruling out innocent explanations for the gap.
- Paraphrase-Difference Test — Holds a finished summary against the evidence map and flags what the compression dropped — modality, exception, speaker, ambiguity, sequence, or relation — before the summary is allowed to stand in for the source.
Universality Extraction¶
Compare heterogeneous cases, vary alleged incidental details, and extract the smallest actionable macro-structure that survives—together with the class and boundaries within which it transfers.
1 mechanism · View full solution archetype
- Red-Team Case Search — Assigns an independent challenge function to find credible cases and interpretations that would break the proposed invariant.
Resource Efficiency & Conservation¶
Solutions that reduce waste, preserve scarce stocks, recover usable value, or improve the useful output obtained from finite resources.
7 mechanisms · View full solution family
- Carnot or Theoretical-Limit Benchmark — Uses an idealized upper bound to separate unavoidable limits from avoidable design losses.
- Cycle Closure Audit — Checks whether the final state really restores the cycle's starting capacity or only passes waste, debt, or degradation to another system.
- Data Lineage Balance Check — Asserts that every step of a data pipeline conserves its records and totals — what enters equals what leaves plus what was intentionally dropped — and flags any hop where the count silently breaks.
- Direct and Indirect Rebound Audit — Traces where an efficiency gain's freed capacity and freed money actually went — same-service demand, cross-category spending, and induced supply — to see how much of the intended saving rebounded.
- Essential-Access Rebound Review — Sorts post-efficiency demand growth into need-closing use that must be protected and low-value use that controls may target, so rebound controls don't cut off the under-served.
- Loss-Sink Audit — Hunts the gap between what should be in the system and what is, tracing the missing quantity to the leak or unmonitored sink absorbing it — and to whoever quietly bears the loss.
- Value-Stream Waste Walk — Follows a repeated process to identify waiting, rework, scrap, handoff loss, and irreversible information or effort loss.
Risk, Robustness & Uncertainty¶
Solutions that make uncertainty explicit, limit downside, preserve acceptable behavior across variation, or prepare contingencies for adverse outcomes.
40 mechanisms · View full solution family
- After-Action Pathway Update — After an incident or near-miss, rebuilds the source-pathway-receptor model to add the route that was actually used and the links that turned out to be cuttable.
- Audit or Attestation — Sends an independent examiner to inspect the claim or system directly and issue a scoped opinion, so belief rests on a competent outsider's findings rather than the sender's say-so.
- Background Check — Retrieves external records of a candidate's documented past — conduct, credit, sanctions, history — to reveal a track record the candidate cannot see or won't disclose.
- Bias Audit — Runs a consequential decision through one structured pass — classify its type, map the few distortion pathways that actually threaten it, deploy only the matching checks, and either revise the process or record the bias risk left standing.
- Blind or Masked Review — Removes identifying or extraneous information — names, sources, affiliations, demographics — from what a reviewer sees, so judgment attaches to the work rather than to who produced it.
- Censoring and Left-Truncation Audit — Reconstructs the failures and delayed entrants missing from a survivor sample, so a persistence forecast is not silently biased by who happened to be observed.
- Common-Mode Dependency Red Team — Attacks a system's claims of diversification by hunting the shared supplier, platform, geography, or assumption that would make nominally independent defenses fail together.
- Confidence Retrospective — Compares past confidence labels against how they actually turned out and repairs the scope map from the pattern of misses.
- Constraint and Incentive Checklist — A lightweight checklist that prompts reviewers to scan for constraints, incentives, access, norms, and environmental conditions.
- Context Reconstruction Interview — A structured interview that recovers the actor's constraints, information, pressures, options, and interpretation at the time of behavior.
- Contingency Buffer Review — Converts ranked failure causes into right-sized schedule, budget, and scope buffers, anchored on how much slack comparable efforts actually needed.
- Credential Verification — Confirms with the issuing authority that a claimed qualification is genuine, current, and unrevoked — turning an unverified claim into standing evidence of a hidden competency or authorization.
- Decision Checklist — A short, decision-specific list of the few bias checks worth running here, phrased as prompts a reviewer answers before closing — kept deliberately brief so it actually gets used.
- Defensive Design Review — A structured, adversarial walk-through of a design that hunts for fragile assumptions, unnamed stress dimensions, and hidden reliance on ideal behavior — flagging where margin is missing before anything ships.
- Design Review — A milestone gate where a proposed design is presented and challenged for failure paths, and cleared to proceed only once each serious weakness carries an assigned, owned mitigation that changes the design.
- Diagnostic Debiasing Check — A structured challenge to a favored explanation — force the alternative, seek what would disconfirm it, and re-examine confidence — matched to the known ways expert diagnosis goes wrong and calibrated over time against outcomes.
- Equity Impact Review — Reviews who gets helped and who is left exposed when effort concentrates on the statistical hotspots, so hardening does not quietly abandon the already-disadvantaged.
- Failure Scenario Review — A structured walkthrough of a single failure as a story — the mode, the chain of causes that triggers it, and the cascade of effects it produces across time, actors, and dependencies.
- Field or Operator Ground-Truth Walkthrough — Takes the mapped hotspot to the actual site and checks it against what the people who work there already know.
- Field Report Review — Reads periodic reports from distributed sites to surface cross-site patterns, exceptions, and emerging constraints.
- Hiring Review Rubric — Fixes the criteria, weights, and anchored rating scales a hiring decision will be judged on before candidates are seen, so every applicant is scored on the same job-relevant dimensions instead of on gut fit.
- Incident and Near-Miss Review — Reconstructs dangerous incidents and the close calls that almost became them to expose the hidden pathways and perverse incentives behind them, then converts each finding into a concrete control or payoff change.
- Incident Timeline Review — A chronological reconstruction of events, cues, handoffs, decisions, and pressures before a behavior or failure.
- Multiple-Testing Holdout Check — Re-tests a discovered hotspot on held-out data before anyone acts, so a cell that is only the worst of a thousand comparisons is not mistaken for a real one.
- Performance Context Review — A performance-evaluation workflow that checks role clarity, workload, resources, tools, and feedback history before final judgment.
- Policy Exception Review — A governance review that checks notice, feasibility, access, rule design, and enforcement context before deciding how to respond to noncompliance.
- Post-Incident Recurrence Review — After an occurrence actually happens, makes affected parties whole and traces the shared root cause so the same event cannot recur the same way.
- Post-Shock Boundary and Rebuild Review — After the shock, decides in stages what to restore, redesign, or retire — and extracts structural lessons while resisting the tidy single-cause story hindsight wants to tell.
- Post-Surprise After-Action Review — Reconstructs decisions, assumption failures, equity effects, workarounds, and capability changes.
- Public–Private Message Reconciliation — Audits public statements, private commitments, operator instructions, and automated rules side by side for the contradictions that make the other side misread intent — the self-inflicted mixed signals that turn a standoff into an accident.
- Red-Team Failure Review — Hands the plan to an independent, adversarial reviewer whose job is to find how it fails, free of the insiders' stake in its success.
- Red-Team Verification Review — An independent adversary stress-tests the de-escalation plan and the safety case — hunting the failure modes, hidden triggers, and unsupported assumptions the people inside can no longer see.
- Reference Check — Elicits testimony from people who have worked with a candidate to reveal patterns of past behavior, reading each account against the referee's own bias and reach.
- Residual Hotspot Exception Review — Formally reviews the hotspots that cannot be fully fixed and signs off the leftover risk — with compensating controls and an expiry — instead of letting it hide.
- Risk Migration Review — Checks, after a control goes in, whether the hazard actually fell or merely moved — to a substitute route, downstream, or onto a more vulnerable population.
- Safety Case — A structured, evidence-backed argument that a system is acceptably safe to operate in a defined context — stating the safety claim, citing the controls and evidence behind it, and judging the residual risk acceptable, valid only until the context changes.
- Stress-Test Scorecard — A one-page verdict sheet that consumes the results of the stress tests and gives each key assumption a confidence grade, a reversibility flag, and a disposition — safeguarded, monitored, or knowingly accepted.
- Structured Interview — Asks every candidate the same pre-set questions and scores answers against a fixed rubric, so live judgment becomes comparable and less prone to bias.
- Transfer Assumption Review — Makes the leap from a source domain to a target domain explicit and tests, assumption by assumption, whether the warrant actually carries.
- Underwriting Assessment — Gathers targeted evidence about a specific applicant's hidden risk, classifies them into a risk type, and routes to accept-at-a-price, refer, or decline.
Scaling & Capacity¶
Solutions that match capability to load, grow or shrink safely, and manage how structure and performance change with size.
25 mechanisms · View full solution family
- Adversarial Birthday-Attack Review — A defensive review that asks whether an attacker could deliberately force a collision — which arrives near the square root of the space, not at the accidental rate — and weighs the damage if they do.
- Assimilation Capacity Audit — Measures how much of a beneficial input the receiving system can actually absorb per period, turning an assumed ceiling into a scoped, evidenced number.
- Asymptotic Claim Review — A review protocol for claims that invoke long-run, at-scale, or limiting behavior.
- Common-Mode Dependency Audit — Traces whether a system's nominally independent alternatives actually converge on the same upstream provider, region, credential, owner, or trigger — turning "we have three suppliers" into "we have one shared failure point wearing three names."
- Community Ground-Truthing Review — Puts the analysts' vulnerability classification in front of the people it describes, so lived experience can correct mis-scored factors and flag interventions that would quietly shift the burden onto them.
- Coordination Load Audit — A point-in-time investigation that inventories every coordination scaffold on an activity, measures the burden it consumes, flags recursion, and computes what value it actually returns.
- Displacement and Access Impact Review — Assesses who gets displaced, priced out, crowded, or excluded by an internal-growth move, disaggregated by group, and whether the mitigations actually restore their legitimate access.
- Duplicate Detection Audit — Periodically sweeps assigned identifiers against a uniqueness registry to find and resolve duplicates that have already slipped in, rather than preventing them at assignment time.
- Expansion Debt Review — A periodic audit that tallies the accumulated hidden debt — support, supervision, escalation, and learning — that fast expansion has quietly borrowed against the backbone.
- Governance Maturity Check — Grades whether the organization's decision rights, oversight, audit, escalation, and external accountability are strong enough to govern the next scale before that scale is authorized.
- Ground-Penetrating or Deep Inspection — Directly probes the hidden support layer — scanning beneath the surface or opening it up — to read substrate condition the intact surface will never reveal.
- Hash Collision Risk Assessment — Assesses whether a hash or truncated digest is wide enough for its job by pairing its effective collision probability with the severity of a collision in that use.
- Marginal Net-Benefit Review — Periodically re-checks whether the last increment of input still pays its way, resetting how much margin to keep below the inversion point and recalibrating the ceiling as realized data arrives.
- Namespace Entropy Review — Audits whether a namespace's identifiers carry as much real randomness as their length implies, and whether draws are actually independent — the assumptions every collision estimate silently rests on.
- Near-Miss Substrate Review — Treats every survived incident as substrate evidence, mining near misses to update the support map before the next shock lands harder.
- Occupancy and Idle-Capacity Audit — Counts the capacity you already own but aren't using — position by position — by measuring the gap between what a system nominally holds and what it effectively delivers.
- Plateau Review Cadence — A standing review at a fixed interval where a team looks at each active path and decides to keep escalating, gather more evidence, or switch — so plateau calls happen on schedule, not only in a crisis.
- Portability Checklist — A standing list of the concrete things — data, contracts, interfaces, credentials, skills, runbooks — that must be movable before an alternative provider counts as real rather than nominal.
- Post-Gradient Re-Equilibration Review — Assesses whether the system exited into a viable state, what costs were dissipated, and which guardrails need revision.
- Post-Inversion After-Action Review — After an input has actually crossed into harm, reconstructs the episode to recalibrate the ceiling and the exit threshold — turning a real overshoot into corrected guard settings.
- Reserve and Slack Audit — A point-in-time count of how much reserve and slack actually remains in each support layer, measured against the level ordinary load requires.
- Sensitivity Driver Rubric — A standardized scorecard that rates one lever — sensitivity — by its underlying drivers, so 'they're more fragile' becomes a set of scored, comparable reasons with confidence attached.
- Site Readiness Assessment — Requires each new location to demonstrate its own local readiness against tier-calibrated criteria before it opens, so no site inherits approval from the pilot instead of earning it.
- Slack-Erosion Test — Checks whether an intensification proposal pushes protected slack — maintenance, recovery, surge, safety, or redundancy reserves — below an explicit floor.
- Support Line Postmortem — After a support line buckles or a front culminates badly, reconstructs why the reach outran the sustainment and files the failure as a reusable scenario.
Scheduling & Pacing¶
Solutions that choose timing, cadence, duration, rate, or work-in-progress so demand and action remain temporally compatible.
8 mechanisms · View full solution family
- After-Action Gain Harvest — Turns a finished stress episode into retained capacity by debriefing it, recording what actually improved, and setting the dose that keeps the gain from fading.
- Cadence Reset Retrospective — After a high-tempo interval, reconstructs what was answered, ignored, accelerated, or slowed — and rewrites the decoupling design before the next surge.
- Critical Juncture Review — A go/no-go screen that confirms a live moment is actually a critical juncture — high leverage, genuinely divergent paths, credible lock-in — and rules who is authorized to steward it.
- Post-Juncture Commitment Audit — After the juncture has passed, checks whether the chosen path is still legitimate, still as reversible as was promised, and still aligned with the reasons it was selected — catching silent drift into unintended lock-in.
- Pre/Post Capacity Assessment — Measures capacity before and after a conditioning block — including a delayed transfer test — so real durable gains are separated from momentary performance.
- Recruitment-Failure Postmortem — After a cohort comes in weak, reconstructs the early conditions that caused it and feeds the lesson into a standing review of replenishment policy, so the same window failure is not repeated cohort after cohort.
- Recurring Inspection — Checks readiness, quality, or compliance on a repeating schedule whose frequency scales with risk, producing a verdict that catches problems before they compound.
- Weekly Review — A recurring personal audit of commitments and open loops that catches what is slipping and updates the plan, keeping the whole system trustworthy week to week.
Selection & Filtering¶
Solutions that admit, retain, rank, or reject candidates according to fitness, relevance, quality, or another discriminating rule.
17 mechanisms · View full solution family
- Bus Factor Review — Finds every capability that rides on one irreplaceable person and turns each into a funded plan for redundancy before that person walks.
- Bycatch Audit — Examines non-target capture or collateral burden that ordinary success metrics ignore.
- Common-Mode Escape Review — Tests whether nominally independent barriers would actually fail together — against the same feature, data gap, assumption, or context — so apparent defense-in-depth is not a single point of failure wearing several hats.
- Cross-Boundary Escape Incident Review — Investigates an apparent escape event across teams or jurisdictions to establish whether it is real selection-driven circumvention or an impostor — migration, a protected refuge, an implementation failure, or measurement drift.
- Environmental Shift Retest — When the environment moves, re-runs the selection test on the variants that already won — checking whether they are still the fittest, and whether the fitness proxy still tracks reality — so the loop stops rewarding champions selected for a world that no longer exists.
- False-Capture Audit — An arm's-length review that samples what the selector actually caught, sorts true target from non-target, and reports a false-capture rate the operator can't self-certify away.
- False-Window Audit — A retrospective review of false openings and missed windows that recalibrates the readiness indicators and opening threshold for next time.
- Fitness Proxy Audit — Audits what your barrier and its metrics actually reward for surviving — exposing proxies that let an escape variant look 'handled' precisely because it has become harder to see.
- Generation Cadence Review — Checks whether the selection loop is turning at the right tempo — fast enough to adapt, slow enough that each generation is judged on signal rather than noise — and re-sizes the generation unit, coupled to the variation supply, when it is not.
- Over-Specialization Audit — Asks whether roles have been sliced too thin, measuring specialization intensity and the entrenched status it breeds against the flexibility being lost.
- Post-Window Consolidation Review — A recurring review after the window closes that locks temporary uptake into durable form so the substrate's new state does not revert.
- Ritual or Status Sign Review — Reviews whether a ceremonial gesture, marker, or status object carries meaning by resemblance, indication, convention, or layered social signal.
- Source-Pressure Reduction Review — Looks for ways to shrink the underlying demand, opportunity, or payoff that keeps generating escape pressure — so protection leans less on an ever-stronger filter that only breeds fitter survivors.
- Specialist-Generalist Portfolio Review — A periodic review of the whole workforce as a portfolio — how intensely specialised it has become and how status and power have concentrated across niches — to judge whether the balance still fits demand.
- Underwriting Review — Investigates and estimates an individual applicant's hidden risk against the pool's viability target before exposure is accepted, collecting only the evidence the risk decision actually needs.
- Warning Sign-Type Review — Reviews whether a hazard sign should carry its meaning by resemblance, indication, learned code, text, or redundant layers, weighted by risk.
- Window-Fit Checklist — A per-action check that the intervention's form, intensity, pace, and support match what the substrate can absorb in its current window phase.
State & Transition Management¶
Solutions that define valid states, govern transitions among them, preserve transition history, and prevent ambiguous or illegal mode changes.
1 mechanism · View full solution family
- Documentation Maintenance Review — Reviews instructions, runbooks, and decision records on a schedule so knowledge artifacts are caught and refreshed before they quietly rot into misinformation.
Substitution & Fallback¶
Solutions that replace unavailable or unsuitable means with alternatives while preserving the essential function, contract, or outcome.
6 mechanisms · View full solution family
- Channel Saturation Review — Reviews whether a communication, sales, service, or delivery channel has reached declining incremental response and should be supplemented.
- Fairness or Bias Audit — Checks whether optimization disproportionately burdens groups, hides inequity, or shifts harm to less visible stakeholders.
- KPI Governance Review — Reviews whether metric optimization is improving the intended purpose or merely increasing a score while damaging quality, equity, trust, or adaptability.
- Procurement Equivalence Review — Adjudicates a specific proposed substitute against the requirement — demanding evidence, applying an approve/reject/escalate boundary, and offering an appeal — before it may be used.
- Reversal Completeness, Residue, and Remedy Audit — After a real return or rehearsal, compares promised against actual restoration, names the residue and who bears it, checks whether funded remedy reached people, and downgrades the classification from what actually happened.
- Support-Fading Checklist — A checklist for removing scaffolds, prompts, coaching, or direct help only after readiness, substitute skill, and fallback criteria are satisfied.
Thresholds & Phase Change¶
Solutions that detect, create, avoid, or govern nonlinear transitions when accumulating conditions cross a consequential boundary.
33 mechanisms · View full solution family
- Adaptive Zoning Review — The periodic decision point that reads how the zone has drifted and rules to keep, widen, narrow, reposition, or dissolve it — the zone's steering wheel over time.
- Audit Cycle — Independent, scoped examination of a system against an external standard on a fixed cycle, producing evidence-backed findings and tracked remediation owners rather than fixing anything itself.
- Calibration Check — Compares an instrument's reading against a traceable reference standard at intervals set by its drift rate, and adjusts it back into alignment when the error exceeds tolerance.
- Calibration Curve Review — Checks whether a score's predicted probabilities still match observed frequencies before anyone moves the threshold that sits on it.
- Classification Markedness Audit — Takes a taxonomy's categories as given and traces how its default/special marking drives routing, reporting, and treatment, then restructures the categories and monitors that the asymmetry doesn't creep back.
- Clinical Discharge Readiness Check — A bedside check of whether a patient is stable and supported enough to move to a lower level of care — judged from clinical evidence rather than a target date, sometimes rehearsed with a trial pass, and confirmed by watching how they do afterward.
- Composition-Partition Assay — Measures how the constituents actually distributed among the separated phases, turning a demixing into purity, recovery, and residual numbers.
- Data Quality Recertification — Requires the named owner of each data asset, definition, or access grant to re-affirm on a cycle that it still meets standard; anything left un-attested is revoked or quarantined by default.
- Default Label Review — Finds the unlabeled or 'standard' default buried in settings, options, and interface states, makes that baseline an explicitly named choice, and tells users the default now has a name.
- Diagnostic Cutoff Revision — Revises a clinical or screening cutoff when the population, the assay, or the consequence of a call has changed enough to move the right dividing line.
- Eligibility Threshold Review — Re-examines a cutoff that decides who is in or out of a benefit, service, or protection, so the line still serves its purpose and treats groups fairly.
- Financial Reconciliation — Matches two independent records of the same money against each other on a cycle, itemizes every discrepancy, and clears each one until the two balances agree and are documented.
- Health Checkup — Screens a whole living system's vital signs against age- and role-appropriate norms on a recurring schedule to catch developing problems early, referring anything abnormal to deeper diagnosis.
- Inclusive Language Markedness Review — Applies the marked/default lens to language that shapes belonging and stigma — flagging which groups must be named as departures from an unstated human norm, what status that assigns, and who bears the cost.
- Inhibitor and Poison Screen — Tests incoming cases and operating conditions for the contaminants, conflicts, and incompatibilities that would suppress or corrupt the facilitator — catching them before they reach it.
- Iterative Design Review Cycle — Drives a design toward release-readiness by judging each version against a fixed acceptance brief and test evidence, applying revision rules until reviews stop surfacing severe problems.
- Market and Competitor Scan — Surveys candidate entry zones, incumbents, access barriers, and unmet needs before a foothold is chosen, so the pick rests on where a position can actually be held rather than where entry merely looks easy.
- Maturity Model Guidance — Implements the archetype by tying recommended practices to capability maturity stages rather than recommending the same practice to every organization.
- Migration Readiness Assessment — A pre-stage go/no-go check that a tested fallback exists and every continuity provision is in place, so a cohort commits to moving only when it could still safely turn back.
- Naming Markedness Audit — Reads the literal wording of parallel labels and headings to catch the one case left bare while its counterparts carry a qualifier, and names the norm that bareness assumes.
- Operational Readiness Review — Checks whether the receiving operation can actually run, support, watch, and recover the new state in production — staffing, runbooks, monitoring, and a tested rollback — before it is switched on.
- Phase-Gate Review — A recurring gate between program phases that names the next state, fixes the criteria for entering it, and checks whether current conditions actually clear that bar before work is allowed to advance.
- Policy Drift Review — Audits how a policy is actually being implemented in the field against its stated intent, using independent evidence, and escalates the gap to the policy owner.
- Policy Review — Re-examines a standing rule against the reality it now governs and revises, renews, or retires it — resetting the reference itself rather than restoring the world to it.
- Post-Burst After-Action Review — After the spike passes, reconstructs what triggered it and how absorption actually performed, surfaces the hidden backlog and recovery debt it left, and feeds sharper thresholds and burst profiles into the next round.
- Post-Episode Evidence Review — Reviews captured evidence soon after the episode while context is still recoverable and corrective action is still timely.
- Project Drift Correction Review — Periodically compares a project's current work against its own charter, scope, and decision record to tell disciplined adaptation apart from unjustified drift — and resets scope when it has drifted.
- Quarterly Business Review — A recurring executive review of performance against targets across a portfolio, where an accountable owner explains variance, decisions reallocate resources, and off-track bets are escalated.
- Reentry Gate Review — A go/no-go review that lets growth or normal operation resume only on evidence that the secondary resource, the sinks, critical functions, and the original driver have all actually recovered.
- Search and Documentation Scan — Sweeps a whole corpus of artifacts to quantify how often a baseline is silently assumed, so the audit rests on breadth of evidence rather than a single anecdotal label.
- Sink Capacity Audit — Verifies that every receiving system — treatment plant, court, landfill, labor market, balance sheet — can actually absorb the planned drawdown without hidden overload, unfair burden-dumping, or delayed failure.
- Spot Check — A short, bounded inspection of selected cases or moments used to catch intermittent defects, lapses, or state changes without monitoring everything continuously.
- Staged Expansion Review — A recurring deliberative forum that weighs the evidence for each expansion stage, names who is accountable for it, and checks whether real support capacity exists before authorizing the move.
Tradeoffs & Decision Support¶
Solutions that expose competing objectives, preference structure, stopping rules, and consequences so a choice can be made under constraint.
30 mechanisms · View full solution family
- Actionability-Filter After-Action Review — Runs a post-outcome review that turns a regret into a durable rule change only when the lesson is both controllable and recurring — otherwise it routes the regret to closure.
- Adaptive Policy Review Cycle — A recurring governance loop that compares observed outcomes against the policy's assumed transitions and fires a revision when the two drift apart.
- After-Action Learning Harvest — Converts what an exposure episode revealed into retained lessons, design changes, and updated playbooks — before the memory fades and the gain is lost.
- Boundary Permeability Scorecard — Rates, boundary by boundary, how easily a signal will cross from its intended audience to each adjacent one, and flags the sieve.
- Bubble and Lock-In Red Team — Attacks a claimed flywheel to expose where its growth is speculative froth and where its concentration has become dangerously fragile — before the story is believed.
- Choice Architecture Confound Audit — Inspects the real choice environment — defaults, ordering, layout, friction — for the presentation features that could have shaped a choice, so preference is not read off a decision the interface made.
- Compliance Threshold Check — A pass/fail test that verifies a decision meets codified legal, contractual, or policy minima before it is approved, so nothing advances that would breach an external floor.
- Compounding Curve Review — Reads the shape of the marginal-return curve across successive increments to tell a still-improving flywheel from one that has quietly flattened or begun to reverse.
- Cost–Benefit Assessment Protocol — Weighs a proposed distortion repair on full welfare terms — surplus recovered, who gains and loses, and how robust the case is — instead of accepting 'it costs less' as proof it is better.
- Counterfactual Plausibility Screen — Tests whether the 'better' path you are regretting was actually available, feasible, and knowable at the decision point — passing only credible alternatives and rejecting hindsight fantasy.
- Distortion-Reduction Review — The intake diagnostic: locates the wedge blocking beneficial activity, separates the genuinely wasteful part from the part that protects something, and sizes the recoverable loss.
- Dominance Violation Scan — Flags any single choice where an available option was at least as good on every attribute and strictly better on one — a selection no coherent preference should make.
- Equity Access Impact Review — Interrogates a demand model to check whether it is measuring genuine value or merely unequal ability to bear cost, and guards the access of those it would price out.
- Ethical Guardrail Review — A convened human review, triggered when a decision may sacrifice a protected ethical value — fairness, dignity, privacy, accountability — that no numeric threshold can adequately capture.
- Ethical Preference Inference Review — Governs whether inferring and acting on someone's revealed preferences is permissible — checking consent, the evidence's limits, and whether the use exploits rather than serves the chooser.
- Experience Curve Review — Certifies whether cost or quality is genuinely improving through learning-by-doing as cumulative production grows — and captures the lessons that drive it — separating a real experience effect from ordinary scale or price moves.
- Managed Retreat Trigger Review — Sets evidence-based retreat triggers in advance and reviews them on a standing cadence against the rising hold-cost curve and the reversibility horizon, so withdrawal is decided by proof rather than nerve.
- New Boundary Stabilization Review — Verifies after the move that the new boundary actually holds under real load — capacity, defenses, funding, and governance in place — before the retreat is declared complete.
- No-Fault Learning Review — A blameless review that rebuilds what was known and reasoned at the decision point and separates controllable choices from bad luck, so people surface information instead of hiding it.
- Post-Decision Calibration Review — Compares forecast, confidence, process, and outcome to recalibrate future thresholds and methods.
- Quota or Allocation Rule Review — Re-examines a quota, cap, queue, or eligibility formula that is locking high-value uses out or leaving capacity idle, asking whether the allocation can be reopened without losing the rationing purpose it legitimately serves.
- Receiving Boundary Readiness Assessment — Tests whether the receiving boundary is genuinely more defensible and can actually absorb what is being moved to it, before anyone commits to leaving the old position.
- Reversal-Window Check — Locates a regretted decision on the reversibility clock — how much time, lock-in, and switching cost stand between now and a closed exit — and flags when the window to change course is about to shut.
- Robust Policy Design Review — Applies robust selection to a policy rule by checking whether it remains acceptable across populations, states, scenarios, or implementation contexts.
- Scenario Robustness Check — Evaluates each candidate solution against named scenarios and records where it remains acceptable, fails, or requires contingency support.
- Signal Cue Audit — Dissects the signal's explicit and implicit cues to find where a word, number, image, or omission will be read differently by a neighbouring audience.
- Spillover After-Action Review — After a signal event, reconstructs what actually spilled, to whom, through which channel, and updates the permeability model so the next signal is planned better.
- Stakeholder Weight Review Panel — Reviews proposed weights for legitimacy, impact, and acceptability.
- Stress-Tested Plan Review — Reviews a plan or design against adverse but plausible conditions before selecting it for implementation.
- Sunset Clause Review — Attaches an expiry to a rule, fee, or control so it must periodically re-earn its keep — a scheduled re-test of whether the original purpose still justifies the value it costs, with lapse as the default.
Transmission, Propagation & Networks¶
Solutions that shape how signals, behaviors, effects, or resources spread through channels and network topology over space or time.
15 mechanisms · View full solution family
- Artifact Signature Verification — Checks a cryptographic signature over an artifact's exact bytes against a pre-decided trust anchor at the point of use, so it is accepted because it verifies — not because of the channel it arrived through.
- Auxiliary-Prior Review Workshop — Convenes domain experts and adversarial reviewers to enumerate what an outside observer already knows, so a release is judged against real background knowledge rather than in isolation.
- Barrier Gap and Shortcut Audit — An audit that identifies unintended high-permeability paths around containment or intended routing boundaries.
- Channel-Fit Audit — Reviews a channel back-to-front from the receiver's decision, cataloguing the distinctions the payload must preserve and flagging the ones the channel cannot carry.
- Differencing Attack Scan — Checks whether two overlapping releases — aggregates that differ by one record, a before/after refresh, a changed filter — can be subtracted to expose the hidden individual value.
- Interface Condition Checklist — A per-interface checklist of the conditions that must hold at each boundary for propagation to transmit cleanly rather than reflect, leak, or stall.
- Least-Privilege Review — Compares each actor's held permissions against what their current role actually needs, and flags the surplus so access matches necessity.
- Multi-Source Release Corroboration — Accepts a release only when independent observers agree on the same artifact digest, so no single compromised source, signer, or channel can define what 'the release' is.
- Post-Surge Reintegration Check — A follow-up, some time after an emotional surge has passed, that confirms the group's feeling has truly returned to baseline and repairs the relationships the surge strained.
- Provenance Attestation Check — Verifies the signed record of how and where an artifact was built against an expected-provenance policy, so a genuine signature on a maliciously-built artifact still fails.
- Relationship Cleanup Review — A recurring review that judges each relationship, partnership, or commitment on its merits and decides whether to keep, restrict, merge, or end it.
- Slide/Narration Alignment Review — Reviews a paired lead and support channel — speech and slides — to catch where the support upstages, contradicts, or lags the lead.
- Software Bill of Materials Review — Enumerates every component and supplier packed inside an artifact and reviews that inventory, so trust attaches to a known list of parts and origins rather than to an opaque whole.
- Support Lane Checklist — Audits each support channel for exactly one licensed, non-competing job and checks the set as a whole against overload.
- Synthetic or Perturbed Data Validation — Tests a synthetic or perturbed release to confirm it still carries the utility it was made for and does not regenerate or memorize any real protected record.
Variation & Experimentation¶
Solutions that deliberately vary conditions, compare trials, preserve controls, and learn from differential outcomes without overclaiming.
19 mechanisms · View full solution family
- A/B Test Readout — Reads out a controlled A/B experiment — the measured lift, its confidence, and the pre-registered metric — to declare which variant actually won.
- Acceptance Sampling Plan — Inspects a defined sample from a lot and accepts or rejects the whole batch on the result, buying a controlled confidence about conformance without inspecting everything.
- After-Action Review — Turns a just-finished episode into validated lessons by reconstructing what was intended versus what actually happened and deciding which improvised moves earned a place in the repertoire.
- Appeal or Reopening Review — Provides a defined route and a triggering threshold for later evidence to challenge a closure that has already passed the gate, so a false convergence cannot become permanent merely because a decision was once made.
- Balanced-Panel Completeness Check — Assesses whether units have observations across required periods and where missingness threatens comparison.
- Case Selection Bias Audit — Interrogates how the cases were chosen — above all whether they were picked because they already show the outcome — and demands the negative cases the choice left out.
- Completer Balance Table — Lines up the people who stayed against the people who left, covariate by covariate, to show whether the two groups were ever the same population.
- Cross-Basis Consistency Check — Tests whether claims made in one representation remain consistent when transformed or interpreted through the conjugate representation.
- Cumulative Discretion Review — Reviews a whole population of individually-reasonable discretionary decisions as one shared pool of spent latitude, so that many locally-defensible exceptions do not compose into a system-level breach.
- Go/No-Go Gauge — Turns a tolerance into a physical pass/fail check — one end must fit, the other must not — so conformance is decided in seconds without reading a number.
- Measurement Equivalence Audit — Checks that each variable denotes the same construct and is measured the same way in every case before any cross-case difference is trusted.
- Pathway Cohort Comparison — Compares outcomes and burdens across route families to test whether convergence is equivalent and fair.
- Post-Pilot After-Action Review — A structured review of pilot results used to decide retention, adaptation, or retirement.
- Randomization Integrity Audit — A forensic check that the assignment actually recorded in the data matches the intended randomization — right allocation ratio, right sequence, no overrides or broken linkage.
- Schedule Float Stack Review — Treats the slack along a chain of dependent tasks as one shared buffer being consumed by each handoff's slip, and rebalances it before the accumulated delay eats the delivery date.
- Service Deviation Journey Audit — Walks a customer's end-to-end journey across every handoff to measure the deviation the customer actually accumulates, exposing service failures that no single step, each inside its own SLA, would ever reveal.
- Stratified Balance Check — Verifies covariate balance within each stratum, block, cluster, or site — at the true unit of assignment — instead of trusting a pooled comparison that can hide local imbalance.
- Stratified Residual Review — Breaks a stable aggregate into subgroups, residuals, and edge cases to expose the pockets where the system has not actually converged even though the average looks settled.
- Within-Case Process Tracing — Follows the causal chain inside a single case step by step, testing whether the proposed mechanism actually left the traces it should have.