Probe Experiment¶
Method — instantiates Weak Signal Triage
Uses a low-cost reversible action to learn whether an ambiguous signal is real, relevant, or accelerating.
Probe Experiment is a designed, deliberately small and reversible action taken to generate new evidence about an ambiguous signal — converting a question that cannot be answered from the data already in hand into one that can, without committing to a full response. Its defining move is acting in order to learn, at a cost calibrated to how weak the current evidence is: because a probe is cheap and undoable, it can be justified on far thinner evidence than a real commitment. It is the only triage mechanism that does something in the world to move a signal, rather than recording, scoring, sorting, or interpreting what is already known. A probe's whole discipline is proportionality and reversibility — spend little, stay undoable, and pre-commit to how each possible result updates the signal — so that the act of learning never quietly becomes the commitment it was meant to test.
Example¶
A drug-safety team at a pharmaceutical company sees a faint disproportionality signal: slightly more spontaneous reports than expected of a rare liver-enzyme elevation among patients on one of its marketed drugs. It is nowhere near enough to act on — relabeling or warning would be a costly, hard-to-reverse move on weak evidence — but the impact if real is serious enough that ignoring it is not acceptable either. So they design a probe: a bounded, blinded chart review of thirty flagged cases and thirty matched controls. No market action, no public statement, fully reversible, done in three weeks.
The probe asks one narrow question: does the association survive a closer look, or dissolve into confounding — for instance, patients who were already on known liver-stressing co-medications? They pre-commit to the reading before they run it: if the signal survives, its plausibility jumps and the case to escalate is made; if it dissolves, the signal can be retired. The probe converts ambiguity into evidence at a cost proportionate to the confidence that justified it — learning cheaply exactly what could not be learned by staring harder at the existing reports.
How it works¶
- Name the one question. A probe answers a single, decisive question about the signal — is it real, is it relevant, is it accelerating — not "tell us more."
- Design the smallest reversible action that answers it. The probe is the minimal move — an interview set, a data pull, a limited pilot, a tabletop — that produces the missing evidence and can be undone.
- Pre-commit the decision rule. Before running, state how each possible outcome updates the signal, so the probe cannot be reinterpreted after the fact.
- Bound it hard. Fixed time, scope, and spend, with a stopping rule, so a probe stays a probe and does not creep into a de facto commitment.
Tuning parameters¶
- Probe cost and scope — how much to spend and how wide to reach. Bigger probes give cleaner answers but erode the cheapness that justified probing weak evidence at all.
- Reversibility requirement — how strictly the action must be undoable. Insisting on full reversibility keeps optionality but rules out some informative moves.
- Pre-registered decision rule strength — how firmly outcomes are bound to responses in advance. Firm binding blocks post-hoc rationalization but reduces room to use judgment on a surprising result.
- Parallelism — how many probes run at once. More probes resolve a slate of signals faster but compete for the same hands and dilute attention.
When it helps, and when it misleads¶
Its strength is that it buys evidence cheaply on exactly the signals triage struggles with most — too weak to act on, too important to drop — and it preserves optionality by staying reversible, so a wrong guess costs a probe, not a commitment. This is the safe-to-fail posture: a small, undoable experiment run because the outcome is genuinely unknown.[n1]
Its failure mode is probe creep: a "small experiment" that quietly grows scope and spend until it has become the very commitment it was supposed to test, at which point reversibility is gone and the learning framing is a fiction. The mirror misuse is the theatrical probe — one whose result cannot actually change the decision, run to look diligent. The guarding discipline is to pre-commit the decision rule and enforce the bounds: if you cannot say in advance which outcome would make you drop the signal, you are not probing, you are committing.
How it implements the components¶
Probe Experiment fills the active-learning side of the archetype — the one mechanism that acts to move a signal's evidence:
follow_up_probe— it is the bounded information-gathering action: the designed, reversible move that produces the missing evidence.response_cost_assessment— it sizes and caps the probe so its cost and reversibility stay proportionate to the weak evidence that justified it.plausibility_assessment— its result directly updates whether the signal reflects something real versus artifact or confounding.
It does not assign a response_tier or set a review_cadence for new signals — sorting and scheduling intake is the Emerging Issue Triage Board, which typically commissions probes; and it does not apply a retirement_rule to clear standing signals — that is Watchlist Review. The probe produces evidence; others decide and schedule around it.
Related¶
- Instantiates: Weak Signal Triage — the probe is how a signal that is too weak to act on is turned into evidence rather than left to age.
- Consumes: Weak Signal Log supplies the recorded signal the probe is designed to test.
- Sibling mechanisms: Weak Signal Log · Emerging Issue Triage Board · Signal Scoring Rubric · Watchlist Review · Early Warning Forum · Uncertainty Dashboard · Escalation Playbook
Editorial Notes¶
Form Classification¶
Form family: Experiment, Test & Rehearsal
Rationale: Probe Experiment operates as an active test, trial, simulation, drill, or rehearsal that generates evidence through a deliberate attempt or perturbation because it uses a low-cost reversible action to learn whether an ambiguous signal is real, relevant, or accelerating.
Independent corroboration: The frozen evidence defines Probe Experiment as 'Uses a low-cost reversible action to learn whether an ambiguous signal is real, relevant, or accelerating', so its operative form is Experiment, Test & Rehearsal.
Review outcome: Independent reviewer agreement; high confidence.
Origin Attribution¶
Primary origin: Systems Thinking & Cybernetics
Origin pattern: Cross-disciplinary synthesis
Present-day reach: Multi-domain
Rationale: Small reversible probes under ambiguity are characteristic complexity and adaptive-systems practice for learning before committing.
Related originating lineages:
- Engineering & Design — Engineering experimentation supplies bounded interventions, observation, and reversal criteria.
- Futurism & Strategic Foresight — Probe Experiment is most plausibly rooted in the futurism_foresight tradition because its characteristic form depends on weak-signal interpretation, scenario horizons, and future-oriented planning. The assignment tracks that formative lineage, not the many settings in which the mechanism can now be applied.
- Innovation & Entrepreneurship — The innovation_entrepreneurship tradition materially shaped Probe Experiment through its own practice of experimentation, product growth, venture autonomy, and opportunity development.
- Organizational & Management Science — Sensemaking and adaptive-management practice materially shaped safe-to-fail probes for weak signals.
- Statistics & Experimental Design — The statistics_experimental_design tradition materially shaped Probe Experiment through its own practice of probability, calibrated inference, experimental design, and uncertainty analysis.
Review resolution: Light authoritative-source research resolves the primary-origin disagreement in favor of systems cybernetics. Cynefin: Tests for Coherence in Exploratory Safe-to-Fail Probes documents the defining practice, history, or theory described in the selected origin rationale. Other domains are retained only where the blind reviews identify material co-development or translation; broad later application is recorded separately as domain_reach=multi_domain, while origin_mode=cross_disciplinary_synthesis describes the relationship among formative lineages.
Attribution caveat: The blind-review boundary with futurism foresight is substantive: those traditions materially developed, translated, or operationalized part of the mechanism. The cited provenance places its defining lineage in systems cybernetics.
Encyclopedia synthesis: The exact catalogued form synthesizes established practice rather than reproducing a single standard historical label.
Review outcome: Researched adjudication after independent review; high confidence.
Sources consulted:
Notes¶
[n1] Safe-to-fail probe — from Dave Snowden's Cynefin framework, a small, reversible experiment run in a genuinely uncertain situation to learn how the system responds, designed so that a failure is affordable and informative rather than damaging. It is the discipline that keeps a probe a probe: bounded, reversible, and run because the answer is not yet known. ↩