Framing Effect Audit¶
Audit how presentation choices influence perception, judgment, and decision before treating a response or conclusion as stable.
The Diagnostic Story¶
Symptom: Two teams review the same data and reach opposite conclusions, but neither can explain why until someone notices the wording, baseline, or visual display differs. A survey result, dashboard metric, or evaluation changes noticeably after a minor edit, and the original version is being treated as definitive with no acknowledgment that plausible alternatives exist.
Pivot: Identify the presentation variables that could shape interpretation, construct plausible alternate presentations, compare how judgment shifts across them, and evaluate materiality — then redesign, disclose, pluralize, or select the presentation according to an explicit documented rule.
Resolution: Decision makers know which conclusions are stable across frames and which are presentation-sensitive. Downstream users receive disclosure when sensitivity is material, and presentation choices become documented design decisions rather than invisible defaults that smuggle in hidden baselines or value judgments.
Reach for this when you hear…¶
[clinical research] “We reported a 50 percent relative risk reduction — the absolute risk moved from 2 to 1 percent, and a colleague pointed out that framing changed whether the committee funded the trial.”
[public opinion polling] “We ran the same question with estate tax and death tax and got a 20-point gap — before reporting anything we needed to decide which frame people would actually encounter.”
[product analytics] “The dashboard showed strong retention and the VP was happy — I switched the baseline to first-week cohort and the trend reversed, so now we have to decide what the right denominator actually is.”
When This Archetype Applies¶
Complete catalog groundingAt least one sufficient condition set is fully represented by existing primes or domain-specific abstractions.
Diagnostic problem
A decision, survey, dashboard, evaluation, message, or comparison may produce different conclusions because of presentation choices rather than because the underlying situation has changed.
What this problem means
The structural problem is that presentation choices can become hidden causal inputs into judgment. A decision maker may believe they are seeing a stable preference, risk estimate, ranking, or evaluation when they are actually seeing the output of a specific frame. Because presentation feels like packaging rather than substance, its effects are often under-documented.
This creates several risks: a survey can appear to measure public preference when it is partly measuring wording; a dashboard can appear to show priority when it is partly showing baseline choice; an evaluation can appear objective when evidence order or labels shape interpretation; a risk message can appear informative while steering action through gain/loss framing.
Show the applicability expression
Applicability expression2 distinct conditions
groundedpartly groundedopen
2 conditions, all required.
2Required in every casenumbered 1–2
These hold no matter which pattern applies.
Multiple factual framings · grounded
The same facts admit multiple plausible wordings, orders, visualizations, categories, or comparisons.
The source archetype describes the situation as follows: The same facts can be worded, ordered, visualized, categorized, or compared in multiple plausible ways. The normalized requirement above isolates the load-bearing portion used in this condition set.
Framing changes response · grounded
Changes in labels, baselines, defaults, denominators, or emphasis alter interpretation or action while facts stay fixed.
The source archetype describes the situation as follows: Small changes in labels, baselines, defaults, denominators, or visual emphasis may change interpretation or action. The normalized requirement above isolates the load-bearing portion used in this condition set.
Other requirements and context (5)
Why these sit outside the expression
Supporting context — it may accompany or help interpret the situation, but it is not a load-bearing condition in a sufficient diagnostic set.
Supporting contextResponses or decisions will be treated as evidence of preference, risk, priority, performance, fairness, or truth.
Use this archetype when a survey, dashboard, decision aid, evaluation, report, interface, or message will be treated as evidence, yet the response may change if the same information is presented differently. In this archetype, the relevant contextual consideration is: Responses or decisions will be treated as evidence of preference, risk, priority, performance, fairness, or truth. It helps interpret the situation or strengthens the practical case for examining the archetype.
Supporting contextThe actor creating the presentation has an incentive, habit, or blind spot that may make one frame appear natural.
Every presentation makes some aspects salient and others less visible, but decisions often need to know whether the resulting judgment reflects the underlying information or the chosen frame. In this archetype, the relevant contextual consideration is: The actor creating the presentation has an incentive, habit, or blind spot that may make one frame appear natural. It helps interpret the situation or strengthens the practical case for examining the archetype.
Supporting contextThe output will travel to downstream users who may not know that presentation choices shaped the result.
The structural problem is that presentation choices can become hidden causal inputs into judgment. In this archetype, the relevant contextual consideration is: The output will travel to downstream users who may not know that presentation choices shaped the result. It helps interpret the situation or strengthens the practical case for examining the archetype.
Supporting context groundings
The presentation's creator has an incentive that may make one frame appear natural.
domainNative-advertising confusion— Diagnose a media artifact by splitting its content from its channel signal, so the failure becomes a decoupling — editorial-coded layout asserting journalistic provenance over commercially-incentivized content — and credibility tracks the signal, not the disclosure label.
A presentation-shaped output will travel to downstream users who may not know that presentation choices shaped the result.
domainResponsive-Layout Breakage— Diagnose the silent UI failure where an interface's content survives a viewport, device, or locale transformation but its layout-encoded meaning — priority, adjacency, hierarchy, above-the-fold prominence — is lost, so a passing content-accessibility check actively conceals the defect.
domainHARKing (Hypothesizing After the Results are Known)— The research practice of building a hypothesis by inspecting already-collected data and then presenting it as if it had been specified in advance, silently inflating the reported false-positive rate because the test's independence assumption is violated.
domainAgenda Distortion— The structural pattern in which the volume of media attention an issue receives becomes the audience's cue for its importance — even though coverage is allocated by newsworthiness and shareability, criteria that have little to do with actual significance.
Coverage
2 of 2 conditions grounded.
Mechanisms / Implementations¶
- Baseline Reference Swap: Re-expresses the same figure against different baselines, denominators, and comparison classes to reveal how much of a judgment rides on the chosen reference point rather than the underlying quantity.
- Blinded Frame Review: Has reviewers evaluate competing presentations without knowing which one the team prefers or what result each produces, so the frame is chosen on stated criteria rather than on the answer it yields.
- Dashboard Framing Review: Audits a live dashboard's display choices — units, baselines, sort order, default filters, missing denominators — for the ones that steer the operational decisions the dashboard actually drives.
- Gain/Loss Frame Comparison: Presents a logically identical outcome once as a gain and once as a loss, measures how far the reframing moves preference, and decides whether both valences must be shown.
- Order-Effect Check: Reorders the same questions, options, or evidence to test whether sequence alone — not content — moves the conclusion far enough to matter.
- Presentation Sensitivity Table: A single ledger that records every frame variable tested, the shift each one produced, the materiality threshold applied, and the resulting disclosure or redesign decision.
- Survey Frame Split Sample: Randomly assigns respondents to alternate framings of the same question so the response difference between frames can be estimated cleanly, segment by segment.
- Visual Framing Audit: Rebuilds a chart or image with alternate scales, colors, and crops to see how much of the reader's takeaway comes from visual encoding rather than the data.
- Wording Test: A sender-side check that vets a question, notice, or clause before it goes out — asking whether every permitted response would concede the same buried premise, and returning a neutral rewrite when it does.
Related Abstractions¶
Abstractions this archetype builds on — directly (a source ingredient) or as a related pattern. Links follow the typed catalog namespace.
Built directly on (3)
- Framing: Presentation shapes perception.
- Observer Effect: Observation alters system.
- Representation: Model complex ideas.
Also references 5 related abstractions
- Anchoring: Overweight initial info.
- Equivalence Relation: Groups elements into equivalence classes.
- Frame of Reference: Observational perspective.
- Invariance: Properties unchanged under transformation.
- Selection Bias: Skewed sampling.
Variants¶
Narrower or domain-specific specializations that share this archetype's core structure. Recognized variants are established; candidate variants are provisional.
Survey Framing Audit · domain variant · recognized
Audit how question wording, order, labels, response options, and context alter survey responses before interpreting results.
Dashboard Framing Audit · domain variant · recognized
Audit whether a dashboard or decision display steers judgment through defaults, layout, color, units, baselines, sorting, or missing context.
Gain/Loss Framing Audit · affective or cognitive variant · recognized
Audit whether equivalent outcomes produce different judgments when presented as gains, losses, savings, costs, survival, or failure.
Reference-Point Framing Audit · subtype · recognized
Audit whether changing the baseline, comparison group, denominator, or reference point changes the interpretation of the same result.
Risk Communication Frame Audit · domain variant · candidate
Audit whether risk information changes interpretation when presented through absolute risk, relative risk, natural frequency, probability, severity, or uncertainty language.
Editorial Notes¶
Problem Classification¶
Classification: Representation, Classification & Model Misfit → Perspective, Frame, Context & Observer Misfit
Problem kernel: presentation frame changes judgment without changing the underlying situation
Rationale: Survey wording, display order, reference context, and other presentation choices change conclusions even though the underlying situation is unchanged, so one situated frame is mistaken for stable reality. Comparison fidelity is nearer when items or structures are transformed across mismatched scales or viewpoints; this record directly matches the taxonomy cue that presentation frame changes conclusions.
Boundary considered: Representation, Classification & Model Misfit → Comparison, Projection & Mapping Fidelity
Why this classification prevailed: Perspective-frame misfit concerns conclusions changing with observer or presentation context; comparison fidelity concerns systematic distortion introduced while mapping or rendering items for comparison.
Review outcome: Adjudicated after independent review; high confidence.