Dashboard Framing Review¶
Display audit — instantiates Framing Effect Audit
Audits a live dashboard's display choices — units, baselines, sort order, default filters, missing denominators — for the ones that steer the operational decisions the dashboard actually drives.
Dashboard Framing Review treats a working dashboard as an audit object and walks its data-structural display choices — the units on each tile, the baseline a trend is drawn from, the default date filter, the sort order of a ranked list, the denominator that is present or missing. Its defining move is to trace each such choice forward to the specific operational decision the tile drives (which incident to work first, which region to fund) and ask whether that decision would change under an equally defensible display setting. It is not about whether a chart is pretty; it is about whether the arrangement of an interactive, multi-metric surface is silently doing the prioritizing that its users believe they are doing themselves.
Example¶
A SaaS company's customer-support operations dashboard is the screen the on-call lead checks each morning to decide where to send attention. Dashboard Framing Review works down its tiles. The "tickets by team" tile is a raw count sorted descending, so the busiest team is always on top — but there is no denominator, so a team with twice the headcount looks like it is drowning when its per-agent load is average; the review flags that the missing denominator makes two tiles non-comparable. The "resolution time" trend defaults to the last 7 days, which happens to start after a holiday, flattering the current week against an artificially slow baseline. The default filter excludes a "pending-customer" status, so a growing backlog is invisible on the summary view. For each, the review names the display variable, records whether an alternative setting is truly equivalent or changes what is counted, and ties it to the decision at risk: the lead has been triaging by raw volume, not by load, because that is how the tiles were sorted.
How it works¶
- Inventory the display variables. Enumerate the structural choices on each tile — unit, scale baseline, denominator, sort key, default filter, aggregation window — as candidate frame variables rather than fixed properties of "the data."
- Test equivalence tile by tile. For each variable, note whether a defensible alternative setting shows the same thing re-arranged or actually counts something different (a missing denominator, a truncated window). Record which comparisons across tiles are valid and which are not.
- Trace to the decision. For each material display choice, name the specific operational action it steers and whether that action would differ under the alternative setting.
The distinguishing discipline is that it audits an interactive, data-structural surface and grounds every finding in the downstream operational decision — it does not re-render a single graphic for perceptual salience, nor issue a formal claim about the display's neutrality.
Tuning parameters¶
- Tile coverage — every tile or only the ones feeding high-stakes actions. Full coverage is thorough but slow; decision-first coverage focuses effort where a frame effect can actually change an action.
- Alternative-setting spread — how many defensible display settings you test per variable (one obvious alternative versus several). Wider exposes more steering but multiplies the review.
- Default sensitivity — how hard you scrutinize default filters and sort orders, the settings most users never change.[n1] Aggressive scrutiny catches silent steering; lax scrutiny treats defaults as neutral.
- Denominator strictness — whether every count must carry its base. Strict flags more non-comparable tiles; loose tolerates raw counts where the base is well understood.
When it helps, and when it misleads¶
Its strength is catching the frame effects unique to live decision surfaces — a default that no one revisits, a sort order that becomes a priority list, a denominator whose absence turns headcount into apparent crisis — and pinning each to the action it distorts.
It can mislead by cataloguing every display quirk without regard to whether it changes a decision, drowning the load-bearing finding in cosmetic ones; and it can miss steering that lives in the rendering of a single chart rather than in its data structure. The discipline that keeps it honest is to gate each finding on a named downstream decision and to hand perceptual-encoding questions to the audit's visual mechanism rather than absorbing them here.
How it implements the components¶
Dashboard Framing Review realizes the display-audit side of the archetype:
framing_variable_inventory— it enumerates the dashboard's structural display choices (units, baselines, sort, defaults, denominators) as the frame variables in play.equivalence_or_difference_record— it records, per tile, whether an alternative setting is a true re-arrangement or a scope change, flagging non-comparable tiles and missing denominators.downstream_use_context— it grounds each material finding in the specific operational decision the tile drives, so materiality is judged against a real action.
It does not construct alternate renderings of a single graphic and test them against a salience frame_effect_threshold, nor issue a frame_neutrality_claim about a chart — perceptual re-rendering and the neutrality verdict on a single image are Visual Framing Audit. The separation is that a dashboard review audits the *data-structural arrangement of an interactive multi-metric surface and the decisions it drives, while a visual audit audits the perceptual encoding of one graphic.*
Related¶
- Instantiates: Framing Effect Audit — Dashboard Framing Review is the audit applied to a live operational decision surface.
- Sibling mechanisms: Visual Framing Audit · Baseline Reference Swap · Blinded Frame Review · Gain/Loss Frame Comparison · Order-Effect Check · Presentation Sensitivity Table · Survey Frame Split Sample · Wording Test
Editorial Notes¶
Form Classification¶
Form family: Assessment, Review & Assurance
Rationale: Dashboard Framing Review operates as a bounded evaluation of existing evidence or work that produces a finding or disposition because it audits a live dashboard's display choices — units, baselines, sort order, default filters, missing denominators — for the ones that steer the operational decisions the dashboard actually drives.
Independent corroboration: The frozen evidence defines Dashboard Framing Review as 'Audits a live dashboard's display choices — units, baselines, sort order, default filters, missing denominators — for the ones that steer the operational decisions the dashboard actually drives', so its operative form is Assessment, Review & Assurance.
Review outcome: Independent reviewer agreement; high confidence.
Origin Attribution¶
Primary origin: Behavioral Economics
Origin pattern: Cross-disciplinary synthesis
Present-day reach: Multi-domain
Rationale: Behavioral decision research is primary because the audit asks whether equivalent defaults, baselines, denominators, and presentations change the decision without changing the underlying facts. HCI supplies the dashboard audit form and data science supplies the comparability and metric-structure checks.
Related originating lineages:
- Data Science & Analytics — Analytic practice supplies denominator, aggregation-window, and cross-tile comparability tests.
- Human-Computer Interaction — Dashboard and visualization practice supplies the review of filters, sort order, units, interaction, and downstream operator tasks.
Review resolution: Behavioral decision research is primary because the audit asks whether equivalent defaults, baselines, denominators, and presentations change the decision without changing the underlying facts. HCI supplies the dashboard audit form and data science supplies the comparability and metric-structure checks.
Encyclopedia synthesis: The exact catalogued form synthesizes established practice rather than reproducing a single standard historical label.
Review outcome: Researched adjudication after independent review; high confidence.
Sources consulted:
- Tversky and Kahneman (1981): The Framing of Decisions and the Psychology of Choice
- MIT Visualization Group: Heuristics for Supporting Cooperative Dashboard Design
Notes¶
[n1] The default effect — people disproportionately stay with a preset option, so a dashboard's default filter, sort, or time window functions as a framing choice that shapes attention even though users could change it and rarely do. ↩