Skip to content

Effect Size Standardization

Convert raw inferred effects into comparable, uncertainty-bounded magnitude expressions so evidence can be judged by size and practical meaning, not only by detectability.

The Diagnostic Story

Symptom: Studies or evaluations declare findings significant while the room argues about whether the effect actually matters. Different teams compare coefficients and score changes that aren't in the same units, so comparisons are guesswork dressed as analysis. Relative effects look dramatic, but nobody is quoting the baseline risk or absolute magnitude that would tell you whether to act.

Pivot: Declare the target effect and comparison frame, preserve the raw estimate, select a valid standardization rule, attach uncertainty and directionality, and report magnitude with explicit qualifiers distinguishing practical importance from statistical detectability.

Resolution: Effects become meaningfully comparable across studies, scales, populations, and interventions. The system gains separation between practical importance and statistical significance. Raw estimates and their original units remain auditable so the transformation can be traced and challenged.

Reach for this when you hear…

[clinical research] “The p-value is tiny but the effect is smaller than measurement error — tell me the number of needed to treat, not just that it's significant.”

[education policy] “You can't compare a reading score gain in standard deviations from one study to a grade-level gain from another without converting them to the same scale.”

[behavioral economics] “The relative risk sounds alarming but the absolute baseline is 0.1% — that relative framing is doing a lot of emotional work for a tiny absolute shift.”

Mechanisms / Implementations

  • Absolute Risk Difference Translation
  • Confidence Interval Propagation
  • Correlation or Regression Coefficient Transformation
  • Forest Plot or Effect Table Display
  • Hedges Correction Application
  • Meta-Analytic Effect Harmonization
  • Minimal Important Difference Anchoring
  • Risk Ratio or Odds Ratio Standardization
  • Standardized Mean Difference Calculation

Abstractions this archetype builds on — directly (a source ingredient) or as a related pattern. Links follow the typed catalog namespace.

Built directly on (1)

  • Statistical Inference: Reasoning from a finite, noisy sample back to the underlying population or process while explicitly quantifying the uncertainty that sampling introduces.

Also references 26 related abstractions

Variants

Narrower or domain-specific specializations that share this archetype's core structure. Recognized variants are established; candidate variants are provisional.

Effect Size Reporting · reporting variant · recognized

Report effect magnitude alongside or instead of mere statistical detectability so practical importance is visible.

Standardized Mean Difference Harmonization · metric variant · recognized

Convert continuous-outcome effects from different measurement scales into standard-deviation units for comparison.

Ratio Effect Standardization · metric variant · recognized

Standardize event or rate effects through ratios such as risk ratios, odds ratios, rate ratios, or hazard-like comparisons.

Practical Importance Anchoring · interpretation variant · recognized

Interpret standardized effect magnitude against a meaningful-change threshold, policy threshold, cost-benefit threshold, or minimal important difference.

Meta-Analytic Effect Harmonization · evidence synthesis variant · recognized

Convert multiple studies with different measures, scales, and populations into a common effect metric for synthesis.