External Validity

The warrant by which an effect estimated in one study setting can be expected to hold in a target setting outside it — holding conditional on every effect-modifying feature that differs between the two being matched or adjusted.

Core Idea

External validity is the property by which an effect estimated in one study setting — its sample, treatment, outcome measure, context, and time — can be expected to hold in a target setting outside it. One of Cook and Campbell's four validity facets, it is logically independent of internal validity: a study can be internally valid yet externally invalid. The failure mechanism is effect modification — some feature of the participants, treatment, or background conditions interacts with the effect and takes a different value in the target, so the estimate changes when carried over.

Scope of Application

External validity is a property of an epistemic claim, not a mechanism, so it applies literally wherever a finding estimated in one setting is proposed for a target setting outside it.

• Experimental social science — lab-versus-field, WEIRD-sample and mTurk-versus-population concerns.
• Clinical trials — the efficacy-versus-effectiveness gap; pre-approval to pragmatic trials (PICOTS).
• Development economics — scaling-up failures of small RCTs to national programmes.
• Educational research — pilot-school efficacy versus district-wide rollout.
• Machine learning — train/test distribution shift and benchmark-versus-deployment gaps.

Clarity

The facet forces apart what was estimated from what is being claimed, so the move from in-sample effect to target effect becomes a separate inference with named assumptions. It also disambiguates "the study didn't replicate" — an internal-validity failure (never real) versus an external one (real but non-transporting) — opposite diagnoses with opposite remedies.

Manages Complexity

Two settings differ along an open-ended list of dimensions, any of which might break transport. The concept locates the whole question in one mechanism — effect modification by treatment-interacting features — so only differences that interact with the treatment can matter. The boundless catalogue of dissimilarities collapses to a short ledger of effect modifiers, each flagged as modifier-or-irrelevant and matched-or-not.

Abstract Reasoning

External validity supports a diagnostic/disambiguating move (which kind of non-replication?), an interventionist move on the effect modifiers rather than the study (match, re-weight, emulate the target trial), and a boundary-drawing move that converts the binary "does this generalize?" into a per-feature partition plus the estimated-versus-claimed discipline, reading transport as conditional rather than all-or-nothing.

Knowledge Transfer

External validity is a construct-plus-bookkeeping, and it transfers literally wherever its precondition holds — the Cook-Campbell facets, effect-modification mechanism, per-feature partition, and study-design remedies carry intact across every field that runs studies, since these are one methodology applied to many subjects. Beyond the empirical-study practice it belongs to the metalanguage of inquiry, not the systems studied; the general question of when an in-sample regularity warrants extrapolation is carried by the parents generalization, inductive_reasoning, and transferability.

Relationships to Other Abstractions

Current abstraction External Validity Domain-specific

Parents (2) — more general patterns this builds on

• External Validity presupposes Internal validity Domain-specific

  A positive transport warrant presupposes that the in-sample causal effect being transported is locally warranted rather than an artifact.

• External Validity is a decomposition of Inductive Reasoning Prime

  Stripping the research-design frame leaves the ampliative move from a finding in one bounded setting to a claim beyond those observations.

Hierarchy paths (10) — routes to 8 parentless roots

• External Validity → Internal validity → Causal Inference → Statistical Inference → Inductive Reasoning

Show alternative paths (9)

Neighborhood in Abstraction Space

External Validity sits in a sparse region of the domain-specific corpus (85^th percentile for distinctiveness): few abstractions share its structure, so a faithful description tends to retrieve it precisely.

Family — Unclustered & Miscellaneous (309 abstractions)

Nearest neighbors

• Carryover Effect — 0.83
• Selection on Observables — 0.82
• Outbreak Underascertainment — 0.82
• Regression — 0.82
• File Drawer Problem — 0.82

Computed from structural-signature embeddings · 2026-07-12