Null distribution¶
Represent the sampling distribution of a declared test statistic under the null hypothesis and sampling scheme used to calibrate tail probabilities, critical values, and type-I error.
Core Idea¶
A null distribution is the probability distribution of a specified test statistic under a specified null hypothesis and sampling model. If \(T=T(X)\) is computed from random data \(X\), the null distribution is the law of \(T\) when the data-generating parameter or family satisfies \(H_0\). It supplies the reference against which an observed \(t_{obs}\) is ranked. Critical regions and p-values are therefore properties of the statistic-plus-null model, not generic properties of the raw data or of a named distribution detached from assumptions.
Scope of Application¶
The abstraction is literal wherever practitioners can identify the same constitutive roles, apply the same boundary tests, and obtain the same kind of output. The following habitats are uses of Null distribution itself, not metaphors based only on resemblance.
- Classical parametric tests. Using exact or asymptotic \(t\), \(F\), chi-square, and related reference laws.
- Randomization inference. Enumerating or sampling treatment assignments justified by the design.
- Permutation testing. Generating transformed statistics under an exchangeability null.
- Monte Carlo tests. Simulating the statistic from a fully specified or fitted null model.
- Large-scale multiple testing. Estimating an empirical null when theoretical calibration is systematically distorted.
- Diagnostic simulation. Checking whether nominal critical values achieve intended type-I error under realistic assumptions.
Clarity¶
A clear account of Null distribution must preserve the recognition invariant stated in the Core Idea rather than rely on the title alone. State the null, statistic, sampling unit, dependence structure, conditioning, and tail ordering together. Name whether the law is exact, asymptotic, simulated, permutation-based, or empirically estimated. Explain nuisance-parameter handling and whether the statistic is pivotal. Distinguish a point-null reference law from a composite-null calibration valid over a family.
Manages Complexity¶
Null distribution manages complexity by replacing a diffuse field of observations or possible operations with a bounded role structure: null hypothesis supplies a precise parameter value, family, invariance, or exchangeability statement defines the reference world.; sampling scheme supplies randomization, dependence, censoring, and conditioning determine repeated-sample behavior.; test statistic supplies a declared function of the data orders evidence against the null.; reference law supplies the statistic's probability distribution is derived or generated under the null.; tail ordering supplies one- or two-sided extremeness is defined before observing the result..
Abstract Reasoning¶
- Write the null hypothesis at the parameter, model, invariance, or assignment level. 2. Choose a statistic whose ordering corresponds to the intended departure. 3. Derive or generate its distribution under every material null condition. 4. Handle nuisance parameters by conditioning, estimation, invariance, or conservative maximization. 5. Select one- or two-sided extremeness and compute critical values or tail probabilities. 6. Verify type-I-error calibration analytically or by simulation under realistic dependence and sample size.
Knowledge Transfer¶
The strict upward abstraction is Hypothesis Testing Null Vs Alternative. Null Distribution instantiates Hypothesis Testing (Null vs. Alternative) because it is the reference component that converts a statistic into calibrated evidence and controls false rejection under the null. Within statistical hypothesis testing, the full mechanism transfers literally when the same roles and boundary tests recur. Beyond that domain, only the parent-level skeleton should travel. Reusing the label Null distribution after removing its constitutive vocabulary would hide a change of mechanism behind an analogy. The honest transfer rule is therefore two-stage: recognize the domain-specific pattern first, then lift only the parent relation that remains invariant under a substrate change.
Relationships to Other Abstractions¶
Current abstraction Null distribution Domain-specific
Parents (1) — more general patterns this builds on
-
Null distribution is a kind of Hypothesis Testing (Null vs. Alternative) Prime
Null Distribution instantiates Hypothesis Testing (Null vs.
Hierarchy paths (5) — routes to 5 parentless roots
- Null distribution → Hypothesis Testing (Null vs. Alternative) → Statistical Inference → Inductive Reasoning
- Null distribution → Hypothesis Testing (Null vs. Alternative) → Statistical Inference → Uncertainty
- Null distribution → Hypothesis Testing (Null vs. Alternative) → Verification → Evaluation → Comparison → Self Checking
- Null distribution → Hypothesis Testing (Null vs. Alternative) → Statistical Inference → Probability → Measure → Set and Membership
- Null distribution → Hypothesis Testing (Null vs. Alternative) → Statistical Inference → Probability → Measure → Aggregation → Micro Macro Linkage
Neighborhood in Abstraction Space¶
Null distribution sits in a sparse region of the domain-specific corpus (91st percentile for distinctiveness): few abstractions share its structure, so a faithful description tends to retrieve it precisely.
Family — Statistical Tests & Distribution Calibration (7 abstractions)
Nearest neighbors
- Randomness Test — 0.80
- Family-Wise Error Rate — 0.79
- Anderson–Darling test — 0.79
- Universal Hypothesis Testing — 0.79
- Z-test — 0.78
Computed from structural-signature embeddings · 2026-09-08