Skip to content

Lack-of-Fit Sum of Squares

Decompose regression residual variation at replicated predictor settings into irreducible within-setting pure error and systematic discrepancy between fitted values and setting means.

Version
v2 · 2026-09-06 · History
Domain-specific #
2151
Origin domain
statistics
Subdomain
regression analysis
Aliases
Lack-of-fit SS, Sum of squares due to lack of fit, SSLOF

Core Idea

When response observations are replicated at identical predictor settings, the residual sum of squares from a regression can be decomposed orthogonally into pure-error sum of squares and lack-of-fit sum of squares. Pure error measures variation among responses at the same setting; lack of fit measures the weighted discrepancy between each setting mean and the fitted model value.

The decomposition distinguishes noise no deterministic mean curve could remove from discrepancy attributable to the proposed functional form. Dividing each component by its degrees of freedom yields a classical F test under independent, homoscedastic normal errors. Without replicated settings, pure error cannot be estimated internally and the ordinary residual sum of squares cannot be split this way.

Scope of Application

The quantity is literal in regression experiments with replicated predictor combinations and a candidate mean function.

  • Calibration studies. Testing whether a linear or nonlinear response curve is adequate.
  • Response-surface experiments. Using replicated center or design points to estimate pure error.
  • Industrial experimentation. Separating process repeatability from model-form discrepancy.
  • Dose–response modeling. Checking a specified mean curve when replicated doses exist.
  • Analytical chemistry. Diagnosing calibration-function adequacy.
  • Regression pedagogy. Demonstrating the design-dependent ANOVA partition.

Clarity

List distinct predictor settings, replicate counts, fitted parameters, cell means, and all three sums of squares with degrees of freedom. Verify RSS=SS_PE+SS_LOF numerically. State error assumptions and the exact F ratio. If predictors are rounded or near-equal rather than truly replicated, justify the grouping before calling the within-cell variation pure error.

Manages Complexity

The partition converts a single undifferentiated residual total into two actionable sources: irreducible repeatability noise and removable model discrepancy. It tells analysts whether collecting more precise data or changing the mean function addresses the residual. The clarity depends on experimental replication; retrospective grouping can manufacture a pure-error benchmark and invalidate the diagnosis.

Abstract Reasoning

  1. Identify exact replicated predictor settings.
  2. Fit the proposed regression model.
  3. Compute each setting's response mean.
  4. Sum within-setting squared deviations for pure error.
  5. Compute replicate-weighted squared deviations between cell means and model predictions.
  6. Verify the orthogonal residual partition.
  7. Allocate degrees of freedom and form mean squares.
  8. Use the F comparison only under defensible error assumptions and power.

Knowledge Transfer

The strict parent is Decomposition: one residual total is split exactly into pure noise and model-form discrepancy, each with distinct interpretation. Residual Analysis is related, but the defining move is the design-enabled additive partition.

Decomposition is the strict parent because the operative move is an exact additive split of one squared-distance total into orthogonal components. The domain-specific residue is not merely that two numbers add: it is the projection geometry created by replicated regression settings, one subspace for within-cell departures and another for cell-mean departures from the fitted model.

Relationships to Other Abstractions

Local relationship map for Lack-of-Fit Sum of SquaresParents appear above the current abstraction, mutual partners to the right, and children below. Node labels state whether each abstraction is prime or domain-specific; colors identify relation types.Lack-of-FitSum of SquaresDOMAINPrime abstraction: Decomposition — is a kind ofDecompositionPRIME

Current abstraction Lack-of-Fit Sum of Squares Domain-specific

Parents (1) — more general patterns this builds on

  • Lack-of-Fit Sum of Squares is a kind of Decomposition Prime

    Decomposition is the strict parent because residual variation is exactly split into within-setting pure error and between-mean model discrepancy.

Hierarchy path (1) — routes to 1 parentless root

Neighborhood in Abstraction Space

Lack-of-Fit Sum of Squares sits in a sparse region of the domain-specific corpus (94th percentile for distinctiveness): few abstractions share its structure, so a faithful description tends to retrieve it precisely.

Family — Longitudinal Models & Time-Series Structure (8 abstractions)

Nearest neighbors

Computed from structural-signature embeddings · 2026-09-08