Ground-Truth Drift¶

The model-evaluation failure in which the operational definition of the correct answer drifts on a clock the monitoring apparatus cannot see, so metrics keep scoring against a moved target while the dashboards stay green — invisible because every detector consumes current ground truth as its reference.

Core Idea¶

Ground-truth drift is the model-evaluation failure in which the operational definition of the correct answer — the label a supervised system treats as truth — changes over time while the measurement apparatus appears constant. Labels are still produced and metrics still computed, but what the label means is no longer what it meant at training. The apparatus never flags it because it consumes current ground truth as its reference; comparison to historical ground truth is not performed.

Scope of Application¶

Lives across the application areas of supervised model evaluation — a model scored against a contingent label external actors can quietly revise.

Clinical prediction — the definition of "sepsis" or "readmission" revised as criteria update.
Hiring analytics — shifting taxonomies of "successful hire" or "voluntary exit."
Forecasting evaluation — economic series revised retrospectively after scoring.
Fraud detection — the "fraud" rule expanding, inflating the apparent positive rate.
Content moderation and NLP annotation — an evolving "policy violation" or tightened annotator instructions.

Clarity¶

Naming ground-truth drift makes visible a failure that leaves no trace in the monitoring infrastructure: the pipeline runs, dashboards are green, yet numbers are scored against a target whose meaning moved. It pins the failure to the definition, not the operation — where the standard ML toolkit cannot look. Its sharpest work adds a fourth entry to "why is performance different?": label-definition drift, distinct from concept drift, the distinction practitioners most need drawn.

Manages Complexity¶

A moving metric invites an open-ended list of causes and reflexes — retrain, recollect, recalibrate — none of which can surface a defect living in the label. Ground-truth drift completes a small closed decomposition into four mutually exclusive sources (covariate shift, label shift, concept drift, label-definition drift), so the analyst sorts an anomaly into one of four boxes. In the drift branch, state collapses to two clocks and one agreement test, settling the otherwise-unresolvable ambiguity.

Abstract Reasoning¶

The concept supports a diagnostic relocation (the defect may live in the definition, and no output detector can surface it), a governing decomposition into four mutually exclusive sources with boundary-drawing against concept drift (the Y-definition moved, not P(Y|X)), a two-clocks-and-an-agreement-test move (compare the labeling rule's revision clock against the tracking clock, and ask whether old and new labels agree on identical cases), and an interventionist redirect toward institutional inspection and like-for-like re-scoring.

Knowledge Transfer¶

Within supervised evaluation the concept transfers literally as mechanism — the four-way decomposition, the concept-drift boundary, the two-clocks test, and the version-and-re-score prescription carrying without translation across clinical, hiring, forecasting, fraud, and annotation settings, since all share a model scored against a revisable label. Beyond ML only the substrate-neutral structure travels: an apparatus anchored to a reference whose definition drifts unseen, carried by the parent reference_standard_decay (with its twin gold-standard erosion, and calibration upstream), recurring in revised legal categories and DSM/ICD criteria. The ML cargo stays home.

Relationships to Other Abstractions¶

Current abstraction Ground-Truth Drift Domain-specific

Parents (1) — more general patterns this builds on

Ground-Truth Drift is a decomposition of Reference Standard Decay Prime

Removing supervised-model terminology from ground-truth drift leaves an apparatus scoring against a reference whose definition moved invisibly.

Hierarchy path (1) — routes to 1 parentless root

Ground-Truth Drift → Reference Standard Decay → Proxy-Target Divergence → Proxy–Target Fidelity → Representation → Abstraction

Neighborhood in Abstraction Space¶

Ground-Truth Drift sits in a moderately populated region (59^th percentile for distinctiveness): it has near-neighbors but no dense thicket of look-alikes.

Family — Unclustered & Miscellaneous (309 abstractions)

Nearest neighbors

Computed from structural-signature embeddings · 2026-07-12