Prediction Error

Version

v4 · 2026-09-28 · History

Prime #

1416

Domain group

Formal Sciences

Origin domain

Experimental Design & Statistics

Subdomain

Forecasting and Model Diagnostics → Experimental Design & Statistics

Also from

Computer Science & Software Engineering, Neuroscience, Engineering & Design (beyond software), Economics & Finance

Aliases

Model Prediction Error, Forecast Error Signal

Related primes

Reward Prediction Error, Predictive Coding, Residual Analysis, Baseline Deviation

Core Idea

A prediction error is the signed or structured discrepancy between what an identifiable model predicted and what was observed in the same frame. The residual becomes operational: it updates the predictor, is routed as a compact message, or is collected for diagnosis.

How would you explain it like I'm…

Oops, Not What I Guessed

You guess the cookie jar has five cookies, but when you look, there are only two. The difference between your guess and what you saw is a prediction error. Next time, you can use it to make a better guess.

Guess Minus What Happened

A prediction error is the difference between what you expected and what actually happened. If the weather app said 20 degrees and it was really 25, the prediction error is 5 degrees too cold. The important part is that the error gets used: you can fix your guessing method, find out what you keep getting wrong, or only pay attention to the surprising part. Your brain does this too, noticing when things don't go the way it expected and learning from it.

Expected-vs-Observed Residual

A prediction error is the difference between what a model predicted and what was actually observed, measured in the same terms. It usually has a direction and size, like 'three degrees too high,' so it tells you not just that you were wrong but how. What makes it a useful idea is that the error is put to work: a learning system uses it to adjust its predictions, a compression system sends only the surprising part instead of everything, and an analyst studies the errors to find what the model consistently misses. It appears in weather forecasting, control systems, image compression, and neuroscience, where dopamine signals are thought to track reward prediction errors, getting more than you expected versus less.

 

A prediction error is the signed or structured discrepancy between what an identifiable model predicted and what was observed, expressed in the same frame. The residual is not just noticed; it is operational: a learner uses it to update the predictor, a coding system transmits it instead of the predictable content, and an analyst collects it to diagnose systematic model failures. The concept is deliberately generic, covering forecast errors, control-loop residuals, image-prediction residuals in video compression, cortical mismatch signals in predictive-processing accounts of perception, and reward prediction errors in reinforcement learning (famously tracked by dopamine neurons). The Kalman filter makes the structure explicit: the innovation equals the observed measurement minus the predicted measurement, and the Kalman gain determines how much that innovation shifts the state estimate. The key requirement is an identifiable predictor and a shared frame; a vague sense of surprise without a specific prediction does not count. Consumers of the error differ, but the predictor–observation–residual relation is the same.

Scope

The identity recurs in forecast errors, Kalman innovations, control residuals, predictive coding, residual coding, model diagnostics, and reward prediction errors. The predicted quantity changes; the predictor–observation–residual relation does not.

Clarity

The abstraction distinguishes a prediction miss from any departure from a norm. The reference must have been generated as a prediction. It also distinguishes the error signal from the larger architecture or method that consumes it.

Manages Complexity

Once predictable content is removed, the system can update or communicate only the residual. Collections of residuals can then be inspected for remaining structure.

Abstract Reasoning

Always name the predictor, prediction, observation, frame, residual sign, and consumer. Without those roles, “prediction error” is merely a metaphor for surprise.

Knowledge Transfer

Gain selection, residual routing, and error-diagnostic reasoning transfer directly among filters, forecasts, codecs, cortical hierarchies, and learning systems.

Relationships to Other Abstractions

Current abstraction Prediction Error Prime

Parents (1) — outgoing typed relations

• Prediction Error is a kind of Baseline Deviation Prime

  Prediction error is baseline deviation specialized to a model-generated predictive reference and an operational signed residual.

Children (5) — abstractions linked here by typed relations

• Error-driven learning Domain-specific is a kind of Prediction Error

  The mechanism converts mismatch between expectation and outcome into learning.

• Reward Prediction Error Prime is a kind of Prediction Error

  Reward prediction error is prediction error specialized to reward or value predictions and value-policy updating.

• Predictive Coding Prime includes Prediction Error

  Prediction-error signals are internal messages in the predictive-coding hierarchy, comparing level-specific predictions with incoming activity and routing the residual upward.

• Residual Analysis Prime includes Prediction Error

  Prediction errors are the observed-minus-predicted objects that residual analysis collects and examines for remaining structure.

• Expectancy Disconfirmation Domain-specific is a decomposition of Prediction Error

  Expectancy Disconfirmation decomposes to Prediction Error: remove the consumer-satisfaction frame and the load-bearing operation is a signed realized-minus-predicted discrepancy.

Hierarchy path (1) — routes to 1 parentless root

• Prediction Error → is a kind of Baseline Deviation → presupposes, typical Comparison