Jeffreys prior¶

A Bayesian prior measure proportional to the square root of the Fisher-information determinant, constructed to remain invariant under smooth reparameterization.

Version: v2 · 2026-09-19 · History
Domain-specific #: 5137
Domain group: Formal Sciences
Origin domain: Experimental Design & Statistics
Subdomains: Bayesian Statistics, Objective Priors → Experimental Design & Statistics

Core Idea¶

Jeffreys prior assigns density proportional to the square root of the determinant of expected Fisher information. Fisher information transforms as a metric tensor, so its volume element compensates for Jacobians and defines the same prior measure in new smooth coordinates. The abstraction is therefore identified by a declared carrier, a transformation or constraint over that carrier, and an invariant that tells an analyst whether the named structure is genuinely present.

The load-bearing residual is not the broad topic of bayesian statistics. It is information-geometric default prior with parameterization invariance. That residual remains recognizable when examples, notation, scale, or implementation change, but it disappears if the carrier is mistyped, the condition that the prior measure, rather than its coordinate density, is unchanged by one-to-one smooth reparameterization fails, a neighboring object is substituted, or notation and topical resemblance replace the constitutive test.

How would you explain it like I'm…

No faithful explanation at this level. A child-level version collapses into 'a fair guess treating every number equally,' a uniform prior. That is exactly what Jeffreys prior is not: its point is that the prior measure is invariant under reparameterization.

Same Guess, Any Description

Before seeing any data, a statistician sometimes needs a starting guess about an unknown number. The trouble is that you can describe the same unknown in different ways, like a square's side length or its area. A guess that looks fair in one description can look lopsided in another. The Jeffreys prior is a recipe for a starting guess that says the same thing about the world no matter which of those descriptions you use. It builds the guess from how much the data can tell you about the unknown at each value.

Reparameterization-Invariant Default Prior

A prior is the probability distribution placed on a parameter before seeing data. If you relabel the parameter, for example switching from a standard deviation to a variance, a prior that is flat in one label is not flat in the other, so 'flat' is not a neutral choice. Jeffreys prior sets the prior density proportional to the square root of the Fisher information (its determinant when there are several parameters). Fisher information measures how sharply the data can pin the parameter down. Because of how Fisher information changes when you relabel, the density formula adjusts automatically, so the probability assigned to any region of possible models stays the same. The density formula looks different in each coordinate system, but the underlying prior is identical.

The Jeffreys prior is a default prior with density proportional to √det I(θ), where I(θ) is the expected Fisher information matrix. Its defining property is invariance under reparameterization. Fisher information transforms like a metric tensor, so under a smooth one-to-one change of variables its determinant picks up exactly the squared Jacobian. The square root therefore supplies the Jacobian factor needed to carry the same measure into the new coordinates. What is invariant is the prior measure, not the coordinate density: the density formula differs between parameterizations, but probabilities assigned to corresponding regions agree. Geometrically, it is the volume element induced by the Fisher metric, which makes it an information-geometric default. Before using it, one should state the model and its parameters, check that the invariance condition actually holds, and stay within its assumptions rather than treating it as automatically "uninformative."

Scope of Application¶

Jeffreys prior belongs to bayesian statistics and is useful where the analyst can specify a parametric likelihood, parameter vector, Fisher information matrix, coordinate transformation, prior measure, observed data and posterior propriety conditions, then evaluate the prior measure, rather than its coordinate density, is unchanged by one-to-one smooth reparameterization. The scope is broad within that domain but bounded by the need for the prior measure, rather than its coordinate density, is unchanged by one-to-one smooth reparameterization. The entry records a descriptive analytical identity; practical use requires the governing domain's evidence, standards, and safety obligations.

Clarity¶

The abstraction clarifies a crowded vocabulary by making the prior measure, rather than its coordinate density, is unchanged by one-to-one smooth reparameterization the center of the account. A claim should name the carrier, the governing operation or relation, the applicable assumptions, and the recognition test. A bare label is insufficient because the name Jeffreys prior can be used for a formal identity, an implementation, or a neighboring result unless carrier and convention are stated.

Manages Complexity¶

Without the abstraction, an analyst must reason directly over many local details: the carrier roles, admissibility assumptions, competing conventions, derived invariants, boundary cases, and proof or validation obligations specific to Jeffreys prior. Jeffreys prior compresses them into the roles in the structural signature. That compression permits comparison across instances without erasing the variables that determine validity. It also exposes which details may be varied safely and which are constitutive.

Abstract Reasoning¶

Identify the carrier. State what the elements, states, objects, or observations are: a parametric likelihood, parameter vector, Fisher information matrix, coordinate transformation, prior measure, observed data and posterior propriety conditions. Reject examples whose alleged carrier belongs to a different problem.
Lock the constitutive rule. Express the prior measure, rather than its coordinate density, is unchanged by one-to-one smooth reparameterization independently of one notation or implementation.

Knowledge Transfer¶

Knowledge transfers strongly among subfields of bayesian statistics because they reuse a parametric likelihood, parameter vector, Fisher information matrix, coordinate transformation, prior measure, observed data and posterior propriety conditions, Fisher information transforms as a metric tensor, so its volume element compensates for Jacobians and defines the same prior measure in new smooth coordinates., and type the carrier, state every parameter and convention in the definition, test that the prior measure, rather than its coordinate density, is unchanged by one-to-one smooth reparameterization, compare the nearest accepted identity, and report counterexamples, uncertainty, and limiting cases.

Relationships to Other Abstractions¶

Current abstraction Jeffreys prior Domain-specific

Parents (1) — outgoing typed relations

Jeffreys prior is a kind of Invariance Prime

Its defining benefit is invariance under smooth parameter coordinates.

Hierarchy path (1) — routes to 1 parentless root

Jeffreys prior → is a kind of Invariance

Neighborhood in Abstraction Space¶

Jeffreys prior sits in a crowded region of the domain-specific corpus (12^th percentile for distinctiveness): several abstractions share nearly its structure, so a description that fits it tends to fit its neighbors too.

Family — Statistical Estimation & System Inference (13 abstractions)

Nearest neighbors

Posterior probability — 0.92
Marginal likelihood — 0.92
Widely applicable information criterion — 0.91
Bayesian linear regression — 0.91
Exchangeable random variables — 0.91

Computed from structural-signature embeddings · 2026-10-25