Skip to content

Bayes Factor

The ratio of the marginal likelihoods of the data under two specific models, isolating the data's weight of evidence between them and updating prior model odds to posterior odds multiplicatively — with an automatic Occam penalty on flexible models.

Core Idea

The Bayes factor is the ratio of the marginal likelihoods of data under two competing models, BF12 = P(D|H1)/P(D|H2), each marginal likelihood being the fit averaged over the model's parameter space against its prior. It quantifies how much more probable the data are under one hypothesis than the other, and updates prior model odds to posterior odds multiplicatively. Three features distinguish it from the p-value: it compares two specific hypotheses (so it can give evidence for a hypothesis), the integration imposes an automatic Occam penalty, and it accumulates multiplicatively over data.

Scope of Application

Being a statistic, the Bayes factor applies wherever its precondition holds: two specific probability models each assigning a computable marginal likelihood to the same data.

  • Statistics — the home turf: Bayesian model comparison, gradable evidence for a null.
  • Cognitive psychology — the Bayesian-replication movement, because null evidence is gradable.
  • Genetics and bioinformatics — ranking causal models for variant-trait associations.
  • Machine learning — marginal-likelihood model selection; the variational ELBO as surrogate.
  • Astrophysics — comparing cosmological models against survey data.
  • Forensic science — the reported likelihood ratio, the court supplying prior odds.

Clarity

The Bayes factor isolates the evidence the data supply from how plausible the hypotheses were going in, splitting posterior odds into prior odds times Bayes factor. It poses the sharp question the p-value cannot — how much more probable are these data under H1 than H2 — yields evidence for a hypothesis (including a null), and makes the flexibility penalty legible without an ad hoc complexity term.

Manages Complexity

An entangled tangle — fit, flexibility, prior plausibility, decision threshold, cross-study combination — compresses into a single scalar read through the multiplicative split posterior odds = BF × prior odds. The fit-versus-complexity trade-off is charged automatically, evidential accumulation collapses to multiplication, and strength collapses to a position on Jeffreys' calibration scale.

Abstract Reasoning

The Bayes factor licenses a diagnostic evidence-direction-and-strength reading (including support for a null versus uninformativeness); a diagnostic detecting a fit-versus-flexibility mismatch via the Occam penalty; an interventionist move accumulating evidence and stopping adaptively under the multiplicative law; and boundary-drawing moves partitioning data-owned from analyst-owned and treating Jeffreys' bands as reading aids, not thresholds.

Knowledge Transfer

As a statistic the Bayes factor transfers literally wherever two specific probability models assign marginal likelihoods to the same data — psychology, genetics, ML, astrophysics, and forensics are the same computed quantity, not analogies. The boundary is over-reading: where no such models exist, "Bayes factor" does rhetorical work. There the portable content is the parent bayesian_updating (prior odds × evidence = posterior odds), of which the Bayes factor is the model-comparison evidence-summary.

Relationships to Other Abstractions

Local relationship map for Bayes FactorParents appear above the current abstraction, mutual partners to the right, and children below. Node labels state whether each abstraction is prime or domain-specific; colors identify relation types.Bayes FactorDOMAINPrime abstraction: Bayesian Updating — is part ofBayesianUpdatingPRIME

Current abstraction Bayes Factor Domain-specific

Parents (1) — more general patterns this builds on

  • Bayes Factor is part of Bayesian Updating Prime

    A Bayes factor is the evidence multiplier that converts prior model odds into posterior model odds within Bayesian updating.

Hierarchy paths (5) — routes to 3 parentless roots

Neighborhood in Abstraction Space

Bayes Factor sits in a sparse region of the domain-specific corpus (62nd percentile for distinctiveness): few abstractions share its structure, so a faithful description tends to retrieve it precisely.

Family — Statistical Inference & Model Failure Modes (16 abstractions)

Nearest neighbors

Computed from structural-signature embeddings · 2026-07-12