Belief Aggregation¶

Pool several probability assignments over a common event space into one collective distribution under an explicit rule.

Version: v1 · 2026-10-03 · History
Domain-specific #: 13009
Domain group: Formal Sciences
Origin domain: Mathematics
Subdomains: Probability Theory, Probabilistic Opinion Pooling → Mathematics
Aliases: Probabilistic Opinion Pooling

Core Idea¶

Belief aggregation, in the probabilistic sense, takes several probability assignments about the same events or outcomes and uses an explicit pooling rule to produce one collective probability assignment. The inputs might be expert judgments or predictive forecasts; they need not all come from human experts. The output must still be a coherent probability distribution on the declared common question, not merely a ranking of sources or a yes/no vote. Dietrich and List formalize this as a mapping from a profile of individual probability functions to a collective one, while emphasizing that the mapping is a family of possible rules, not a uniquely correct average.^[1]

For fixed nonnegative weights $w_i$ summing to one, a linear pool uses $P_{\mathrm{lin}}(A)=\sum_i w_iP_i(A)$ for event $A$. A geometric or logarithmic pool instead combines probabilities of possible worlds multiplicatively and normalizes, under positivity conditions. These can return different collective beliefs from the same reports; changing weights or the information assumptions can change which rule is defensible. The abstraction is the typed multiple probability reports → explicit rule and weights → one same-agenda probability report operation, not the linear formula alone.^[1]

The pooled distribution is not automatically better calibrated, more truthful or more democratic. It records the selected synthesis. Those performance or fairness claims require their own criteria and evidence. The original Sangay hazard study and Ranjan–Gneiting weather-forecast study show the same operation in unlike settings while making different choices about source weighting and recalibration.^[2]^[3]

Structural Signature¶

Sig role-phrases:

Common probabilistic question: fixes an event agenda or outcome space so every reported probability refers to the same proposition, variable and forecast horizon. A numerical average of answers to different questions is not a pooled belief.
Multiple probability assignments: supplies at least two distributions or event-probability forecasts, from experts, models or other specified sources. A single report updated with new evidence belongs to a different operation.
Pooling rule and influence weights: specifies how the profile becomes one assignment and whose report influences it. Weights are common parameters but do not imply one universally appropriate formula.
Collective probability assignment: provides the output on the same question, normalized and coherent under the chosen probability framework.
Rule-selection and evaluation conditions: states why a rule is used and how its axioms, shared information, calibration or decision purpose will be tested. These conditions guide interpretation but are not one universal fixed axiom package.^[1]^[2]^[3]

Remove the common agenda and the numerical inputs cease to be comparable. Remove the probabilistic inputs and a rank or vote aggregator may remain but not this identity. Remove the pooling rule and the collective assignment is not reproducible. A mathematically valid output can still be poor for a downstream forecasting goal; validity and evaluation are separate questions.

What It Is Not¶

It is not rank aggregation: combining ordinal orders need not preserve probability magnitudes or produce a distribution. It is not a generic ensemble-learning procedure: a trained collection of predictors may generate probabilistic inputs, but the learning architecture and its training protocol are not required for pooling the resulting assignments. It is not belief revision, where one agent changes a belief state in response to information, and it is not Dempster–Shafer combination of evidential mass on subsets with distinct belief/plausibility semantics. These distinctions turn on the carrier and transformation, not on a shared word such as “belief.”^[1]

Nor does pooling itself instantiate live Wisdom of the Crowds. That prime's independent noisy signals and improved collective accuracy are additional conditions, not consequences of averaging dependent, biased or strategically reported probabilities. Equal weights need not make a rule fair in every procedural sense, and performance weights need not guarantee future target calibration. A three-round clinical-guideline vote from the frozen seed is excluded: it did not pool treatment-effect probability distributions.

Scope of Application¶

The formal home is probabilistic opinion pooling: probability functions on a common agenda are mapped to one probability function. Within that scope, reports may come from a panel of experts, statistical forecasters, or institutional forecasting services. A finite event space is convenient for displaying linear and geometric formulas; applying a particular formula to continuous distributions needs its own measure, density and normalizing conditions. Geometric pooling is especially sensitive to the positivity domain of its input distributions. The exact selected rule and information assumptions belong in every application.^[1]

Sangay researchers elicited expert uncertainty distributions for shared volcanic target questions and compared equal-weight with calibration-based pooling schemes. Ranjan and Gneiting combined statistical and National Weather Service precipitation probabilities, then studied a beta-transformed linear pool as a recalibration step. The first setting has elicited expert distributions; the second has probabilistic forecasts from different systems. Both retain common questions, multiple probability inputs, an explicit combination rule and one pooled output.^[2]^[3]

Do not infer that “risk aggregation” generally means this entry. That phrase can also mean adding exposure losses or building a portfolio risk measure. Likewise “opinion aggregation” can include ordinal or binary judgments. Both broad surfaces remain unresolved vocabulary proposals; only scoped probabilistic opinion pooling is recorded as a supported alternate name here.^[1]

Clarity¶

The abstraction distinguishes the kind of thing combined from the reason for combining it. In the linear rule, $0.3$ and $0.7$ for the same event with equal weights produce $0.5$; those numbers are event probabilities, not labels for who voted. The result is a valid collective probability for that event, but that arithmetic says nothing by itself about source independence, truth or future calibration. Dietrich and List explicitly distinguish a procedural compromise from an epistemically justified collective opinion.^[1]

It also clarifies why two apparently reasonable reports can yield multiple defensible pools. A linear rule preserves eventwise separability; a normalized geometric rule incorporates probabilities across the whole event space and can commute with a shared Bayesian likelihood update under its stated domain conditions. The disagreement is structural, not merely a software implementation detail. One must name the rule before interpreting the resulting collective distribution.^[1]

Manages Complexity¶

Pooling compresses a profile of several entire probability assignments into one usable distribution. This gives a decision or forecasting analysis a single input while retaining uncertainty over the common outcomes. The compression discards the original between-source disagreement unless that spread and the individual reports are preserved separately. It also makes weighting and common-question alignment load-bearing choices, rather than clerical details.^[1]

In the Sangay case, decision-maker distributions make many elicited expert distributions legible as group uncertainty, but the original study still compares equal and performance-based schemes and displays uncertainty ranges. In weather forecasting, a linear combination is a manageable starting point, but Ranjan and Gneiting's recalibration motivation shows that compression can change calibration behavior. The manageable pooled object does not erase the need to inspect what was lost.^[2]^[3]

Abstract Reasoning¶

First align event definitions, units and forecast horizons, then check that each source supplied a probability assignment rather than a rank or vote. State whether the objective is procedural representation, forecast skill, update commutation or something else. Select a rule with explicit weights and domain assumptions; compute the pooled assignment and check normalization. Finally evaluate the output against the chosen aim—such as calibration on held-out outcomes or sensitivity to alternative weights—without confusing mathematical coherence with empirical success.^[1]^[3]

The axiomatic comparison is informative. Dietrich and List show, in their classical domain, that unanimity plus eventwise independence characterizes linear pooling. They also show that geometric pooling can be unanimous and externally Bayesian under its regularity and update-domain conditions, while not generally being eventwise independent. These are rule-selection tests, not an unqualified theorem that no possible rule can satisfy “all good axioms.”^[1]

Knowledge Transfer¶

The roles transfer literally from expert elicitation to forecast combination: common target, source probability profiles, declared rule, pooled probability output and evaluation conditions. What changes is source type and what counts as an informative weighting check. Sangay's seed-question calibration can weight experts; Ranjan–Gneiting's forecast combination is assessed by predictive calibration/sharpness and recalibration. One should not import a volcano-calibration weight into weather forecasts, or infer that a weather recalibration transformation is justified for elicited volcanic parameters, without a new evidential test.^[2]^[3]

The broader many-to-one skeleton already belongs to live Aggregation. The named entry remains probability-specific because its common event algebra, additive probabilities and pooled-distribution coherence are constitutive. A cross-domain metaphor about “aggregating beliefs” without actual probability functions is not a literal instance.

Examples¶

Sangay volcanic-hazard elicitation. The original Sangay study asks experts for uncertainty distributions on common seed and target questions; seed-item answers support calibration weights. It compares equal-weight, classical-model and expected-relative-frequency schemes, reporting group “decision-maker” distributions for target questions. These distributions summarize expert uncertainty about eruptive scenarios and source parameters; they are not observed frequencies guaranteed by the pooling operation.^[2]

Mapped back: The common probabilistic questions are the same Sangay target variables for each expert; the multiple assignments are individual elicited distributions; the pooling rule and weights are the compared equal/performance-based schemes; the collective assignment is each decision-maker distribution; and the evaluation conditions include seed-item calibration and sensitivity across schemes.

Probability of precipitation. Ranjan and Gneiting's original study combines statistical and National Weather Service probability-of-precipitation forecasts. Its proposed beta-transformed linear opinion pool takes a weighted combination and then recalibrates it. The case demonstrates that combining probability forecasts is more than taking a majority rain/no-rain vote, and that a valid arithmetic pool can still need performance assessment.^[3]

Mapped back: The common question is a specified precipitation event; multiple assignments are the statistical and National Weather Service probability forecasts; the pooling rule and weights form a linear pool with a fitted beta transformation; the output is one precipitation-probability forecast; and the evaluation conditions are forecast calibration and sharpness under the paper's study design.

Structural Tensions¶

Eventwise separability versus Bayesian update commutation. If a group wants the pooled probability of an event to depend only on each source's probability for that event, a linear rule has an attractive locality property. But normalized geometric pooling can commute with a shared likelihood update under its regularity conditions, and that normalization makes the result depend on the whole probability profile. Choosing locality can lose update commutation; choosing commutation can lose locality. Diagnostic: Will the pooled assignment be used after common evidence updates, and is eventwise independence or commuting with those updates the declared requirement?^[1]

Equal voice versus performance-weighted influence. Equal weighting treats reports symmetrically and is procedurally simple; calibration weights give better-performing sources more influence under the measured seed questions. The latter reduces equal influence and may be unstable if seed performance does not transfer, while the former can ignore demonstrated differences in calibration. Neither goal can be maximized under a non-equal performance weighting without a cost to the other. Diagnostic: Do the sources' seed-item performances differ enough that the pooled target distributions change materially, and is equal participation or predictive calibration the governing purpose?^[1]^[2]

Structural–Framed Character¶

This entry sits toward the structural end inside a probabilistic social-choice and forecasting frame. Evaluative weight is substantial at rule selection—equal influence, epistemic calibration and update behavior express different aims—even though the mapping itself is formal. Human-practice dependence is moderate: expert elicitation is a human procedure, but machine-produced probability forecasts can instantiate the same typed operation. Institutional origin is low to moderate: neither an institution nor a committee is needed to define a pooling function, although forecast agencies and expert panels provide common applications. Vocabulary travels literally from decision theory to volcanology and meteorology because each retains same-question probability reports and one pooled probability report; the broader phrases “risk aggregation” and “opinion aggregation” travel too loosely to be admitted automatically. Import versus recognition is conditional: the probability-pooling rule may be imported across settings only after event alignment, weighting assumptions and output coherence are checked; a vote or ordinal consensus is merely analogous. Its character: a portable formal operation within the probability domain, but not a domain-neutral prime because probability assignments and their coherence constraints are essential.^[1]^[2]^[3]

Structural Core vs. Domain Accent¶

The portable skeleton is many inputs deliberately compressed into one summary, assigned to live Aggregation. The domain accent is not cosmetic: the inputs and output are probability assignments on one event space, and a defensible rule must respect the intended probabilistic and informational constraints. Remove those, and one may have rank aggregation or another kind of combination, but not belief aggregation in this scoped sense. The prime parent is thus strict subsumption, while the probability-specific residual keeps the named identity domain-specific. A broader future-prime about reconciling multiple uncertain representations would require separate evidence and review; this draft does not assert it.^[1]

This entry is a kind of Aggregation.

The proposed typed DAG relation is strict subsumption to live Aggregation. Wisdom of the Crowds is related only when source diversity, error cancellation and accuracy improvement are actually established; those are not guaranteed by this entry. Live Rank Aggregation, Ensemble Learning and Belief Revision are nearby operations but not strict parents. Live Dempster–Shafer theory uses a different evidential-mass carrier.

Relationships to Other Abstractions¶

Current abstraction Belief Aggregation Domain-specific

Parents (1) — more general patterns this builds on

Belief Aggregation is a kind of Aggregation Prime

Pooling probability assignments is a deliberate many-to-one aggregation with probabilistic coherence constraints.

Hierarchy path (1) — routes to 1 parentless root

Belief Aggregation → Aggregation → Micro Macro Linkage

Neighborhood in Abstraction Space¶

Belief Aggregation sits in a sparse region of the domain-specific corpus (81^st percentile for distinctiveness): few abstractions share its structure, so a faithful description tends to retrieve it precisely.

Family — Strategic Decision Biases & Mechanisms (29 abstractions)

Nearest neighbors

Computed from structural-signature embeddings · 2026-10-08

Not to Be Confused With¶

Do not read every “consensus” as a probability pool. A clinical guideline vote, an ordinal rank consensus, or a single agent's posterior update fails a defining role even if it is described as belief aggregation in ordinary speech. Do not treat all pooled distributions as calibrated, nor invoke a seed's broad impossibility claim without its exact theorem assumptions. A linear pool, geometric pool and beta-transformed pool are different rules, not aliases for the identity itself. “Risk aggregation” and unqualified “opinion aggregation” remain unresolved broad surfaces, while probabilistic opinion pooling names this scoped operation.^[1]^[3]

References¶

[1] Franz Dietrich and Christian List, “Probabilistic Opinion Pooling”, original author manuscript, final 13 October 2014, introduction and §§2, 4–7, PDF pp.1–14. registry ↩a ↩b ↩c ↩d ↩e ↩f ↩g ↩h ↩i ↩j ↩k ↩l ↩m ↩n ↩o ↩p

[2] Benjamin Bernard et al., “Developing hazard scenarios from monitoring data, historical chronicles, and expert elicitation: a case study of Sangay volcano, Ecuador”, Bulletin of Volcanology 86, article 68 (2024), “Expert elicitation basics,” “Elicitation results,” Figures 7–8. registry ↩a ↩b ↩c ↩d ↩e ↩f ↩g ↩h

[3] Roopesh Ranjan and Tilmann Gneiting, “Combining Probability Forecasts”, Journal of the Royal Statistical Society: Series B 72(1) (2010), 71–91, original publisher abstract and indexed introduction. Full publisher text was not directly readable during this author pass; no case-specific numerical performance claim is made. registry ↩a ↩b ↩c ↩d ↩e ↩f ↩g ↩h ↩i