Statistical Paradoxes & Distributional Structure

Abstractions about how summary statistics and distributions can mislead or reveal — paradoxes like Anscombe's quartet, the coastline paradox, and the friendship paradox, distributional regularities like Benford's and Gibrat's laws, and formal building blocks like random variables and probability distributions.

11 abstractions in this family — domain-specific abstractions that sit near one another in structural-signature space (k-means over structural-signature embeddings). Each is shown with its short description.

• Anscombe's Quartet — Four hand-built bivariate datasets that share nearly identical low-order summary statistics yet have radically different scatter geometries, demonstrating that summaries are lossy projections and that one must visualize before granting any parametric summary authority over the data.
• Benford's Law — Score a dataset's honesty by checking whether its leading digits follow the fixed logarithmic curve log₁₀((d+1)/d) — about 30% start with 1, only 5% with 9 — that scale-spanning multiplicative data must obey.
• Big O Notation — Classify a function by its order of growth — discarding constant factors and small-input detail — so algorithms can be compared by how they scale rather than how fast they run on one machine.
• Coastline Paradox — A rough natural coastline has no fixed length — it grows without bound as the measuring ruler shrinks — so the stable thing to report is not a length but the fractal dimension governing how length scales with the ruler.
• Differential equation — A mathematical equation relating an unknown function to its own derivatives, encoding the law that a quantity's rate of change depends on its current state — so specifying the local rule plus initial or boundary conditions fixes the entire trajectory.
• Friendship Paradox — Explain why your friends have more friends than you as the exact consequence of edge-sampling — reaching a node by following a tie over-represents high-degree nodes by exactly the degree variance divided by the mean.
• Gambler's Fallacy — Catch the error of believing a run of one outcome makes the opposite 'due' on the next trial — imposing the law of large numbers' aggregate balance as a within-trial obligation — by first screening whether the trial process is independent.
• Gibrat's Law — The claim that a firm's proportional growth rate is independent of its current size — which, iterated as multiplicative iid noise, makes log-size a random walk and drives the cross-sectional size distribution toward log-normal.
• Gini Coefficient — Collapse a whole distribution of a resource into one number on a 0-to-1 scale by measuring how far its Lorenz curve bows away from perfect equality.
• Probability Distribution — The complete specification of how probability mass or density is spread over a random variable's possible values — a measure that, once compressed to a named parametric family, encodes shape, moments, tails, and a generative claim about the process producing the data.
• Random Variable — Translate an uncertain event into a measurable function X: Ω → ℝ on a probability space, so that a number attaches to each outcome and the whole apparatus of expectation, distribution, and convergence becomes computable before any value is observed.