Clustering¶
Core Idea¶
Clustering partitions a set of items into groups without predefined labels, membership fixed by within-group similarity and between-group separation in a chosen feature space — so the labels are an output of the procedure, not an input.
How would you explain it like I'm…
Sorting the Toy Pile
Groups Without Labels
Finding the Labels
Broad Use¶
- Data science: k-means, hierarchical, DBSCAN, and Gaussian-mixture clustering — the source of the algorithmic vocabulary.
- Biology: numerical taxonomy and gene-expression clustering propose species and functional modules from trait or sequence data.
- Astronomy: stellar populations, galaxy clusters, and the cosmic web's filamentary structure are identified as clustering problems.
- Public health: disease-cluster detection and phylogenetic clustering of viral isolates surface outbreak chains.
- Marketing: customer segmentation by purchase history into "lapsing high-spenders" and the like.
- Anthropology: artefact assemblages and burial styles cluster into cultural groupings before historical labels are imposed.
Clarity¶
Names the four contestable choices a discussion of "natural groups" usually leaves implicit — feature space, metric, partition method, and number of clusters — and separates discovering labels (clustering) from applying them (classification).
Manages Complexity¶
Compresses a high-dimensional population into a few group descriptions — a lossy summary that turns millions of items into a handful of characterised segments.
Abstract Reasoning¶
Licenses choice-of-metric, stability, cluster-as-hypothesis, and cluster-versus-continuum inferences — a partition that resists perturbation or alternative metrics may itself be a finding.
Knowledge Transfer¶
- Epidemiology: hierarchical clustering of viral genomes traces outbreak sources, the same machinery as species phylogeny.
- Computer vision: density- and graph-based algorithms from galactic clustering port into image segmentation.
- Cybersecurity: the anomaly-as-cluster-outlier framing runs the same machinery in reverse to flag points fitting no cluster.
Example¶
A Gaussian mixture fit by expectation-maximisation assigns points in \(\mathbb{R}^d\) to \(k\) components; the cardinality \(k\), chosen by an information criterion, is itself a claim about how many natural kinds the population contains.
Relationships to Other Abstractions¶
Current abstraction Clustering Prime
Parents (2) — more general patterns this builds on
-
Clustering is a kind of Classification Prime
Clustering is classification specialized to discovering categories from within-group similarity without predefined labels.
-
Clustering presupposes, typical Similarity Measure Prime
Most clustering operationalizes within-group likeness through a similarity, dissimilarity, kernel, or distance-derived measure, while generative mixture methods can group by likelihood or latent fit without an explicit pairwise similarity.
Children (7) — more specific cases that build on this
-
Commuting zone Domain-specific is a kind of Clustering
The proposed strict upward parent is
prime:clustering. -
Complete-linkage clustering Domain-specific is a kind of Clustering
The proposed strict upward parent is
prime:clustering. -
Geodemographic segmentation Domain-specific is a kind of Clustering
The proposed strict upward parent is
prime:clustering. -
Hopkins statistic Domain-specific is a kind of Clustering
The proposed strict upward parent is
prime:clustering. -
K-means clustering Domain-specific is a kind of Clustering
The proposed strict upward parent is
prime:clustering.
- Louvain method Domain-specific is a kind of Clustering
The proposed strict upward parent is `prime:clustering`.
- Production flow analysis Domain-specific is a kind of Clustering
The proposed strict upward parent is `prime:clustering`.
Hierarchy paths (3) — routes to 3 parentless roots
- Clustering → Classification
- Clustering → Similarity Measure → Function (Mapping)
- Clustering → Similarity Measure → Comparison → Self Checking
Not to Be Confused With¶
- Clustering is not Classification because clustering discovers labels from the data's geometry whereas classification assigns items to a known label set; they solve inverse problems.
- Clustering is not Segmentation and Boundary Drawing because segmentation cuts a domain at chosen boundaries along a known axis whereas clustering lets within-group similarity generate the grouping without committing in advance to where the cuts fall.
- Clustering is not Statistical Inference because inference estimates parameters of a known model whereas clustering is the prior, unsupervised move of proposing a discrete-mixture structure exists at all.