Skip to content

Type-Token Ratio

Estimate a language sample's lexical diversity as distinct word types over total tokens, while correcting for the sample-size confound that makes vocabulary grow sublinearly and raw TTR fall with length.

Version
v4 · 2026-09-28 · History · 6 corrections
Domain-specific #
1150
Domain group
Humanities
Origin domain
Linguistics & Semiotics
Subdomain
Lexical Statistics → Linguistics & Semiotics

Core Idea

The type-token ratio (TTR) is distinct word types over total tokens in a sample — a surface proxy for lexical diversity (400 distinct words in 1,000 tokens gives 0.40). It is simple but carries a sample-size pathology: vocabulary grows sublinearly, so raw TTR falls as a text lengthens even at constant richness, making unequal-length samples non-comparable and prompting a family of length-corrected variants.

Scope of Application

A measure requiring a sample of word types drawn from a token stream; its literal reach is bounded to the linguistic substrate.

  • Stylometry — authorship attribution and register comparison, length-corrected.
  • Child language-acquisition research — lexical-diversity growth curves over development.
  • Aphasia and dementia screening — indices of lexical-access impairment, length essential.
  • L2 writing assessment — a corrected proficiency proxy across texts of unequal length.
  • Corpus genre profiling — comparing registers, reading a difference as signal only after length control.

Clarity

The construct breaks the naive identification of the ratio with diversity itself: because vocabulary grows sublinearly, a TTR gap between two texts is confounded with a length gap. The sharp question becomes not "which sample is more diverse?" but "is this difference signal or sample-size artifact?" — a determinate question the raw comparison could not pose.

Manages Complexity

The full lexical character of a sample is the whole vocabulary-growth curve. TTR compresses that to one scalar per sample, making large-corpus profiling and clinical screening feasible. It also packages the one confound-correction: the analyst tracks the ratio plus which length-controlled variant the corpus's sample-length distribution calls for, then gates every comparison through "does it survive length control?"

Abstract Reasoning

The governing move is confound diagnosis — separating the measurement from the property, with the predictive corollary that the longer sample shows the lower raw TTR. A second move is correction selection reasoned from the growth curve: root TTR, Herdan's C, MATTR, and vocd-D are not rival definitions but length-independent estimators, the transforms each assuming a different growth curve and MATTR holding window length fixed. A guarded clinical inference chains them: control length before reading low diversity as impairment.

Knowledge Transfer

Within linguistics the ratio and its correction family transfer literally, because every subfield samples word types from token streams and faces the identical sublinear-growth confound. Beyond that substrate the honest reading splits: the general diversity-versus-volume problem genuinely recurs and is carried by the broader prime Diversity, but TTR's own machinery does not travel — ecology, genetics, and information theory each built their own sample-size corrections (rarefaction, effective number, entropy) and would not accept TTR as canonical. The problem generalizes; this solution does not.

Relationships to Other Abstractions

Local relationship map for Type-Token RatioParents appear above the current abstraction, mutual partners to the right, and children below. Node labels state whether each abstraction is prime or domain-specific; colors identify relation types.Type-Token RatioDOMAINPrime abstraction: Cardinality — includesCardinalityPRIMEDomain-specific abstraction: Heaps' Law — presupposesHeaps' LawDOMAINPrime abstraction: Measurement — is a kind ofMeasurementPRIMEPrime abstraction: Ratio — is a kind ofRatioPRIMEDomain-specific abstraction: Language Sample Analysis — includes, typicalLanguageSample AnalysisDOMAIN

Current abstraction Type-Token Ratio Domain-specific

Parents (4) — outgoing typed relations

  • Type-Token Ratio is a kind of Measurement Prime

    Type-Token Ratio is a measurement specialized to mapping a language sample's lexical richness proxy onto a quotient under a declared tokenization and correction procedure.

  • Type-Token Ratio is a kind of Ratio Prime

    Type-Token Ratio is a ratio specialized to distinct lexical types as numerator and total word tokens as the nonzero reference denominator.

  • Type-Token Ratio presupposes Heaps' Law Domain-specific

    The guarded interpretation of Type-Token Ratio presupposes Heaps' Law because sublinear vocabulary growth is what makes raw V/N decline with sample length and determines the correction.

  • Type-Token Ratio includes Cardinality Prime

    Cardinality is internal to Type-Token Ratio because the numerator is the count of members in the set of distinct lexical types observed in the sample.

Children (1) — abstractions linked here by typed relations

  • Language Sample Analysis Domain-specific includes, typical Type-Token Ratio

    Language Sample Analysis typically contains a length-controlled Type-Token Ratio or related lexical-diversity index as one coordinate of its multi-level profile.

Hierarchy paths (9) — routes to 7 parentless roots

Neighborhood in Abstraction Space

Type-Token Ratio sits in a sparse region of the domain-specific corpus (64th percentile for distinctiveness): few abstractions share its structure, so a faithful description tends to retrieve it precisely.

Family — Scaling Laws & Growth Patterns (13 abstractions)

Nearest neighbors

Computed from structural-signature embeddings · 2026-10-25