Twyman's law¶

Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another".

Version: v1 · 2026-09-28 · History
Domain-specific #: 12669
Domain group: Formal Sciences
Origin domain: Experimental Design & Statistics
Subdomains: Data Analysis, Data Quality → Experimental Design & Statistics

Core Idea¶

Twyman's law is treated here as the recurring cross-domain formal modeling identity summarized by this source-grounded definition: Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another".

Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another". It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis. The law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values.

These errors are usually more common than real changes of similar magnitude in the underlying process being measured. For example, if an analyst at a software company notices that the number of users has doubled overnight, the most likely explanation is a bug in logging, rather than a true increase in users. The law can also be extended to situations where the underlying data is influenced by unexpected factors that differ from what was intended to be measured.

For Twyman's law, the abstraction is narrower than the article's general subject matter: a positive case must preserve Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another". Retaining only the name, a familiar example, or a downstream effect is insufficient. The specialist roles and tests remain anchored in cross-domain formal modeling, which is why this identity is domain-specific rather than prime.

Structural Signature¶

Sig role-phrases:

Defining carrier — These errors are usually more common than real changes of similar magnitude in the underlying process being measured.
Constitutive relation — The law can also be extended to situations where the underlying data is influenced by unexpected factors that differ from what was intended to be measured.
Operating condition — For example, when schools show unusually large improvements in test scores, subsequent investigation often reveals that those scores were driven by fraud.
Recognition evidence — It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis.
Admissible variation — The law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values.
Characteristic consequence — For example, if an analyst at a software company notices that the number of users has doubled overnight, the most likely explanation is a bug in logging, rather than a true increase in users.
Failure boundary — Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another".

What It Is Not¶

Not the whole field of cross-domain formal modeling. The node requires the specific identity stated by Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another".
Not an over-broad reading. The law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values.
Not an over-broad reading. For example, if an analyst at a software company notices that the number of users has doubled overnight, the most likely explanation is a bug in logging, rather than a true increase in users.
Not an over-broad reading. Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another".
Not automatically Paradox of analysis. Retrieval proximity does not establish equivalence; the two identities must be compared by carrier, operation, and failure boundary.

Scope of Application¶

Twyman's law applies literally inside cross-domain formal modeling wherever the source-defined carrier and relation can be established. Its documented habitats include:

Documented setting. It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis.
Documented setting. The law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values.
Documented setting. These errors are usually more common than real changes of similar magnitude in the underlying process being measured.
Documented setting. For example, if an analyst at a software company notices that the number of users has doubled overnight, the most likely explanation is a bug in logging, rather than a true increase in users.
Documented setting. The law can also be extended to situations where the underlying data is influenced by unexpected factors that differ from what was intended to be measured.
Documented setting. For example, when schools show unusually large improvements in test scores, subsequent investigation often reveals that those scores were driven by fraud.

Outside cross-domain formal modeling, the name should be retained only when these same operational conditions survive; otherwise the comparison belongs to the broader parent Pattern or should be marked as analogy.

Clarity¶

A clear use of Twyman's law names the carrier, the operative relation, and the conditions under which the source treats the identity as present. The minimal definition is Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another". The strongest recognition evidence in the frozen account is: It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis. A report should distinguish that evidence from a proxy, consequence, or common implementation. It should also state the qualification The law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values. so that a reader can reproduce the classification rather than infer it from topical resemblance.

Manages Complexity¶

Twyman's law compresses multiple cross-domain formal modeling details into a stable diagnostic relation. The source shows both the central mechanism—the law can also be extended to situations where the underlying data is influenced by unexpected factors that differ from what was intended to be measured.—and the practical consequence—for example, if an analyst at a software company notices that the number of users has doubled overnight, the most likely explanation is a bug in logging, rather than a true increase in users. This compression makes cases comparable while leaving parameters, conventions, exceptions, and evidential quality explicit. It is lossy by design: local history and implementation details may be omitted only when they do not alter the defining relation.

Abstract Reasoning¶

Type the carrier. Identify the cross-domain formal modeling entities to which the claim applies.
State the relation. Use the source-grounded identity: Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another".
Check operation and conditions. For example, when schools show unusually large improvements in test scores, subsequent investigation often reveals that those scores were driven by fraud.
Demand recognition evidence. It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis.
Test variation. Change an implementation or setting while preserving the law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values.
Run the collapse test. Remove the defining operation; if the label still seems equally apt, only a topic or correlate was retained.
Reduce cautiously. When the specialist conditions cannot be carried, route the residual comparison to Pattern.

Knowledge Transfer¶

Within the home domain. Knowledge about Twyman's law transfers literally when a new case preserves the same carrier type, relation, and recognition test. It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis. The law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values.

Beyond the home domain. No canonical parent is asserted for Twyman's law. An outside case receives the specialist name only when the same typed roles and rejection conditions can be filled literally; otherwise the comparison remains an analogy pending later graph densification.

Examples¶

Canonical¶

For example, if an analyst at a software company notices that the number of users has doubled overnight, the most likely explanation is a bug in logging, rather than a true increase in users. This case is canonical because it supplies a concrete carrier and lets the defining relation be checked rather than merely named.

Mapped back: carrier → the entities in the documented case; operation → Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another"; recognition evidence → It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis

Applied / In Practice¶

For example, when schools show unusually large improvements in test scores, subsequent investigation often reveals that those scores were driven by fraud. The applied case shows how the identity is used under a second setting or qualification while keeping the same operative relation.

Mapped back: changed setting → the applied context; invariant → Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another"; boundary → the case exits the class when the law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values

Structural Tensions¶

T1 — Stable identity versus admissible variation. The law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values. The tension matters because emphasizing only one side either dissolves the identity or overstates what the evidence and domain conventions warrant.

Diagnostic: Which changes preserve the defining relation, and which replace it?

T2 — Recognition versus proxy. For example, if an analyst at a software company notices that the number of users has doubled overnight, the most likely explanation is a bug in logging, rather than a true increase in users. The tension matters because emphasizing only one side either dissolves the identity or overstates what the evidence and domain conventions warrant.

Diagnostic: Does the cited evidence establish the identity or only a correlated sign?

T3 — Definition versus implementation. Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another". The tension matters because emphasizing only one side either dissolves the identity or overstates what the evidence and domain conventions warrant.

Diagnostic: Is the observed implementation constitutive, optional, or merely common?

T4 — Scope versus overextension. It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis. The tension matters because emphasizing only one side either dissolves the identity or overstates what the evidence and domain conventions warrant.

Diagnostic: Can every claimed application fill the same typed roles without metaphor?

T5 — Transfer versus domain accent. These errors are usually more common than real changes of similar magnitude in the underlying process being measured. The tension matters because emphasizing only one side either dissolves the identity or overstates what the evidence and domain conventions warrant.

Diagnostic: Does the receiving case instantiate Twyman's law literally, co-instantiate Pattern, or only resemble it?

T6 — Autonomy versus reduction. The law can also be extended to situations where the underlying data is influenced by unexpected factors that differ from what was intended to be measured. The tension matters because emphasizing only one side either dissolves the identity or overstates what the evidence and domain conventions warrant.

Diagnostic: What does Twyman's law distinguish that the broader parent Pattern leaves together?

Structural–Framed Character¶

Twyman's law is mixed or framed-leaning. Its structural side is the repeatable organization summarized by Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another". Its framed side is the cross-domain formal modeling vocabulary that fixes the carrier, evidence, exceptions, and admissible transformations.

Evaluative weight: the identity can be stated descriptively even when applications carry practical stakes. Human-practice dependence: the source-grounded carrier determines whether the relation exists independently or is constituted by a practice. Institutional origin: disciplinary conventions stabilize the name and test. Vocabulary portability: For example, when schools show unusually large improvements in test scores, subsequent investigation often reveals that those scores were driven by fraud. Import versus recognition: literal transfer requires the same mechanism; shape alone is analogy.

Its portable skeleton is Pattern. Its character: a recurring specialist identity whose thin organization can be abstracted, while its operational meaning remains domain-bound.

Structural Core vs. Domain Accent¶

What is skeletal. Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another". The stable skeleton is the typed relation expressed in that definition and the entry's recognition and collapse tests. The source identifies these operative conditions: These errors are usually more common than real changes of similar magnitude in the underlying process being measured. The law can also be extended to situations where the underlying data is influenced by unexpected factors that differ from what was intended to be measured. It further constrains recognition and variation through: For example, when schools show unusually large improvements in test scores, subsequent investigation often reveals that those scores were driven by fraud. It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis.

What is domain-bound. cross-domain formal modeling supplies the operative entities, technical vocabulary, warrants, and exceptions that make Twyman's law literal. Its documented scope includes the condition that It is named after the media and market researcher Tony Twyman and has been described as one of the most important laws of data analysis. Another bounded application condition is that The law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values. These are not decorative examples; they determine which carrier and evidence can fill the abstraction's roles.

Why no parent is asserted. Removing those specialist details does not currently yield one live catalog node that is a necessary genus for every instance. The entry is therefore approved as unparented rather than attached by topical resemblance. Its collapse evidence remains specific—The law is based on the fact that errors in data measurement and analysis can lead to observed quantities that are wildly different from typical values.—and future graph densification may discover a defensible relation only if it preserves that boundary.

Approved unparented node. No current live node supplies a defensible necessary genus or structural prerequisite for Twyman's law. The reviewed identity is: Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another". The accelerated suggestion was declined because topical or lexical similarity does not establish hierarchy; the node is admitted without a parent pending later graph densification.
Related reasoning operations. Evidence, representation, comparison, classification, transformation, or evaluation may participate in particular cases, but participation does not make any one of them a necessary parent of every instance.

Neighborhood in Abstraction Space¶

Twyman's law sits in a moderately populated region (48^th percentile for distinctiveness): it has near-neighbors but no dense thicket of look-alikes.

Family — Inferential Fallacies & Research Biases (18 abstractions)

Nearest neighbors

Data element — 0.87
Control chart — 0.87
Value at risk — 0.86
Single Vegetative Obstruction Model — 0.86
Automatic item generation — 0.86

Computed from structural-signature embeddings · 2026-10-08

Not to Be Confused With¶

Pattern. The parent omits the specialist differentia. Tell: Can the case establish Twyman's law states that "Any figure that looks interesting or different is usually wrong", following the principle that "the more unusual or interesting the data, the more likely they are to have been the result of an error of one kind or another"?
Paradox of analysis. The puzzle that a correct conceptual analysis appears uninformative if analysandum and analysans mean the same thing, yet incorrect if they do not. Tell: Which entry's carrier, operation, and failure condition are satisfied?
Faulty generalization. An informal fallacy that infers a broad population claim from evidence too small, biased or unrepresentative to warrant that scope. Tell: Which entry's carrier, operation, and failure condition are satisfied?
Precision Weighting. Signals about the same latent quantity receive influence in proportion to estimated precision, so more reliable evidence contributes more while context may revise the weights. Tell: Which entry's carrier, operation, and failure condition are satisfied?
A measurement, proxy, or consequence. Those may provide evidence without being the identity. Tell: Would Twyman's law remain present if the detector or downstream effect changed?
A metaphorical analogue. A similar shape outside cross-domain formal modeling lacks the specialist mechanism. Tell: Do the native roles transfer literally, or only the parent Pattern?

References¶

Frozen Wikipedia discovery revision: https://en.wikipedia.org/wiki/Twyman%27s_law (revision 1366575530).
Preserved source candidate: https://www.exp-platform.com/Documents/TwymansLaw.pdf
Preserved source candidate: https://books.google.com/books?id=qAcXIgxMF98C&pg=PA46
Preserved source candidate: https://books.google.com/books?id=TFjPDwAAQBAJ&pg=PA39
Preserved source candidate: https://hechingerreport.org/when-test-scores-are-too-good-to-be-true/
Preserved source candidate: https://geneyx.com/

The frozen Wikipedia revision is discovery provenance. The retained source set was reviewed for identity, formal or operational relation, and scope. The encyclopedia's structural synthesis is bounded to those claims; a thin authority surface is recorded as a nonblocking source-strengthening repair rather than concealed.