Source Credibility & Argument Evaluation

← Back to Domain-Specific Families

Abstractions about evaluating claims, sources, and arguments, covering journalistic attribution and correction practices (anonymous sourcing, on background, corrections policy), argument-structure and fallacy analysis (Toulmin model, appeal to authority), and trust-calibration phenomena like the Gell-Mann amnesia effect and inter-annotator agreement.

9 abstractions in this family — domain-specific abstractions that sit near one another in structural-signature space (k-means over structural-signature embeddings). Each is shown with its short description.

• Ad Verecundiam (Appeal to Authority) — The informal fallacy of treating a claim as established by an authority's credential under conditions where the citation carries no evidential weight — the credential being a signal that load-bearing conditions (domain competence, evidence access, disinterest, convergence) hold, used as though it guaranteed what it only heuristically suggests.
• Anonymous Sourcing — Publish information with the source's identity hidden from the audience but known to and vouched for by a reputation-staking intermediary, so the intermediary's verification procedure substitutes for the source's named credibility in the audience's trust calculus.
• Corrections Policy — An institution's standing rule to acknowledge errors in its public claims through visible, dated, attributed corrections that preserve the original — converting an unverifiable edit history into a reconstructible, auditable claim-trajectory.
• Gell-Mann Amnesia Effect — A reader who finds a source riddled with errors in their own field turns the page and trusts it on an unfamiliar topic, because the error was filed as topic-specific news rather than propagated to a source-level prior.
• Inter-Annotator Agreement — Measure whether independent raters applying the same coding scheme to the same items converge, using a statistic that subtracts the agreement expected by chance from the marginal label distribution.
• Mistakes were made — "Mistakes were made" is an expression that is commonly used as a rhetorical device, whereby a speaker acknowledges that a situation was handled poorly or inappropriately but seeks to evade any direct admission or accusation of responsibility.
• On Background — The middle attribution tier where a claim may be published but the source is named only by a generic class descriptor — separating evidentiary content from source identity, with descriptor granularity a tunable knob trading warrant against identifiability.
• Public Interest Test — A doctrinal override on a default prohibition that permits otherwise-protected disclosure only when an institutional decision-maker weighs a qualifying social benefit against foreseeable harm and finds it outweighs — discriminating public interest from mere public curiosity.
• Toulmin Model — Decompose an informal argument into six named slots — claim, grounds, warrant, backing, qualifier, rebuttal — so evaluation becomes a completeness check that isolates the usually-implicit warrant, where almost every contested dispute actually lives.