Psychology of Intelligence Analysis¶
J., H. R. (1999). Psychology of Intelligence Analysis.
Cited by¶
28 citations across 28 artifacts.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Absence as Information
- Diplomacy and intelligence. A meeting that did not happen, a statement not issued, a delegation not sent — trained analysts read these silences as signals of comparable weight to actions.
This sourceCanonical analytic-tradecraft text; argues analysts systematically under-weight the absence of expected evidence and that a non-event (e.g., expected activity that fails to appear, deception that leaves no trace) is itself a signal that must be reasoned about.
- Diplomacy and intelligence. A meeting that did not happen, a statement not issued, a delegation not sent — trained analysts read these silences as signals of comparable weight to actions.
- Alertness
- Field tracking, code review, negotiation, and intelligence analysis (the indications-and-warning function) all name the same trainable capacity under different vocabularies.
This sourceCanonical analytic-tradecraft text on the indications-and-warning function and the trained capacity to notice anomalies and the absence of expected evidence — the same noticing capacity named under a different vocabulary.
- Field tracking, code review, negotiation, and intelligence analysis (the indications-and-warning function) all name the same trainable capacity under different vocabularies.
- Collective Systemic Learning
This sourceCenter for the Study of Intelligence, Central Intelligence Agency. Treats cognitive biases in analysis and structured techniques for improving judgment from accumulated evidence.
- Confirmation Bias
- .
This sourceFoundational treatment of cognitive bias in intelligence analysis; develops the Analysis of Competing Hypotheses (ACH) method and treats confirmation bias / oversensitivity to consistency as a central analyst failure mode. (Annotation corrected in a prior pass — see citation-fix flag; prior annotation described signal-detection Type I/II trade-offs that belong to a different source.) Live-verified (CIA CSI).
- .
- Cromwell's Rule
- Scientific practice — falsifiability requires that no theory be treated as certain, and pre-registration and adversarial collaboration assume nonzero credences in alternative hypotheses. Intelligence analysis — doctrines that prohibit treating any assessment as 100% certain (confidence scales rather than certainty) implement the rule institutionally; major intelligence failures illustrate the cost of closure.
This sourceArgues against treating any assessment as certain and for analysis-of-competing-hypotheses and calibrated confidence rather than 100%-certainty judgments.
- Scientific practice — falsifiability requires that no theory be treated as certain, and pre-registration and adversarial collaboration assume nonzero credences in alternative hypotheses. Intelligence analysis — doctrines that prohibit treating any assessment as 100% certain (confidence scales rather than certainty) implement the rule institutionally; major intelligence failures illustrate the cost of closure.
- Formal vs. Informal Structures
This sourceApplies cognitive psychology to intelligence analysis, covering mental models, cognitive biases, and tools such as analysis of competing hypotheses.
- Horizon Scanning
- T1: Signal-detection sensitivity vs false-alarm rate.
This sourceCenter for the Study of Intelligence, Central Intelligence Agency. Foundational treatment of warning analysis: develops the Type I / Type II error trade-off in intelligence detection and the cognitive sources of false-alarm fatigue and missed-signal bias.
- T1: Signal-detection sensitivity vs false-alarm rate.
- Narrative
This sourceCentral Intelligence Agency.
- Researcher Degrees of Freedom
- In investigative journalism and intelligence analysis, the choice of framing, which sources to weight, and which timeframes to compare reproduces the identical structure under a different label.
This sourceDocuments how framing, mental models, and selective source weighting shape analytic judgments — the forking-path structure in intelligence and investigative reporting.
- In investigative journalism and intelligence analysis, the choice of framing, which sources to weight, and which timeframes to compare reproduces the identical structure under a different label.
- Sensemaking
This sourceCentral Intelligence Agency.
- Transferability Overclaim
- In intelligence and policy analysis it is a model of one adversary's behavior generalized into a doctrine about adversaries in general, losing the actor-specific factors that produced the original pattern.
This sourceIdentifies 'mirror-imaging' and over-generalization — projecting a model of one actor onto adversaries in general — as a recurring analytic error.
- In intelligence and policy analysis it is a model of one adversary's behavior generalized into a doctrine about adversaries in general, losing the actor-specific factors that produced the original pattern.
- Underspecification
- In intelligence analysis, the same collected indicators are consistent with several adversary-intent hypotheses, and the chosen hypothesis is the analyst's default, not the data's verdict.
This sourceDescribes how the same indicators are consistent with several adversary-intent hypotheses and the chosen hypothesis reflects the analyst's default, motivating analysis of competing hypotheses.
- In intelligence analysis, the same collected indicators are consistent with several adversary-intent hypotheses, and the chosen hypothesis is the analyst's default, not the data's verdict.
- Vantage-Induced Omission
- A reasoner who has seen a safety regulator discover that its incidents concentrate in unregistered subcontractor facilities, overnight shifts, and non-English-speaking subcultures — all unreachable from a vantage of scheduled, working-hours, English-language inspections — can recognise the identical shape when a newsroom's beat structure fails to cover suburban county-government meetings and readers experience the gap as "nothing important is happening there."
This sourceAnalysis of how collection vantage and absence-of-evidence reasoning mislead, and the discipline of complementary sources.
- A reasoner who has seen a safety regulator discover that its incidents concentrate in unregistered subcontractor facilities, overnight shifts, and non-English-speaking subcultures — all unreachable from a vantage of scheduled, working-hours, English-language inspections — can recognise the identical shape when a newsroom's beat structure fails to cover suburban county-government meetings and readers experience the gap as "nothing important is happening there."
- Viewpoint
- The bias profile is the systematic slant each source carries on what it does collect: a defector's account is shaped by their motives, an intercept by what the adversary chose to transmit.
This sourceSource-specific bias and the discipline of analyzing disagreement structurally across stations rather than as one source lying.
- The bias profile is the systematic slant each source carries on what it does collect: a defector's account is shaped by their motives, an intercept by what the adversary chose to transmit.
- Weak Signals & Emerging Issues
- The triage problem itself is fundamentally asymmetric: criteria tuned to suppress false positives also suppress the weakest real signals, a calibration tension Heuer (1999) anatomizes in his analytic-tradecraft treatment of how cognitive heuristics systematically degrade early-warning judgment.
This sourceCenter for the Study of Intelligence, Central Intelligence Agency. Foundational treatment of warning analysis: develops the Type I / Type II error trade-off in intelligence detection and the cognitive sources of false-alarm fatigue and missed-signal bias.
- The triage problem itself is fundamentally asymmetric: criteria tuned to suppress false positives also suppress the weakest real signals, a calibration tension Heuer (1999) anatomizes in his analytic-tradecraft treatment of how cognitive heuristics systematically degrade early-warning judgment.
Domain-specific¶
- Internal validity
- But those domains do not inherit the Cook-Campbell catalog; each has evolved its own substrate-specific threat list — fault-tree analysis in engineering, structured analytic techniques and cognitive-bias checks in intelligence, counterfactual reasoning in history — addressing the same general problem with different machinery
Supported in partVerified against the source
- But those domains do not inherit the Cook-Campbell catalog; each has evolved its own substrate-specific threat list — fault-tree analysis in engineering, structured analytic techniques and cognitive-bias checks in intelligence, counterfactual reasoning in history — addressing the same general problem with different machinery
- Theme Reification
- . Education research — coded classroom or learner data whose higher-order themes acquire explanatory force over student behaviour their underlying utterances never asserted. Organisational ethnography — fieldwork themes reified into stable features "of the organisation" with the coding provenance gone dark. Intelligence analysis — an analyst's memo whose thematic abstractions are reported as found facts about the situation rather than authored groupings of source material
This sourceThe analyst's mind-set and implicit assumptions as shaping intelligence analysis, with objectivity gained by making those assumptions explicit.
Supported in partVerified against the work's full text
“This selection and organization can only be accomplished according to conscious or subconscious assumptions and preconceptions.”
- . Education research — coded classroom or learner data whose higher-order themes acquire explanatory force over student behaviour their underlying utterances never asserted. Organisational ethnography — fieldwork themes reified into stable features "of the organisation" with the coding provenance gone dark. Intelligence analysis — an analyst's memo whose thematic abstractions are reported as found facts about the situation rather than authored groupings of source material
Mechanisms¶
- Associative Claim Red Team
- Its strength is catching confirmation-driven reasoning at its most seductive — an association that feels like evidence — by pre-registering what would refute it, the same disconfirmation-first discipline behind structured Analysis of Competing Hypotheses
This sourcePresents Analysis of Competing Hypotheses as a structured, disconfirmation-oriented method that compares alternatives and seeks evidence capable of refuting them.
- Its strength is catching confirmation-driven reasoning at its most seductive — an association that feels like evidence — by pre-registering what would refute it, the same disconfirmation-first discipline behind structured Analysis of Competing Hypotheses
- Case Comparison Matrix
- It misleads when discriminating rows are left out (an all-shared-features matrix flatters every candidate equally
This sourceExplains that evidence consistent with every competing hypothesis has no diagnostic value because it does not distinguish among them.
- It misleads when discriminating rows are left out (an all-shared-features matrix flatters every candidate equally
- Claim-Warrant Matrix
- The matrix's discipline — borrowed from the analysis of competing hypotheses — is to disbelieve on contradiction rather than believe on confirmation
This sourceInstructs analysts to test competing hypotheses by seeking contradictions and rejecting inconsistent explanations rather than accumulating confirming evidence.
- The matrix's discipline — borrowed from the analysis of competing hypotheses — is to disbelieve on contradiction rather than believe on confirmation
- Counterparty Model Red Team
- Its strength is that it kills premature convergence — the single, comfortable story a group locks onto — and it directly targets mirror-imaging, the assumption that the counterparty reasons and values as the actor would.
This sourceDefines mirror-imaging as assuming that another party reasons and values as the analyst would.
- Its strength is that it kills premature convergence — the single, comfortable story a group locks onto — and it directly targets mirror-imaging, the assumption that the counterparty reasons and values as the actor would.
- Discriminating Test Matrix
- Its strength is that it kills the natural habit of piling up confirming-but-non-diagnostic evidence and points effort at the one observation that actually separates the rivals — the central discipline of Analysis of Competing Hypotheses.
This sourceDefines Analysis of Competing Hypotheses around diagnostic evidence that discriminates among alternatives rather than merely confirming a favored one.
- Its strength is that it kills the natural habit of piling up confirming-but-non-diagnostic evidence and points effort at the one observation that actually separates the rivals — the central discipline of Analysis of Competing Hypotheses.
- Evidence Comparison Matrix
- The guarding discipline, borrowed from Analysis of Competing Hypotheses,
This sourcePresents ACH as a matrix of competing hypotheses and evidence, emphasizing inconsistency and selecting the hypothesis with the least evidence against it.
- The guarding discipline, borrowed from Analysis of Competing Hypotheses,
- Evidence Weighting Rubric
- Its strength is that it separates noticed from weighed by construction — the pre-committed criteria and the gate make it structurally hard for salience to masquerade as significance, and the visible scores turn arguments about a hunch into arguments about a named criterion.
This sourceUses an explicit matrix to weigh each item's diagnostic value across competing hypotheses.
- Its strength is that it separates noticed from weighed by construction — the pre-committed criteria and the gate make it structurally hard for salience to masquerade as significance, and the visible scores turn arguments about a hunch into arguments about a named criterion.
- Intelligence Analysis Cell
- Keeping competing hypotheses live with explicit disconfirming evidence is the core of structured analytic tradecraft — the discipline of Analysis of Competing Hypotheses is built precisely to stop an analyst from anchoring on the first plausible story.
This sourceDefines Analysis of Competing Hypotheses as a structured comparison of plausible alternatives using evidence that is inconsistent with each, countering premature commitment to a favored explanation.
- Keeping competing hypotheses live with explicit disconfirming evidence is the core of structured analytic tradecraft — the discipline of Analysis of Competing Hypotheses is built precisely to stop an analyst from anchoring on the first plausible story.
- Interpretation Red Team
- This mirrors the discipline of Analysis of Competing Hypotheses, whose point is to disconfirm rather than confirm the leading view.
This sourceDefines Analysis of Competing Hypotheses as testing plausible alternatives against inconsistent evidence and emphasizing disconfirmation of the favored explanation.
- This mirrors the discipline of Analysis of Competing Hypotheses, whose point is to disconfirm rather than confirm the leading view.
- Part-Whole Mapping Matrix
- It is the discipline behind Analysis of Competing Hypotheses, which arrays evidence against rival explanations precisely to see which evidence is truly diagnostic.
This sourceDescribes Analysis of Competing Hypotheses as arranging evidence against rival explanations in a matrix to identify diagnostically useful evidence.
- It is the discipline behind Analysis of Competing Hypotheses, which arrays evidence against rival explanations precisely to see which evidence is truly diagnostic.
- Rival Hypothesis Red Team
- It operationalizes something like Analysis of Competing Hypotheses
This sourceDefines Analysis of Competing Hypotheses as comparison of alternatives against evidence rather than acceptance of the first satisfactory explanation.
- It operationalizes something like Analysis of Competing Hypotheses
Verification¶
Does it exist? Not checked yet. This entry carries no identifier to resolve. It was extracted from the citation as written in the article, normalized, and deduplicated against the rest of the registry.
Does it back the claim? Read against the text for 2 of 28 citations: 2 supported in part. Each verdict is shown under its citation below, with what in the work backs the sentence.
Was it audited? Yes. A second, independent pass read the citation against the article text and recorded a verdict.
Support is checked per citation rather than per work — the same source can be cited soundly in one article and wrongly in another. Per-citation recording began recently, so a citation with no recorded check is a gap in the record rather than evidence it went unchecked.
See how references were verified.
Links previously used in the corpus¶
Before the registry existed this work was also linked 1 other way.
- https://www.cia.gov/static/9a5f1162fd0932c29bfed1c030edf4ae/Pyschology-of-Intelligence-Analysis.pdf ×1
Registry ID ref:25263748e8ff · see in the full table