The Statistical Crisis in Science.¶
Gelman, A., & Loken, E. (2014). The Statistical Crisis in Science. American Scientist, 102(6), 460-465.
Cited by¶
2 citations across 2 artifacts.
Each citation links to the sentence it supports in the citing article.
Primes¶
- Holdout Set
- Holdout discipline compresses a sprawling family of validation failures — overfitting, p-hacking, the garden of forking paths, leakage, contamination, regression to the mean across repeated trials — into a single structural diagnostic: was the candidate shaped by the evidence now being used to score it?
This sourceNames the 'garden of forking paths', showing how selecting among many analyses or candidates against the same data inflates apparent performance — the erosion logic of repeated holdout consultation.
- Holdout discipline compresses a sprawling family of validation failures — overfitting, p-hacking, the garden of forking paths, leakage, contamination, regression to the mean across repeated trials — into a single structural diagnostic: was the candidate shaped by the evidence now being used to score it?
- Texas Sharpshooter Fallacy
- The fallacy compresses a sprawling list of separately named phenomena — HARKing, p-hacking, the garden of forking paths, selective reporting, publication bias, survivorship bias, the file-drawer problem, cherry-picking, the look-elsewhere effect, data-snooping bias — into a single mechanism running in different substrates.
This sourceIntroduces the "garden of forking paths," showing that analyst degrees of freedom inflate apparent findings even without explicit multiple testing, unifying HARKing, p-hacking, and selective reporting as one mechanism.
- The fallacy compresses a sprawling list of separately named phenomena — HARKing, p-hacking, the garden of forking paths, selective reporting, publication bias, survivorship bias, the file-drawer problem, cherry-picking, the look-elsewhere effect, data-snooping bias — into a single mechanism running in different substrates.
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:42b3f5c30f90 · see in the full table