Producing Wrong Data Without Doing Anything Obviously Wrong!¶
Mytkowicz, T., Diwan, A., Hauswirth, M., & Sweeney, P. F. (2009). Producing Wrong Data Without Doing Anything Obviously Wrong!. Proceedings of ASPLOS ’09, 265-276.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Mechanisms¶
- Algorithm Benchmarking
- A benchmark is honest only about the sizes it ran and the inputs it used; extrapolating a smooth line past the last rung can hide a cliff sitting just beyond it, and a microbenchmark can produce a beautiful, meaningless number
This sourceShows that seemingly innocuous experimental-setup choices can make systems performance measurements support incorrect conclusions.
- A benchmark is honest only about the sizes it ran and the inputs it used; extrapolating a smooth line past the last rung can hide a cliff sitting just beyond it, and a microbenchmark can produce a beautiful, meaningless number
Verification¶
Does it exist? Confirmed. This work's DOI resolves to a registered record, which fixes its identity. That is all it fixes.
Does it back the claim? Not recorded. The single citation of this work carries no recorded support check.
Support is checked per citation rather than per work — the same source can be cited soundly in one article and wrongly in another. Per-citation recording began recently, so a citation with no recorded check is a gap in the record rather than evidence it went unchecked.
See how references were verified.
Registry ID ref:4e16874378db · see in the full table