Controlled Experiments on the Web¶
Kohavi, R., Longbotham, R., Sommerfield, D., & Henne, R. M. (2009). Controlled Experiments on the Web: Survey and Practical Guide. Data Mining and Knowledge Discovery, 18(1), 140-181.
Cited by¶
3 citations across 3 artifacts.
Each citation links to the sentence it supports in the citing article.
Mechanisms¶
- Cross-Functional Design Review
- The classic misuse is running the review to ratify a choice already made by the highest-paid person's opinion
This sourceContrasts evidence from controlled experiments with decisions driven by the Highest Paid Person's Opinion.
- The classic misuse is running the review to ratify a choice already made by the highest-paid person's opinion
- Leader-Last Protocol
- The protocol is not silencing the leader; it is stopping the leader from becoming the default answer — the classic "highest paid person's opinion" effect.
This sourceWarns against allowing the Highest Paid Person's Opinion to substitute for evidence from users and controlled experiments.
- The protocol is not silencing the leader; it is stopping the leader from becoming the default answer — the classic "highest paid person's opinion" effect.
- Stakeholder Frontier Review
- Its failure mode is authority substituting for legitimacy: the most senior or loudest voice in the room dictating the outcome regardless of the merits or the affected owners (the classic "HiPPO" trap
This sourceIdentifies the HiPPO trap as allowing the Highest Paid Person's Opinion to substitute for customer evidence.
- Its failure mode is authority substituting for legitimacy: the most senior or loudest voice in the room dictating the outcome regardless of the merits or the affected owners (the classic "HiPPO" trap
Verification¶
Does it exist? Confirmed. This work's DOI resolves to a registered record, which fixes its identity. That is all it fixes.
Does it back the claim? Not recorded. Neither this nor any other of the 3 citations of this work carries a recorded support check.
Support is checked per citation rather than per work — the same source can be cited soundly in one article and wrongly in another. Per-citation recording began recently, so a citation with no recorded check is a gap in the record rather than evidence it went unchecked.
See how references were verified.
Registry ID ref:e7bc8f037ba5 · see in the full table