Local Maximum: What It Is, and How to Get Over It in A/B Testing¶
Birkett, A. (2022). Local Maximum: What It Is, and How to Get Over It in A/B Testing: What It Is, and How to Get Over It in A/B Testing. CXL.
Cited by¶
1 citation across 1 artifact.
Each citation links to the sentence it supports in the citing article.
Mechanisms¶
- Prototype A/B or Multivariate Test
- Its failure mode is that an A/B test optimises the variants you thought to build, so relentless local tuning climbs the nearest hill and can miss the better design that was never in the test — the local-optimum trap.
This sourceExplains how iterative A/B testing can reach a local maximum and miss larger gains available only through innovative tests or redesign.
- Its failure mode is that an A/B test optimises the variants you thought to build, so relentless local tuning climbs the nearest hill and can miss the better design that was never in the test — the local-optimum trap.
Verification¶
This reference passed the adversarial substantiation pipeline: it was checked to exist and to support the claim it is attached to. See how references were verified.
Registry ID ref:4f562526584d · see in the full table