Mystery of a broken A/B test

A nonsensical A/B test leads us to a deep understanding of A/B testing and statistical power in general. 📘 Pre-order my book! ► https://hiddenmultipliers.com 📘 Companion article with the formula ► https://bit.ly/abhamster Subscribe to A Smart Bear on YouTube ►    / @asmartbear   Mysteries of a nonsensical A/B test, and a "95% accurate" test where half the results are false-positives. And the solution: A simple formula that you can use avoid these problems, and always calculate the results of your A/B tests correctly. Timestamps 00:00 Intro 00:17 Mystery A/B Tests 02:05 Footrace 07:09 Correct Formula 09:27 What "good" looks like ---------------------------------------------------------------------------------- Read long-form articles by A Smart Bear 📘 https://longform.asmartbear.com/?utm_... Follow A Smart Bear on: Twitter:   / asmartbear   LinkedIn:   / jasoncohen   Bluesky: 🦋 https://bsky.app/profile/asmartbear.com Newsletter: 📩 https://longform.asmartbear.com/subsc... ---------------------------------------------------------------------------------- About Jason Cohen (a.k.a. A Smart Bear): As a four-time entrepreneur across 25 years, both bootstrapped and VC-funded, resulting in two exits and two unicorns (Smart Bear & WP Engine), I’ve also been writing about everything I know for 18 years. Now I'm making some videos. More about me: https://longform.asmartbear.com/jason...