The MLnotes Newsletter

The MLnotes Newsletter

A/B ⚖ Testing with Multiple Metrics

Angelina Yang's avatar
Angelina Yang
Dec 01, 2022
∙ Paid

A lot of literature references and guidance about A/B testing anchor on tests based on one single comparison or one single metric. Some of my friends working in tech also shared that they typically focus on one primary metric when performing experiment designs (e.g., study design and sample size calculation etc.).

I'm curious if this is a common practice…

User's avatar

Continue reading this post for free, courtesy of Mehdi Allahyari.

Or purchase a paid subscription.
© 2026 MLnotes · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture