The MLnotes Newsletter

The MLnotes Newsletter

Share this post

The MLnotes Newsletter
The MLnotes Newsletter
A/B ⚖ Testing with Multiple Metrics

A/B ⚖ Testing with Multiple Metrics

Angelina Yang's avatar
Angelina Yang
Dec 01, 2022
∙ Paid
6

Share this post

The MLnotes Newsletter
The MLnotes Newsletter
A/B ⚖ Testing with Multiple Metrics
Share

A lot of literature references and guidance about A/B testing anchor on tests based on one single comparison or one single metric. Some of my friends working in tech also shared that they typically focus on one primary metric when performing experiment designs (e.g., study design and sample size calculation etc.).

I'm curious if this is a common practice…

Keep reading with a 7-day free trial

Subscribe to The MLnotes Newsletter to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 MLnotes
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share