1. https://towardsdatascience.com/7-a-b-testing-questions-and-answers-in-data-science-interviews-eee6428a8b63
  2. https://www.youtube.com/watch?v=X8u6kr4fxXc
  3. https://uxdesign.cc/how-netflix-does-a-b-testing-87df9f9bf57c

What is A/B Testing

image.png

Interview Questions
image.png

Design the test

image.png

Sample size

image.png
σ²：sample variance
image.png
image.png
image.png

How long to run?

image.png

MULTIPLE TESTING PROBLEM

image.png

image.png

Dealing with ‘mutiple testing’ problem

image.png
image.png

Novelty and Primacy Effect

image.png
image.png
image.png

INTERFERENCE BETWEEN VARIANTS

image.png
image.png
image.png
image.png

image.png
image.png

👇 How do we design the test to prevent the spill over between control and treatment？👇

Dealing with inference

image.png
image.png
image.pngimage.png

image.png
image.png
image.png