Awesome A/B Testing

本页面会陆续更新一些感觉还不错的a/b testing的参考资料，包括理论基础和业界工程实践
Foundations

• Wikipedia: A/B testing
• What is A/B Testing? https://www.quora.com/What-is-A-B-testing-1
• How A/B Testing works? https://blog.kissmetrics.com/how-ab-testing-works/
• Effective A/B Testing http://elem.com/~btilly/effective-ab-testing/
• The Ultimate Guide To A/B Testing
• https://www.quora.com/Are-there-any-online-courses-on-A-B-testing
• Google: Overlapping Experiment Infrastructure: More, Better, Faster Experimentation
• http://research.google.com/pubs/pub36500.html
  • PPThttps://static.googleusercontent.com/media/research.google.com/zh-CN//archive/papers/Overlapping_Experiment_Infrastructure_More_Be.pdf
• Google开设的A/B testing在线课程
• https://www.udacity.com/course/ab-testing–ud257
• https://www.wired.com/2012/04/ff_abtesting/
• https://github.com/ethen8181/machine-learning/blob/master/ab_tests/paper/mostwinningabtestresultsareillusory_0.pdf
• Large-Scale Validation and Analysis of Interleaved Search Evaluation
• http://www.cs.cornell.edu/people/tj/publications/chapelle_etal_12a.pdf
• Facebook: Airlock - Facebook’s mobile A/B testing framework
• https://code.facebook.com/posts/520580318041111/airlock-facebook-s-mobile-a-b-testing-framework/
• A/B Testing Tech Note: determining sample size
• https://signalvnoise.com/posts/3004-ab-testing-tech-note-determining-sample-size
• Switchboard - easy A/B testing for your mobile app
• http://keepsafe-engineering.tumblr.com/post/28437940369/easy-mobile-ab-testing
• https://github.com/KeepSafe/Switchboard
• twitter+aabb: https://blog.twitter.com/engineering/en_us/a/2016/implications-of-use-of-multiple-controls-in-an-ab-test.html
• 天猫app的abtest实践: http://www.infoq.com/cn/articles/tmall-app-ab-test
• Pinterest AB: https://medium.com/@Pinterest_Engineering/building-pinterests-a-b-testing-platform-ab4934ace9f4
• Experimentation@Airbnb: ExperimentationatAirbnb.pdf
• A/B Testing@LinkedIn:
  • Thoughts Sharing on A%2FB Testing (ByteDance).pptx
  • https://content.linkedin.com/content/dam/engineering/site-assets/pdfs/ABTestingSocialNetwork_share.pdf
• The Netflix Experimentation Platform
  • https://medium.com/netflix-techblog/its-all-a-bout-testing-the-netflix-experimentation-platform-4e1ca458c15
  • 2 Period Experiment：Interleaving+A/B https://medium.com/netflix-techblog/interleaving-in-online-experiments-at-netflix-a04ee392ec55
  • https://medium.com/netflix-techblog/interleaving-in-online-experiments-at-netflix-a04ee392ec55
    Tools
• A visual A/B test significance calculator：http://www.abtestcalculator.com/
• Minimum sample size：https://abtestguide.com/abtestsize/
• Evan’s Awesome A/B Tools: http://www.evanmiller.org/ab-testing/sample-size.html
  Outsides
• Optimizely: Make every experience count
• VWO: All-in-One A/B Testing and Conversion Optimization Platform™
  • MAB：https://vwo.com/blog/multi-armed-bandit-algorithm/
• A/B experiments simple like a web-surfing
• A/B Testing Software & A/B Testing Tools by Convert.com

各公司ab情况汇总