攒人品，分享A/B test， produce sense 相关

发现一篇很好很新的文章，概述了 13个大公司 (Airbnb, Amazon, Booking.com, Facebook, Google,
LinkedIn, Lyft, Microsoft, Netflix, Twitter, Uber, Yandex, and
Stanford University) 在大规模在线实验方面的总结：包括最新的challange，method，metrics，各个方面的考虑，可以用来准备回答各个公司面试相关问题特别是 A/B test，produce sense

https://exp-platform.com/Documen ... KDDExplorations.pdf

攒人品，觉得有用请帮忙加米，好多文章都有积分限制，谢谢

Jackie2931 发表于 2019-8-13 01:36
楼主，现在这个页面看不到啦，求分享链接惹

发在附件了

贴个摘要：
Online controlled experiments (OCEs), also known as A/B tests, have become ubiquitous in evaluating the impact of changes made to software products and services. While the concept of online controlled experiments is simple, there are many practical challenges in running OCEs at scale and encourage further academic and industrial exploration. To understand the top practical challenges in running OCEs at scale, representatives with experience in large-scale experimentation from thirteen different organizations (Airbnb, Amazon, Booking.com, Facebook, Google, LinkedIn, Lyft, Microsoft, Netflix, Twitter, Uber, Yandex, and Stanford University)  were invited to the first Practical Online Controlled Experiments Summit. All thirteen organizations sent representatives. Together these organizations tested more than one hundred thousand experiment treatments last year. Thirty-four experts from these organizations participated in the summit in Sunnyvale, CA, USA on December 13-14, 2018.  

While there are papers from individual organizations on some of the challenges and pitfalls in running OCEs at scale, this is the first paper to provide the top challenges faced across the industry for running OCEs at scale and some common solutions.

楼主，现在这个页面看不到啦，求分享链接惹

Jessie2010 发表于 2019-8-13 01:59
发在附件了

哇 好的 谢谢分享呀！！

超级感谢！最近正在复习a/b test 的内容。

马克一下，很好的abtest资料