面试前的准备
1. 【加强公司理解】quarterly earnings call,可以从中看到一些fb正在关心的问题,比如small business (especially during covid),privacy, etc。有助于了解公司的现状,增加对于公司的理解吧。里面提到的一些high level metric也可以留意一下。. 1point 3acres
. 1point 3acres https://s21.q4cdn.com/399680738/ ... Call-Transcript.pdf
2. 【business sense】一些论文还是挺有帮助的。阅读这些论文对我来说就是build up一些basic sense,扩充视野,如果被问到follow up questions心里也有一些底吧。这类论文我都是简单读读,理解个大概,techinical细节直接跳过,知道industry大概在做些什么这样。
举个例子,印象中有个paper里面讲到,有段时间bing的search ranking出现了bug,会把应该排在后面的结果显示在前面,这样会出现什么后果呢?bing的研究员发现,出现了这个bug之后,revenue上涨了,#of searches 增加了。这是因为人们要花更长时间找到他们想要的结果,所以用bing的时间增加了。由此可见,如果大家只有revenue或者#of searches来衡量这个ranking的好坏是不合适的。我感觉,建立这类sense有助于面试中对于follow-up questions的回答。
. From 1point 3acres bbs
- Deng, A., & Shi, X. (2016, August). Data-driven metric development for online controlled experiments: Seven lessons learned. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 77-86).
- Dmitriev, P., & Wu, X. (2016, October). Measuring metrics. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management (pp. 429-437).. 1point 3acres
- Chen, A. C., & Fu, X. (2017, April). Data+ intuition: A hybrid approach to developing product north star metrics. In Proceedings of the 26th International Conference on World Wide Web Companion (pp. 617-625).
5. 【多多思考】在回答product问题的时候,往往想到一些metric并不难。难的是继续追问自己:
- 这些metric大概的distribution是什么?is it normally distributed? what is the estimated mean, median, P90?
- 如果你想到了很多metrics,那么哪两三个是比较重要的?
- pros and cons of using this metric? is it sensitive to outliers? is it possible to capture bots?
- is this metric sensitive and robust? (参考udacity abtesting课)
- any edge cases?
- if this metric goes down, does it tell you something?
- if this metric goes up, but DAU goes down, does it tell you something?. Χ
. 1point 3acres
6.【mock interviews】真的挺有帮助的,如果遇到不错的同学,你也可以从他们身上学习到一些;如果遇到不太好的,你也可以知道自己应该避免什么。
7. 【书籍】我买了两本cracking the PM interview and trustworthy online controlled experiments. 久仰diane tang and ya xu大名,就买了第二本书。我大概花了一天的时间,过了一下trustworthy这本书,挺有帮助的,比如里面有关怎么分析confidence intervals 的部分(page 37)。