1. Coding interview (SQL/Python/R) → Execution (basic querying skills)
Most coding interviews are just simple data wrangling questions. Some companies will test Leetcode/ML questions. Make sure you know what is going to be tested before getting into the interviews.
Open end product questions: how to evaluate the opportunity of a new product/ how to deal with a business problem with limited/unlimited resources. 1point 3 acres
- Pick metrics → Opportunity sizing (include deep dive analysis of existing data) → Experimentation → Product Iteration → Modeling (if automation is possible or optimization is needed)
. Χ
4. Data Challenge → Execution & Independence
Take home: please refer to my old post here
Paired test: there will be an interviewer giving you a mini project to solve together:Usually much simpler than the take home version, like a business case study with a small dataset. Tips: 1/ Focus on the top metric(s) you need to answer the business question 2/ Get
p that is excluded from all the new features is the control group when you want to analyze the aggregated results for the experiment series.
Always document your experiment design, even if it is a simple set up. The key sections include:
. check 1point3acres for more.
Hypothesis
Metrics:
- Primary Metrics: the one to verify your hypothesis
- Secondary Metrics: metrics that will be directly impacted in the treatment, such as conversion funnel metrics, marketing engagement, etc.
- Countermetrics: any trade-offs in this experiment? Usually about cannibalization
Decision Criteria :
- Set a target to mark the success of the experiment . 1point 3acres
- A decision tree and a guardrail are recommended if there are trade-offs or investment costs: situations that we will stop the experiment right away; situations that we will not launch but continue to iterate
Keep a list of experiment impacts you analyzed and better to normalize the annual impact to all audiences. It will come back to you once or twice a year when all the cross-functional partners are trying to figure out the impacts they can write in their perf reviews and the standardized experiment impact tracker is also your impact :)