注册一亩三分地论坛,查看更多干货!
您需要 登录 才可以下载或查看附件。没有帐号?注册账号 
x
30min Data Engineering and PySpark discussions:
- Data orchestration procedure
- Data quality checks (threshold, upstream dependencies, primary key checks, etc)
- Data observability framework
- How do you optimize your Spark code?
- What does Spark lazy operations mean?
- Explain Spark distributed data processing
- If a small percentage (e.g. 2%) of streaming data doesn't pass data quality validation, how would you handle it? Would you stop the data """
# TO DO
pass
def generate_report(prices):
"""
return something like this:
buy_day=1 buy_price=1 sell_day=2 sell_price=5 profit=4
buy_day=3 buy_price=3 sell_day=4 sell_price=6 profit=3
total_profit=7
"""
# TO DO
pass
--
|