如何从海量数据中获取有效信息？

大家来说说，如何从海量数据中获得有效信息，完成分析+数据可视化呈献给客户？用到的软件和技术？工作内容是1.从文档和网页等等抓取数据 2.分析产品不断记录的大量数据。
有点伸手党，不好意思。。。刚刚申请完应用统计的研究生，所以在市场需求层面上能夸夸其谈一番，也拿了几个analytics的on-site。可是真的要解决具体问题我就完全不懂技术细节。。。请大家指点！

1. Data extraction: SQL if they have structured database. For more complicated ones, considering ETL. if for massive dataset, considering Hadoop (MapReduce or Spark).
2. Analysis: depending on your goal and sophisticated level. Statistics software or even programming language if you want to build your algorithm from scratch.
3. Visualization: Considering Tableau

For document and website, google "how to extract data by API".
For massive product records, SQL or Hadoop, depending how large it can be.

Python script ?

刚申请完硕士的同时就拿到好几个on-site么 楼楼是海本咩

其实 不同公司会有不同的偏好的啦
你去问你老板╭(╯^╰)╮