MongoDB

Web Crawler: Single-Threaded, Then Concurrent

Members only

A crawler problem that MongoDB uses both as a phone screen and as the dedicated concurrency round of the onsite. You start from a provided page-fetching primitive and must visit reachable pages correctly, then make it fast. Interviewers expect production-quality code even when it is never run.