Anthropic Web Crawler Async Version Performance Inquiry

Seeking insights on the performance improvements of the async version of Anthropic's web crawler during a tech phone screen for SDE roles.