Anthropic Software Engineer Tech Phone Screen Experience and Inference Discussion

A detailed account of an Anthropics software engineer tech phone screen focusing on caching, batching, throughput calculations, and GPU load balancing strategies.