Nuro Tech Phone Screen: Designing Cost-Effective Online Model Inference Server

Prepare for Nuro's AI Infra tech phone screen focused on designing an online model inference server handling 10+ models with cost-saving priorities.