Challenges in Designing Anthropics System: Unrealistic 100ms Batch Completion

Discussion on the impracticality of uniform 100ms batch completion time in Anthropics system design and its impact on model performance and latency.