Augment Tech Phone Screen: Top K Text Generation and KV Caching Implementation

Interview task at Augment involving coding top k text generation and key-value caching for transformers in a fulltime machine learning role.