Byte Tokenizer (Online Assessment)

Problem overview from a real Perplexity interview:

This is a multi-part online assessment focused on implementing and optimizing a byte-level tokenizer similar to Byte Pair Encoding (BPE), widely used in LLM tokenization.