Data Parallel & FSDP Matrix Multiplication
Solve an xAI distributed systems task with NumPy and threads. Shard arrays row and column-wise, computing dot products via a queue-based ring all-gather.
Check more interview questions and experiences about Xai