Microsoft

Resumable Batch Dataloader with Weighted Sampling

Members only

Build an iterator over a multi-source dataset that supports checkpointable resume, mixed batching by source weight, and weights that don't divide the batch size cleanly.