Perplexity

Embedding Model Batching Service

Members only

Wrap a provided embedding model in a service that supports batched requests, shutdown, and concurrent processing. One variant adds max batch and max-token limits for batches of sequences.