Batching
For best performance, we recommend you batch your content. There are several factors to consider when creating a batch:
- All documents in a batch must be processed by the same configuration
- All documents in a single batch must be processed before the documents are returned.
- Larger batches lead to higher overall throughput but longer latency on individual batches
- The maximum batch size is limited by your subscription.
Updated less than a minute ago