II.
Capability overview
Reference · livecapability:supports-batch-api
Supports batch API overview
The provider exposes an asynchronous batch inference surface that accepts a file of requests, processes them within a vendor-specified SLA window (typically 24h), and returns results at a discounted rate. OpenAI Batch API and Anthropic Message Batches are the canonical examples.
Attributes
displayName
Supports batch API
description
The provider exposes an asynchronous batch inference surface that
accepts a file of requests, processes them within a vendor-specified
SLA window (typically 24h), and returns results at a discounted rate.
OpenAI Batch API and Anthropic Message Batches are the canonical
examples.
appliesToNodeKinds
- Provider
category
provider-feature
Outgoing edges
None.
Incoming edges
supports40
- model:claude-fable-5@current·ModelVersionClaude Fable 5
- model:claude-haiku-4-5@current·ModelVersionClaude 4.5 Haiku
- model:claude-mythos-5@current·ModelVersionClaude Mythos 5
- model:claude-opus-3@current·ModelVersionClaude 3 Opus
- model:claude-opus-4-5@current·ModelVersionClaude 4.5 Opus
- model:claude-opus-4-6@current·ModelVersionClaude 4.6 Opus
- model:claude-opus-4-7@current·ModelVersionClaude 4.7 Opus
- model:claude-sonnet-3-5@current·ModelVersionClaude 3.5 Sonnet
- model:claude-sonnet-4-5@current·ModelVersionClaude 4.5 Sonnet
- model:claude-sonnet-4-6@current·ModelVersionClaude 4.6 Sonnet
- model:gemini-2-0-flash-lite@current·ModelVersionGemini 2.0 Flash-Lite
- model:gemini-2-0-flash-preview-image-generation@current·ModelVersionGemini 2.0 Flash Preview Image Generation
- model:gemini-2-0-flash@current·ModelVersionGemini 2.0 Flash
- model:gemini-2-5-flash-image@current·ModelVersionGemini 2.5 Flash Image
- model:gemini-2-5-flash-lite@current·ModelVersionGemini 2.5 Flash-Lite
- model:gemini-2-5-flash@current·ModelVersionGemini 2.5 Flash
- model:gemini-2-5-pro@current·ModelVersionGemini 2.5 Pro
- model:gemini-3-1-deep-think@current·ModelVersionGemini 3.1 Deep Think
- model:gemini-3-1-flash-image@current·ModelVersionGemini 3.1 Flash Image
- model:gemini-3-1-flash-lite@current·ModelVersionGemini 3.1 Flash Lite
- model:gemini-3-1-pro@current·ModelVersionGemini 3.1 Pro
- model:gemini-3-5-flash@current·ModelVersionGemini 3.5 Flash
- model:gemini-3-flash@current·ModelVersionGemini 3 Flash
- model:gemini-3-pro-image@current·ModelVersionGemini 3.1 Pro Image
- model:gemini-3-pro@current·ModelVersionGemini 3 Pro
- model:gpt-4o-mini@current·ModelVersionGPT-4o Mini
- model:gpt-4o@current·ModelVersionGPT-4o
- model:gpt-5-mini@current·ModelVersionGPT-5 Mini
- model:gpt-5.4-mini@current·ModelVersionGPT-5.4 Mini
- model:gpt-5.4-nano@current·ModelVersionGPT-5.4 Nano
- model:gpt-5.4@current·ModelVersionGPT-5.4
- model:gpt-5.5-pro@current·ModelVersionGPT-5.5 Pro
- model:gpt-5.5@current·ModelVersionGPT-5.5
- model:gpt-5@current·ModelVersionGPT-5
- model:claude-opus-4-8@current·ModelVersionClaude Opus 4.8
- model:o1@current·ModelVersiono1
- model:o3@current·ModelVersiono3
- provider:anthropic·ModelProviderProductAnthropic
- provider:azure-openai·ModelProviderProductAzure OpenAI
- provider:openai·ModelProviderProductOpenAI