Start every workload on Standard on-demand, and move it only after the model card lists the mode you want. Batch, Flex, Priority, Reserved, and Provisioned Throughput each trade latency or commitment for price or capacity. Support varies by provider and model.
When you need this
- A workload is moving to steady high volume, and on-demand quotas or prices no longer fit.
- Finance asks whether a commitment would lower the bill.
- Evaluation suites, backfills, or bulk classification can wait for results.
Evaluation criteria
Standard on-demand
Is the traffic interactive and variable?
Look forPay per model token with no commitment. Standard prices vary by provider and model; use the representative table above, then verify the exact model row and routing profile in AWS's pricing page.
Batch
Can the results arrive later, without tool calls or structured output?
Look forUse batch for S3-based jobs when the model lists a batch price. AWS advertises 50% below on-demand for supported models, and the supported model table changes by provider and release.
Flex and Priority
Does the workload trade latency for price, or price for latency?
Look forChoose Flex for work that tolerates longer processing, at half the Standard price. Priority costs 75% more for customer-facing work that needs the fastest responses. Both share on-demand quotas. Check support on the model card.
Reserved tier
Is there a steady floor of traffic that cannot tolerate throttling?
Look forSize Reserved capacity on input plus cache-write tokens. It starts at 100,000 input and 10,000 output tokens per minute for 1 or 3 months. Overflow goes to Standard, with 99.5% target uptime. Ask the AWS account team about supported models, including Sonnet 4.6, Opus 4.6, and Haiku 4.5.
Provisioned Throughput
Are you serving a custom model or buying dedicated Model Units?
Look forBuy hourly Model Units with no commitment or with 1-month or 6-month terms. Custom models require Provisioned Throughput. AWS supplies Model Unit prices per supported model. Inference profiles do not support it.
Caching across modes
Is the stable part of each prompt cached?
Look forMeasure cache reads against uncached input. AWS prices cache reads below uncached input on supported model rows, and cache writes have their own rate. Put stable prompt prefixes behind explicit cache points and track reads per workload.
Questions to ask vendors
- Which of our models list batch, Flex, Priority, or Reserved on their model cards?
- What share of our traffic could wait for batch results?
- What is our steady minimum tokens per minute, and does it clear the Reserved tier minimum?
- Does our AWS agreement include discounts that apply to third-party model charges?
Red flags
- Budgeting a 50% batch discount for a model that does not list batch.
- Buying reserved capacity before measuring steady-state tokens per minute, including cache writes.
- Paying Geo prices for workloads with no residency requirement.
- Leaving a Reserved reservation running after the workload moves, since billing continues until it is deleted.
Products in this piece
Sources
- Official documentation
- 18
- Public source
- 3
- Amazon Bedrock pricing
- AWS model card: Anthropic Claude Opus 5.5
- AWS model card: Amazon Nova Pro
- AWS model card: Meta Llama 4 Scout 17B
- AWS model card: Mistral Large 3
- AWS model card: DeepSeek V3.2
- AWS model card: OpenAI gpt-oss-120b
- AWS model card: Cohere Command R
- AWS model card: AI21 Jamba 1.5 Mini
- AWS price list: metered model rates
- AWS price list: foundation model rates
- Amazon Bedrock User Guide: Service tiers
- Amazon Bedrock User Guide: Batch inference
- Amazon Bedrock User Guide: Provisioned Throughput
- Amazon Bedrock User Guide: Cross-Region inference
- Amazon Bedrock User Guide: Global cross-Region inference
- Amazon Bedrock User Guide: Claude Opus 5.5 model card
- Amazon Bedrock User Guide: Prompt caching
- Neradot: Case Study: Cutting LLM Cost by 36% with Prompt Caching (Aug 31, 2026)
- Sachin M: Prompt caching on Amazon Bedrock across three Nova models (Feb 19, 2026)
- Hacker News comment on Converse API cache points (Apr 30, 2026)