gpt-oss-120b on AvalAI
Available on AvalAI
- Publisher
- OpenAI
- Available AvalAI IDs
- 3
- Provider and configuration variants
- 28
Available AvalAI IDs
| Model ID | Operation | Supported endpoints | Minimum tier |
|---|---|---|---|
gpt-oss-120b | "chat" | Unknown | 0 |
groq.gpt-oss-120b | "chat" | Unknown | 0 |
nvidia_nim.gpt-oss-120b | "chat" | Unknown | 0 |
Unknown means unrecorded. null is an explicit unknown value; false means lack of support. A reference namespace does not establish which provider AvalAI uses.
Use through AvalAI
Use the guide for this exact ID’s supported endpoint. An unrecorded endpoint cannot supply a verified request example.
AvalAI prices
These are recorded AvalAI charges. Each row retains its exact model ID, billing unit, and qualifiers.
| Covered exact IDs | Charge field | Amount | Unit | Currency / role / modality | Configuration and qualifiers | Source |
|---|---|---|---|---|---|---|
gpt-oss-120b | Cached text inputpricing.cached_input | 0.15 | USD/1M tokens | USD / cached-input / text | — | AvalAI catalog |
gpt-oss-120b | Text inputpricing.input | 0.3 | USD/1M tokens | USD / input / text | — | AvalAI catalog |
gpt-oss-120b | Text outputpricing.output | 2.5 | USD/1M tokens | USD / output / text | — | AvalAI catalog |
groq.gpt-oss-120b | Cached text inputpricing.cached_input | 0.075 | USD/1M tokens | USD / cached-input / text | — | AvalAI catalog |
groq.gpt-oss-120b | Text inputpricing.input | 0.15 | USD/1M tokens | USD / input / text | — | AvalAI catalog |
groq.gpt-oss-120b | Text outputpricing.output | 0.75 | USD/1M tokens | USD / output / text | — | AvalAI catalog |
nvidia_nim.gpt-oss-120b | Cached text inputpricing.cached_input | 0.015 | USD/1M tokens | USD / cached-input / text | — | AvalAI catalog |
nvidia_nim.gpt-oss-120b | Text inputpricing.input | 0.03 | USD/1M tokens | USD / input / text | — | AvalAI catalog |
nvidia_nim.gpt-oss-120b | Text outputpricing.output | 0.25 | USD/1M tokens | USD / output / text | — | AvalAI catalog |
Provider namespaces and configurations
Namespaces and regions describe the reference IDs and do not confirm AvalAI routing. Different qualified billing units are not directly comparable.
| Variant | Exact ID | Identity and configuration | AvalAI availability |
|---|---|---|---|
| V1 | azure/gpt-oss-120b | {"axes":{},"hostingProvider":"azure","region":null} | Reference only |
| V2 | azure_ai/gpt-oss-120b | {"axes":{},"hostingProvider":"azure_ai","region":null} | Reference only |
| V3 | baseten/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"baseten","region":null} | Reference only |
| V4 | bedrock_mantle/openai.gpt-oss-120b | {"axes":{},"hostingProvider":"bedrock_mantle","region":null} | Reference only |
| V5 | bedrock_mantle/us-gov-east-1/openai.gpt-oss-120b | {"axes":{},"hostingProvider":"bedrock_mantle","region":"us-gov-east-1"} | Reference only |
| V6 | bedrock_mantle/us-gov-west-1/openai.gpt-oss-120b | {"axes":{},"hostingProvider":"bedrock_mantle","region":"us-gov-west-1"} | Reference only |
| V7 | cerebras/gpt-oss-120b | {"axes":{},"hostingProvider":"cerebras","region":null} | Reference only |
| V8 | cloudflare/@cf/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"cloudflare","region":null} | Reference only |
| V9 | crusoe/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"crusoe","region":null} | Reference only |
| V10 | deepinfra/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"deepinfra","region":null} | Reference only |
| V11 | fireworks_ai/accounts/fireworks/models/gpt-oss-120b | {"axes":{},"hostingProvider":"fireworks_ai","region":null} | Reference only |
| V12 | fireworks_ai/gpt-oss-120b | {"axes":{},"hostingProvider":"fireworks_ai","region":null} | Reference only |
| V13 | gpt-oss-120b | {"axes":{},"hostingProvider":null,"region":null} | Available on AvalAI |
| V14 | groq.gpt-oss-120b | {"axes":{},"hostingProvider":"groq","region":null} | Available on AvalAI |
| V15 | groq/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"groq","region":null} | Reference only |
| V16 | nebius/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"nebius","region":null} | Reference only |
| V17 | novita/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"novita","region":null} | Reference only |
| V18 | nvidia_nim.gpt-oss-120b | {"axes":{},"hostingProvider":"nvidia_nim","region":null} | Available on AvalAI |
| V19 | nvidia_nim/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"nvidia_nim","region":null} | Reference only |
| V20 | ovhcloud/gpt-oss-120b | {"axes":{},"hostingProvider":"ovhcloud","region":null} | Reference only |
| V21 | replicate/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"replicate","region":null} | Reference only |
| V22 | sail/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"sail","region":null} | Reference only |
| V23 | sambanova/gpt-oss-120b | {"axes":{},"hostingProvider":"sambanova","region":null} | Reference only |
| V24 | scaleway/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"scaleway","region":null} | Reference only |
| V25 | tensormesh/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"tensormesh","region":null} | Reference only |
| V26 | together_ai/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"together_ai","region":null} | Reference only |
| V27 | wandb/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"wandb","region":null} | Reference only |
| V28 | watsonx/openai/gpt-oss-120b | {"axes":{},"hostingProvider":"watsonx","region":null} | Reference only |
Provider reference prices
{"currency":"USD","normalizationStatus":"normalized","source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
F1 — Text input{"billingRole":"input","field":"input_cost_per_token","modality":"text","qualifiers":{},"unit":"USD/token"}
F2 — Text output{"billingRole":"output","field":"output_cost_per_token","modality":"text","qualifiers":{},"unit":"USD/token"}
F3 — Cached text input{"billingRole":"cached-input","field":"cache_read_input_token_cost","modality":"text","qualifiers":{},"unit":"USD/token"}
F4 — Text input{"billingRole":"input","field":"input_cost_per_token_batches","modality":"text","qualifiers":{"executionMode":"batches"},"unit":"USD/token"}
F5 — Text input{"billingRole":"input","field":"input_cost_per_token_flex","modality":"text","qualifiers":{"executionMode":"flex"},"unit":"USD/token"}
F6 — Text input{"billingRole":"input","field":"input_cost_per_token_priority","modality":"text","qualifiers":{"executionMode":"priority"},"unit":"USD/token"}
F7 — Text output{"billingRole":"output","field":"output_cost_per_token_batches","modality":"text","qualifiers":{"executionMode":"batches"},"unit":"USD/token"}
F8 — Text output{"billingRole":"output","field":"output_cost_per_token_flex","modality":"text","qualifiers":{"executionMode":"flex"},"unit":"USD/token"}
F9 — Text output{"billingRole":"output","field":"output_cost_per_token_priority","modality":"text","qualifiers":{"executionMode":"priority"},"unit":"USD/token"}
F10 — Cached text input{"billingRole":"cached-input","field":"cache_read_input_token_cost_priority","modality":"text","qualifiers":{"executionMode":"priority"},"unit":"USD/token"}
F11 — Source charge{"billingRole":"input","field":"input_cost_per_query","modality":null,"qualifiers":{},"unit":"USD/query"}
Source-qualified charges — Different units; see charge fields
| Charge field | Amount | Variants |
|---|---|---|
| F1 | 3e-07 | V1 |
| F2 | 2.5e-06 | V1 |
| F1 | 1.5e-07 | V2 |
| F2 | 6e-07 | V2 |
| F3 | 1e-07 | V3 |
| F1 | 1e-07 | V3 |
| F2 | 5e-07 | V3 |
| F1 | 1.5e-07 | V4 |
| F4 | 7.5e-08 | V4 |
| F5 | 7.5e-08 | V4 |
| F6 | 2.625e-07 | V4 |
| F2 | 6e-07 | V4 |
| F7 | 3e-07 | V4 |
| F8 | 3e-07 | V4 |
| F9 | 1.05e-06 | V4 |
| F1 | 1.8e-07 | V5 |
| F2 | 7.2e-07 | V5 |
| F1 | 1.8e-07 | V6 |
| F2 | 7.2e-07 | V6 |
| F1 | 3.5e-07 | V7 |
| F2 | 7.5e-07 | V7 |
| F1 | 3.5e-07 | V8 |
| F2 | 7.5e-07 | V8 |
| F1 | 8e-07 | V9 |
| F2 | 8e-07 | V9 |
| F1 | 3.7e-08 | V10 |
| F2 | 1.7e-07 | V10 |
| F3 | 1.5e-08 | V11 V12 |
| F10 | 1.8e-08 | V11 V12 |
| F1 | 1.5e-07 | V11 V12 |
| F6 | 1.8e-07 | V11 V12 |
| F2 | 6e-07 | V11 V12 |
| F9 | 7.2e-07 | V11 V12 |
| F1 | 3e-07 | V13 |
| F2 | 2.5e-06 | V13 |
| F1 | 1.5e-07 | V14 |
| F2 | 7.5e-07 | V14 |
| F3 | 7.5e-08 | V15 |
| F1 | 1.5e-07 | V15 |
| F2 | 6e-07 | V15 |
| F1 | 1.5e-07 | V16 |
| F2 | 6e-07 | V16 |
| F1 | 5e-08 | V17 |
| F2 | 2.5e-07 | V17 |
| F11 | 0.0 | V19 |
| F1 | 0.0 | V19 |
| F2 | 0.0 | V19 |
| F1 | 8e-08 | V20 |
| F2 | 4e-07 | V20 |
| F1 | 1.8e-07 | V21 |
| F2 | 7.2e-07 | V21 |
| F3 | 3e-08 | V22 |
| F1 | 6e-08 | V22 |
| F2 | 4e-07 | V22 |
| F1 | 2.2e-07 | V23 |
| F2 | 5.9e-07 | V23 |
| F1 | 1.5e-07 | V24 |
| F2 | 6e-07 | V24 |
| F3 | 0 | V25 |
| F1 | 1.5e-07 | V25 |
| F2 | 6e-07 | V25 |
| F1 | 1.5e-07 | V26 |
| F2 | 6e-07 | V26 |
| F1 | 3e-08 | V27 |
| F2 | 1.7e-07 | V27 |
| F1 | 1.59e-07 | V28 |
| F2 | 6.36e-07 | V28 |
{"currency":"USD","normalizationStatus":"normalized","qualifiers":{},"source":"supplemental-reference","sourcePath":"data/rate-limits/missing_models_context_window.json"}
F1 — Text input{"billingRole":"input","field":"input_cost_per_token","modality":"text","unit":"USD/token"}
F2 — Text output{"billingRole":"output","field":"output_cost_per_token","modality":"text","unit":"USD/token"}
F3 — Source charge{"billingRole":"input","field":"input_cost_per_query","modality":null,"unit":"USD/query"}
{"billingRole":null,"currency":null,"modality":null,"normalizationStatus":"opaque","qualifiers":{},"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json","unit":null}
F1 — Source charge{"field":"search_context_cost_per_query"}
Source-qualified charges — Unit not verified
| Charge field | Amount | Variants |
|---|---|---|
| F1 | {"search_context_size_high":0.005,"search_context_size_low":0.005,"search_context_size_medium":0.005} | V15 |
Unit not verified means the source value is retained without interpretation and cannot be compared as a price. null does not mean free.
Capabilities and limits
| Field | Value | Covered IDs | Source |
|---|---|---|---|
max_input_tokens | 128000 | V13 | AvalAI catalog |
max_input_tokens | 131072 | V14 | AvalAI catalog |
max_input_tokens | Unknown | V18 | AvalAI catalog |
max_output_tokens | 128000 | V13 | AvalAI catalog |
max_output_tokens | 32766 | V14 | AvalAI catalog |
max_output_tokens | Unknown | V18 | AvalAI catalog |
max_requests_per_1_minute | 2500.0 | V13 | AvalAI catalog |
max_requests_per_1_minute | 1000.0 | V14 | AvalAI catalog |
max_requests_per_1_minute | 25.0 | V18 | AvalAI catalog |
max_tokens | 128000 | V13 | AvalAI catalog |
max_tokens | 32766 | V14 | AvalAI catalog |
max_tokens | Unknown | V18 | AvalAI catalog |
max_tokens_per_1_minute | 4000000.0 | V13 | AvalAI catalog |
max_tokens_per_1_minute | 250000.0 | V14 | AvalAI catalog |
max_tokens_per_1_minute | 40000.0 | V18 | AvalAI catalog |
min_tier | 0 | V13 V14 V18 | AvalAI catalog |
mode | "chat" | V13 V14 V18 | AvalAI catalog |
object | "model" | V13 V14 V18 | AvalAI catalog |
owned_by | "openai" | V13 V14 V18 | AvalAI catalog |
supported_endpoints | Unknown | V13 V14 V18 | AvalAI catalog |
supports_function_calling | true — Supported | V13 V14 | AvalAI catalog |
supports_function_calling | Unknown | V18 | AvalAI catalog |
supports_parallel_function_calling | Unknown | V13 V18 | AvalAI catalog |
supports_parallel_function_calling | true — Supported | V14 | AvalAI catalog |
supports_reasoning | true — Supported | V13 V14 | AvalAI catalog |
supports_reasoning | Unknown | V18 | AvalAI catalog |
supports_response_schema | true — Supported | V13 V14 | AvalAI catalog |
supports_response_schema | Unknown | V18 | AvalAI catalog |
supports_tool_choice | true — Supported | V13 V14 | AvalAI catalog |
supports_tool_choice | Unknown | V18 | AvalAI catalog |
supports_vision | true — Supported | V13 | AvalAI catalog |
supports_vision | Unknown | V14 V18 | AvalAI catalog |
supports_web_search | Unknown | V13 V18 | AvalAI catalog |
supports_web_search | true — Supported | V14 | AvalAI catalog |
| Model ID | Tier | Access | RPM | TPM | Other limits | Source |
|---|---|---|---|---|---|---|
| V13 | 0 | Available | 1.0 | 40000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"} | Exact tier source |
| V13 | 1 | Available | 250.0 | 450000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"} | Exact tier source |
| V13 | 2 | Available | 500.0 | 800000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"} | Exact tier source |
| V13 | 3 | Available | 750.0 | 1200000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"} | Exact tier source |
| V13 | 4 | Available | 1500.0 | 2000000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"} | Exact tier source |
| V13 | 5 | Available | 2500.0 | 4000000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"} | Exact tier source |
| V14 | 0 | Available | 1.0 | 10000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"} | Exact tier source |
| V14 | 1 | Available | 50.0 | 75000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"} | Exact tier source |
| V14 | 2 | Available | 75.0 | 100000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"} | Exact tier source |
| V14 | 3 | Available | 100.0 | 150000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"} | Exact tier source |
| V14 | 4 | Available | 500.0 | 200000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"} | Exact tier source |
| V14 | 5 | Available | 1000.0 | 250000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"} | Exact tier source |
| V18 | 0 | Available | 3.0 | 10000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"} | Exact tier source |
| V18 | 1 | Available | 5.0 | 20000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"} | Exact tier source |
| V18 | 2 | Available | 10.0 | 30000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"} | Exact tier source |
| V18 | 3 | Available | 15.0 | 30000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"} | Exact tier source |
| V18 | 4 | Available | 20.0 | 30000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"} | Exact tier source |
| V18 | 5 | Available | 25.0 | 40000.0 | {"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"} | Exact tier source |
Technical reference observations
The sources below are independent and may disagree. Their observations do not override AvalAI prices, capabilities, or supported endpoints.
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V1 V13{"litellm_provider":"azure","max_input_tokens":128000,"max_output_tokens":128000,"max_tokens":128000,"mode":"chat","supports_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_vision":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V2{"litellm_provider":"azure_ai","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_response_schema":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V3{"litellm_provider":"baseten","max_input_tokens":128072,"max_output_tokens":128072,"max_tokens":128072,"mode":"chat","source":"https://inference.baseten.co/v1/models","supports_function_calling":true,"supports_prompt_caching":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_vision":false}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V4{"litellm_provider":"bedrock_mantle","max_input_tokens":131072,"max_output_tokens":16384,"max_tokens":16384,"mode":"chat","source":"https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrock/current/us-east-1/index.json","supported_endpoints":["/v1/chat/completions","/v1/responses"],"supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V5 V6{"litellm_provider":"bedrock_mantle","max_input_tokens":131072,"max_output_tokens":16384,"max_tokens":16384,"mode":"chat","source":"https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-oss-120b.html","supported_endpoints":["/v1/chat/completions","/v1/responses"],"supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V7{"litellm_provider":"cerebras","max_input_tokens":131072,"max_output_tokens":32768,"max_tokens":32768,"mode":"chat","source":"https://www.cerebras.ai/blog/openai-gpt-oss-120b-runs-fastest-on-cerebras","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V8{"litellm_provider":"cloudflare","max_input_tokens":128000,"max_output_tokens":128000,"max_tokens":128000,"mode":"chat","rpm":300,"supports_function_calling":true,"supports_reasoning":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V9{"litellm_provider":"crusoe","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_system_messages":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V10{"litellm_provider":"deepinfra","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://deepinfra.com/pricing","supports_function_calling":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V11 V12{"litellm_provider":"fireworks_ai","max_input_tokens":131072,"max_output_tokens":32768,"max_tokens":32768,"mode":"chat","source":"https://api.fireworks.ai/v1/serverless/models","supports_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_vision":false}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V14{"litellm_provider":"groq","max_input_tokens":131072,"max_output_tokens":32766,"max_tokens":32766,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_web_search":true}
{"source":"supplemental-reference","sourcePath":"data/rate-limits/missing_models_context_window.json"}
V14{"litellm_provider":"groq","max_input_tokens":131072,"max_output_tokens":32766,"max_tokens":32766,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_web_search":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V15{"litellm_provider":"groq","max_input_tokens":131072,"max_output_tokens":65536,"max_tokens":65536,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_web_search":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V16{"litellm_provider":"nebius","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://tokenfactory.nebius.com/models/catalog/text2text/openai%2Fgpt-oss-120b","supports_function_calling":true,"supports_reasoning":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V17{"litellm_provider":"novita","max_input_tokens":131072,"max_output_tokens":32768,"max_tokens":32768,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_system_messages":true,"supports_tool_choice":true,"supports_vision":false}
{"source":"supplemental-reference","sourcePath":"data/rate-limits/missing_models_context_window.json"}
V18{"litellm_provider":"nvidia_nim","mode":"chat"}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V19{"litellm_provider":"nvidia_nim","mode":"chat"}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V20{"litellm_provider":"ovhcloud","max_input_tokens":131000,"max_output_tokens":131000,"max_tokens":131000,"mode":"chat","source":"https://www.ovhcloud.com/en/public-cloud/ai-endpoints/catalog/","supports_function_calling":false,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":false}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V21{"litellm_provider":"replicate","mode":"chat","supports_function_calling":true,"supports_system_messages":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V22{"litellm_provider":"sail","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://docs.sailresearch.com/models","supports_function_calling":true,"supports_prompt_caching":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V23{"litellm_provider":"sambanova","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://cloud.sambanova.ai/plans/pricing","supports_function_calling":true,"supports_reasoning":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V24{"litellm_provider":"scaleway","max_input_tokens":128000,"max_output_tokens":32768,"max_tokens":32768,"mode":"chat","supports_function_calling":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V25{"litellm_provider":"tensormesh","max_input_tokens":131072,"max_output_tokens":131072,"mode":"chat","source":"https://serverless.tensormesh.ai/v1/models/openrouter","supports_function_calling":true,"supports_prompt_caching":true,"supports_reasoning":true,"supports_response_schema":true,"supports_system_messages":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V26{"litellm_provider":"together_ai","max_input_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://api.together.ai/v1/models","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V27{"litellm_provider":"wandb","max_input_tokens":131000,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://wandb.ai/site/pricing/tokens/","supports_reasoning":true}
{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}
V28{"litellm_provider":"watsonx","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://dataplatform.cloud.ibm.com/docs/content/wsj/analyze-data/fm-models.html?context=wx","supports_function_calling":false,"supports_parallel_function_calling":false,"supports_vision":false}
{"sourcePath":"data/rate-limits/tier0.json","tier":0,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":1.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":40000.0,"owner":"openai","provider":"azure"}}V13
{"sourcePath":"data/rate-limits/tier1.json","tier":1,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":250.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":450000.0,"owner":"openai","provider":"azure"}}V13
{"sourcePath":"data/rate-limits/tier2.json","tier":2,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":500.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":800000.0,"owner":"openai","provider":"azure"}}V13
{"sourcePath":"data/rate-limits/tier3.json","tier":3,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":750.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":1200000.0,"owner":"openai","provider":"azure"}}V13
{"sourcePath":"data/rate-limits/tier4.json","tier":4,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":1500.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":2000000.0,"owner":"openai","provider":"azure"}}V13
{"sourcePath":"data/rate-limits/tier5.json","tier":5,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":2500.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":4000000.0,"owner":"openai","provider":"azure"}}V13
{"sourcePath":"data/rate-limits/tier0.json","tier":0,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":1.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":10000.0,"owner":"openai","provider":"groq"}}V14
{"sourcePath":"data/rate-limits/tier1.json","tier":1,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":50.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":75000.0,"owner":"openai","provider":"groq"}}V14
{"sourcePath":"data/rate-limits/tier2.json","tier":2,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":75.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":100000.0,"owner":"openai","provider":"groq"}}V14
{"sourcePath":"data/rate-limits/tier3.json","tier":3,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":100.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":150000.0,"owner":"openai","provider":"groq"}}V14
{"sourcePath":"data/rate-limits/tier4.json","tier":4,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":500.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":200000.0,"owner":"openai","provider":"groq"}}V14
{"sourcePath":"data/rate-limits/tier5.json","tier":5,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":1000.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":250000.0,"owner":"openai","provider":"groq"}}V14
{"sourcePath":"data/rate-limits/tier0.json","tier":0,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":3.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":10000.0,"owner":"openai","provider":"nvidia_nim"}}V18
{"sourcePath":"data/rate-limits/tier1.json","tier":1,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":5.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":20000.0,"owner":"openai","provider":"nvidia_nim"}}V18
{"sourcePath":"data/rate-limits/tier2.json","tier":2,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":10.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":30000.0,"owner":"openai","provider":"nvidia_nim"}}V18
{"sourcePath":"data/rate-limits/tier3.json","tier":3,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":15.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":30000.0,"owner":"openai","provider":"nvidia_nim"}}V18
{"sourcePath":"data/rate-limits/tier4.json","tier":4,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":20.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":30000.0,"owner":"openai","provider":"nvidia_nim"}}V18
{"sourcePath":"data/rate-limits/tier5.json","tier":5,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":25.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":40000.0,"owner":"openai","provider":"nvidia_nim"}}V18