داشبورد توسعه‌دهنده
پرسش از هوش مصنوعی
پرسش از هوش مصنوعی

مدل gpt-oss-120b در AvalAI ​

در AvalAI در دسترس است

سازنده
OpenAI
شناسه‌های در دسترس AvalAI
3
نسخه‌های ارائه‌دهنده و پیکربندی
28

فهرست مدل‌ها

شناسه‌های در دسترس در AvalAI ​

شناسه‌های دقیق مدل‌های قابل فراخوانی
شناسه مدلعملیاتمسیرهای پشتیبانی‌شدهحداقل سطح
gpt-oss-120b"chat"نامشخص0
groq.gpt-oss-120b"chat"نامشخص0
nvidia_nim.gpt-oss-120b"chat"نامشخص0

نامشخص یعنی داده ثبت نشده است؛ null مقدار نامشخصِ صریح و false نبود پشتیبانی را نشان می‌دهد. وجود یک نسخه مرجع به معنی ارائه آن از طریق AvalAI نیست.

استفاده از طریق AvalAI ​

برای نمونه درخواست، راهنمای مسیر پشتیبانی‌شده همین شناسه را بررسی کنید. اگر مسیر ثبت نشده باشد، نمی‌توان نمونه قابل تأییدی ارائه کرد.

قیمت‌های AvalAI ​

مقادیر زیر قیمت‌های ثبت‌شده AvalAI هستند. هر ردیف، شناسه دقیق، واحد محاسبه و شرایط خودش را دارد.

قیمت‌های AvalAI بر اساس فیلد دقیق هزینه
شناسه‌های دقیق مربوطفیلد هزینهمقدارواحدارز / نقش / نوع دادهپیکربندی و شرایطمنبع
gpt-oss-120bورودی متنی از حافظه نهان
pricing.cached_input
0.15USD/1M tokensUSD / cached-input / text—فهرست AvalAI
gpt-oss-120bورودی متنی
pricing.input
0.3USD/1M tokensUSD / input / text—فهرست AvalAI
gpt-oss-120bخروجی متنی
pricing.output
2.5USD/1M tokensUSD / output / text—فهرست AvalAI
groq.gpt-oss-120bورودی متنی از حافظه نهان
pricing.cached_input
0.075USD/1M tokensUSD / cached-input / text—فهرست AvalAI
groq.gpt-oss-120bورودی متنی
pricing.input
0.15USD/1M tokensUSD / input / text—فهرست AvalAI
groq.gpt-oss-120bخروجی متنی
pricing.output
0.75USD/1M tokensUSD / output / text—فهرست AvalAI
nvidia_nim.gpt-oss-120bورودی متنی از حافظه نهان
pricing.cached_input
0.015USD/1M tokensUSD / cached-input / text—فهرست AvalAI
nvidia_nim.gpt-oss-120bورودی متنی
pricing.input
0.03USD/1M tokensUSD / input / text—فهرست AvalAI
nvidia_nim.gpt-oss-120bخروجی متنی
pricing.output
0.25USD/1M tokensUSD / output / text—فهرست AvalAI

ارائه‌دهندگان و پیکربندی‌ها ​

فضای نام و منطقه زیر مربوط به شناسه مرجع هستند و مسیر ارائه AvalAI را تأیید نمی‌کنند. شرایط و واحدهای متفاوت را نباید با یکدیگر مقایسه کرد.

نام‌های دقیق و محورهای پیکربندی
نسخهشناسه دقیقشناسه و پیکربندیدسترسی در AvalAI
V1azure/gpt-oss-120b{"axes":{},"hostingProvider":"azure","region":null}فقط مرجع
V2azure_ai/gpt-oss-120b{"axes":{},"hostingProvider":"azure_ai","region":null}فقط مرجع
V3baseten/openai/gpt-oss-120b{"axes":{},"hostingProvider":"baseten","region":null}فقط مرجع
V4bedrock_mantle/openai.gpt-oss-120b{"axes":{},"hostingProvider":"bedrock_mantle","region":null}فقط مرجع
V5bedrock_mantle/us-gov-east-1/openai.gpt-oss-120b{"axes":{},"hostingProvider":"bedrock_mantle","region":"us-gov-east-1"}فقط مرجع
V6bedrock_mantle/us-gov-west-1/openai.gpt-oss-120b{"axes":{},"hostingProvider":"bedrock_mantle","region":"us-gov-west-1"}فقط مرجع
V7cerebras/gpt-oss-120b{"axes":{},"hostingProvider":"cerebras","region":null}فقط مرجع
V8cloudflare/@cf/openai/gpt-oss-120b{"axes":{},"hostingProvider":"cloudflare","region":null}فقط مرجع
V9crusoe/openai/gpt-oss-120b{"axes":{},"hostingProvider":"crusoe","region":null}فقط مرجع
V10deepinfra/openai/gpt-oss-120b{"axes":{},"hostingProvider":"deepinfra","region":null}فقط مرجع
V11fireworks_ai/accounts/fireworks/models/gpt-oss-120b{"axes":{},"hostingProvider":"fireworks_ai","region":null}فقط مرجع
V12fireworks_ai/gpt-oss-120b{"axes":{},"hostingProvider":"fireworks_ai","region":null}فقط مرجع
V13gpt-oss-120b{"axes":{},"hostingProvider":null,"region":null}در AvalAI در دسترس
V14groq.gpt-oss-120b{"axes":{},"hostingProvider":"groq","region":null}در AvalAI در دسترس
V15groq/openai/gpt-oss-120b{"axes":{},"hostingProvider":"groq","region":null}فقط مرجع
V16nebius/openai/gpt-oss-120b{"axes":{},"hostingProvider":"nebius","region":null}فقط مرجع
V17novita/openai/gpt-oss-120b{"axes":{},"hostingProvider":"novita","region":null}فقط مرجع
V18nvidia_nim.gpt-oss-120b{"axes":{},"hostingProvider":"nvidia_nim","region":null}در AvalAI در دسترس
V19nvidia_nim/openai/gpt-oss-120b{"axes":{},"hostingProvider":"nvidia_nim","region":null}فقط مرجع
V20ovhcloud/gpt-oss-120b{"axes":{},"hostingProvider":"ovhcloud","region":null}فقط مرجع
V21replicate/openai/gpt-oss-120b{"axes":{},"hostingProvider":"replicate","region":null}فقط مرجع
V22sail/openai/gpt-oss-120b{"axes":{},"hostingProvider":"sail","region":null}فقط مرجع
V23sambanova/gpt-oss-120b{"axes":{},"hostingProvider":"sambanova","region":null}فقط مرجع
V24scaleway/openai/gpt-oss-120b{"axes":{},"hostingProvider":"scaleway","region":null}فقط مرجع
V25tensormesh/openai/gpt-oss-120b{"axes":{},"hostingProvider":"tensormesh","region":null}فقط مرجع
V26together_ai/openai/gpt-oss-120b{"axes":{},"hostingProvider":"together_ai","region":null}فقط مرجع
V27wandb/openai/gpt-oss-120b{"axes":{},"hostingProvider":"wandb","region":null}فقط مرجع
V28watsonx/openai/gpt-oss-120b{"axes":{},"hostingProvider":"watsonx","region":null}فقط مرجع

قیمت‌های مرجع ارائه‌دهندگان ​

{"currency":"USD","normalizationStatus":"normalized","source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}

F1 — ورودی متنی{"billingRole":"input","field":"input_cost_per_token","modality":"text","qualifiers":{},"unit":"USD/token"}

F2 — خروجی متنی{"billingRole":"output","field":"output_cost_per_token","modality":"text","qualifiers":{},"unit":"USD/token"}

F3 — ورودی متنی از حافظه نهان{"billingRole":"cached-input","field":"cache_read_input_token_cost","modality":"text","qualifiers":{},"unit":"USD/token"}

F4 — ورودی متنی{"billingRole":"input","field":"input_cost_per_token_batches","modality":"text","qualifiers":{"executionMode":"batches"},"unit":"USD/token"}

F5 — ورودی متنی{"billingRole":"input","field":"input_cost_per_token_flex","modality":"text","qualifiers":{"executionMode":"flex"},"unit":"USD/token"}

F6 — ورودی متنی{"billingRole":"input","field":"input_cost_per_token_priority","modality":"text","qualifiers":{"executionMode":"priority"},"unit":"USD/token"}

F7 — خروجی متنی{"billingRole":"output","field":"output_cost_per_token_batches","modality":"text","qualifiers":{"executionMode":"batches"},"unit":"USD/token"}

F8 — خروجی متنی{"billingRole":"output","field":"output_cost_per_token_flex","modality":"text","qualifiers":{"executionMode":"flex"},"unit":"USD/token"}

F9 — خروجی متنی{"billingRole":"output","field":"output_cost_per_token_priority","modality":"text","qualifiers":{"executionMode":"priority"},"unit":"USD/token"}

F10 — ورودی متنی از حافظه نهان{"billingRole":"cached-input","field":"cache_read_input_token_cost_priority","modality":"text","qualifiers":{"executionMode":"priority"},"unit":"USD/token"}

F11 — هزینه ثبت‌شده در منبع{"billingRole":"input","field":"input_cost_per_query","modality":null,"qualifiers":{},"unit":"USD/query"}

هزینه‌ها با مشخصات منبع — واحدهای متفاوت؛ فیلدهای هزینه را بررسی کنید
هزینه‌ها با مشخصات منبع — واحدهای متفاوت؛ فیلدهای هزینه را بررسی کنید
فیلد هزینهمقدارنسخه‌ها
F13e-07V1
F22.5e-06V1
F11.5e-07V2
F26e-07V2
F31e-07V3
F11e-07V3
F25e-07V3
F11.5e-07V4
F47.5e-08V4
F57.5e-08V4
F62.625e-07V4
F26e-07V4
F73e-07V4
F83e-07V4
F91.05e-06V4
F11.8e-07V5
F27.2e-07V5
F11.8e-07V6
F27.2e-07V6
F13.5e-07V7
F27.5e-07V7
F13.5e-07V8
F27.5e-07V8
F18e-07V9
F28e-07V9
F13.7e-08V10
F21.7e-07V10
F31.5e-08V11 V12
F101.8e-08V11 V12
F11.5e-07V11 V12
F61.8e-07V11 V12
F26e-07V11 V12
F97.2e-07V11 V12
F13e-07V13
F22.5e-06V13
F11.5e-07V14
F27.5e-07V14
F37.5e-08V15
F11.5e-07V15
F26e-07V15
F11.5e-07V16
F26e-07V16
F15e-08V17
F22.5e-07V17
F110.0V19
F10.0V19
F20.0V19
F18e-08V20
F24e-07V20
F11.8e-07V21
F27.2e-07V21
F33e-08V22
F16e-08V22
F24e-07V22
F12.2e-07V23
F25.9e-07V23
F11.5e-07V24
F26e-07V24
F30V25
F11.5e-07V25
F26e-07V25
F11.5e-07V26
F26e-07V26
F13e-08V27
F21.7e-07V27
F11.59e-07V28
F26.36e-07V28

{"currency":"USD","normalizationStatus":"normalized","qualifiers":{},"source":"supplemental-reference","sourcePath":"data/rate-limits/missing_models_context_window.json"}

F1 — ورودی متنی{"billingRole":"input","field":"input_cost_per_token","modality":"text","unit":"USD/token"}

F2 — خروجی متنی{"billingRole":"output","field":"output_cost_per_token","modality":"text","unit":"USD/token"}

F3 — هزینه ثبت‌شده در منبع{"billingRole":"input","field":"input_cost_per_query","modality":null,"unit":"USD/query"}

هزینه‌ها با مشخصات منبع — واحدهای متفاوت؛ فیلدهای هزینه را بررسی کنید
هزینه‌ها با مشخصات منبع — واحدهای متفاوت؛ فیلدهای هزینه را بررسی کنید
فیلد هزینهمقدارنسخه‌ها
F11.5e-07V14
F27.5e-07V14
F30.0V18
F10.0V18
F20.0V18

{"billingRole":null,"currency":null,"modality":null,"normalizationStatus":"opaque","qualifiers":{},"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json","unit":null}

F1 — هزینه ثبت‌شده در منبع{"field":"search_context_cost_per_query"}

هزینه‌ها با مشخصات منبع — واحد تأیید نشده
هزینه‌ها با مشخصات منبع — واحد تأیید نشده
فیلد هزینهمقدارنسخه‌ها
F1{"search_context_size_high":0.005,"search_context_size_low":0.005,"search_context_size_medium":0.005}V15

واحد تأیید نشده یعنی مقدار منبع بدون تفسیر حفظ شده است؛ این مقدار در مقایسه قیمت‌ها به کار نمی‌رود. null قیمت رایگان نیست.

قابلیت‌ها و محدودیت‌ها ​

قابلیت‌ها و پنجره زمینه در AvalAI
فیلدمقدارشناسه‌های مربوطمنبع
max_input_tokens128000V13فهرست AvalAI
max_input_tokens131072V14فهرست AvalAI
max_input_tokensنامشخصV18فهرست AvalAI
max_output_tokens128000V13فهرست AvalAI
max_output_tokens32766V14فهرست AvalAI
max_output_tokensنامشخصV18فهرست AvalAI
max_requests_per_1_minute2500.0V13فهرست AvalAI
max_requests_per_1_minute1000.0V14فهرست AvalAI
max_requests_per_1_minute25.0V18فهرست AvalAI
max_tokens128000V13فهرست AvalAI
max_tokens32766V14فهرست AvalAI
max_tokensنامشخصV18فهرست AvalAI
max_tokens_per_1_minute4000000.0V13فهرست AvalAI
max_tokens_per_1_minute250000.0V14فهرست AvalAI
max_tokens_per_1_minute40000.0V18فهرست AvalAI
min_tier0V13
V14
V18
فهرست AvalAI
mode"chat"V13
V14
V18
فهرست AvalAI
object"model"V13
V14
V18
فهرست AvalAI
owned_by"openai"V13
V14
V18
فهرست AvalAI
supported_endpointsنامشخصV13
V14
V18
فهرست AvalAI
supports_function_callingtrue — پشتیبانی می‌شودV13
V14
فهرست AvalAI
supports_function_callingنامشخصV18فهرست AvalAI
supports_parallel_function_callingنامشخصV13
V18
فهرست AvalAI
supports_parallel_function_callingtrue — پشتیبانی می‌شودV14فهرست AvalAI
supports_reasoningtrue — پشتیبانی می‌شودV13
V14
فهرست AvalAI
supports_reasoningنامشخصV18فهرست AvalAI
supports_response_schematrue — پشتیبانی می‌شودV13
V14
فهرست AvalAI
supports_response_schemaنامشخصV18فهرست AvalAI
supports_tool_choicetrue — پشتیبانی می‌شودV13
V14
فهرست AvalAI
supports_tool_choiceنامشخصV18فهرست AvalAI
supports_visiontrue — پشتیبانی می‌شودV13فهرست AvalAI
supports_visionنامشخصV14
V18
فهرست AvalAI
supports_web_searchنامشخصV13
V18
فهرست AvalAI
supports_web_searchtrue — پشتیبانی می‌شودV14فهرست AvalAI
محدودیت مصرف و دسترسی هر شناسه در سطح‌های حساب
شناسه مدلسطحدسترسیRPMTPMمحدودیت‌های دیگرمنبع
V130در دسترس1.040000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"}منبع دقیق سطح حساب
V131در دسترس250.0450000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"}منبع دقیق سطح حساب
V132در دسترس500.0800000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"}منبع دقیق سطح حساب
V133در دسترس750.01200000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"}منبع دقیق سطح حساب
V134در دسترس1500.02000000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"}منبع دقیق سطح حساب
V135در دسترس2500.04000000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"azure"}منبع دقیق سطح حساب
V140در دسترس1.010000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"}منبع دقیق سطح حساب
V141در دسترس50.075000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"}منبع دقیق سطح حساب
V142در دسترس75.0100000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"}منبع دقیق سطح حساب
V143در دسترس100.0150000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"}منبع دقیق سطح حساب
V144در دسترس500.0200000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"}منبع دقیق سطح حساب
V145در دسترس1000.0250000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"groq"}منبع دقیق سطح حساب
V180در دسترس3.010000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"}منبع دقیق سطح حساب
V181در دسترس5.020000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"}منبع دقیق سطح حساب
V182در دسترس10.030000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"}منبع دقیق سطح حساب
V183در دسترس15.030000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"}منبع دقیق سطح حساب
V184در دسترس20.030000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"}منبع دقیق سطح حساب
V185در دسترس25.040000.0{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_tokens_per_1_day":2147483647.0,"owner":"openai","provider":"nvidia_nim"}منبع دقیق سطح حساب

اطلاعات فنی و منابع مرجع ​

منابع زیر مستقل‌اند و ممکن است اختلاف داشته باشند. این اطلاعات قیمت، قابلیت یا مسیر پشتیبانی‌شده AvalAI را تغییر نمی‌دهند.

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V1 V13

{"litellm_provider":"azure","max_input_tokens":128000,"max_output_tokens":128000,"max_tokens":128000,"mode":"chat","supports_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_vision":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V2

{"litellm_provider":"azure_ai","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://prices.azure.com/api/retail/prices?$filter=serviceName%20eq%20'Foundry%20Models'%20and%20armRegionName%20eq%20'eastus'%20and%20priceType%20eq%20'Consumption'","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_response_schema":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V3

{"litellm_provider":"baseten","max_input_tokens":128072,"max_output_tokens":128072,"max_tokens":128072,"mode":"chat","source":"https://inference.baseten.co/v1/models","supports_function_calling":true,"supports_prompt_caching":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_vision":false}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V4

{"litellm_provider":"bedrock_mantle","max_input_tokens":131072,"max_output_tokens":16384,"max_tokens":16384,"mode":"chat","source":"https://pricing.us-east-1.amazonaws.com/offers/v1.0/aws/AmazonBedrock/current/us-east-1/index.json","supported_endpoints":["/v1/chat/completions","/v1/responses"],"supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V5 V6

{"litellm_provider":"bedrock_mantle","max_input_tokens":131072,"max_output_tokens":16384,"max_tokens":16384,"mode":"chat","source":"https://docs.aws.amazon.com/bedrock/latest/userguide/model-card-openai-gpt-oss-120b.html","supported_endpoints":["/v1/chat/completions","/v1/responses"],"supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V7

{"litellm_provider":"cerebras","max_input_tokens":131072,"max_output_tokens":32768,"max_tokens":32768,"mode":"chat","source":"https://www.cerebras.ai/blog/openai-gpt-oss-120b-runs-fastest-on-cerebras","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V8

{"litellm_provider":"cloudflare","max_input_tokens":128000,"max_output_tokens":128000,"max_tokens":128000,"mode":"chat","rpm":300,"supports_function_calling":true,"supports_reasoning":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V9

{"litellm_provider":"crusoe","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_system_messages":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V10

{"litellm_provider":"deepinfra","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://deepinfra.com/pricing","supports_function_calling":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V11 V12

{"litellm_provider":"fireworks_ai","max_input_tokens":131072,"max_output_tokens":32768,"max_tokens":32768,"mode":"chat","source":"https://api.fireworks.ai/v1/serverless/models","supports_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_vision":false}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V14

{"litellm_provider":"groq","max_input_tokens":131072,"max_output_tokens":32766,"max_tokens":32766,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_web_search":true}

{"source":"supplemental-reference","sourcePath":"data/rate-limits/missing_models_context_window.json"}V14

{"litellm_provider":"groq","max_input_tokens":131072,"max_output_tokens":32766,"max_tokens":32766,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_web_search":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V15

{"litellm_provider":"groq","max_input_tokens":131072,"max_output_tokens":65536,"max_tokens":65536,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true,"supports_web_search":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V16

{"litellm_provider":"nebius","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://tokenfactory.nebius.com/models/catalog/text2text/openai%2Fgpt-oss-120b","supports_function_calling":true,"supports_reasoning":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V17

{"litellm_provider":"novita","max_input_tokens":131072,"max_output_tokens":32768,"max_tokens":32768,"mode":"chat","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_system_messages":true,"supports_tool_choice":true,"supports_vision":false}

{"source":"supplemental-reference","sourcePath":"data/rate-limits/missing_models_context_window.json"}V18

{"litellm_provider":"nvidia_nim","mode":"chat"}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V19

{"litellm_provider":"nvidia_nim","mode":"chat"}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V20

{"litellm_provider":"ovhcloud","max_input_tokens":131000,"max_output_tokens":131000,"max_tokens":131000,"mode":"chat","source":"https://www.ovhcloud.com/en/public-cloud/ai-endpoints/catalog/","supports_function_calling":false,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":false}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V21

{"litellm_provider":"replicate","mode":"chat","supports_function_calling":true,"supports_system_messages":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V22

{"litellm_provider":"sail","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://docs.sailresearch.com/models","supports_function_calling":true,"supports_prompt_caching":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V23

{"litellm_provider":"sambanova","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://cloud.sambanova.ai/plans/pricing","supports_function_calling":true,"supports_reasoning":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V24

{"litellm_provider":"scaleway","max_input_tokens":128000,"max_output_tokens":32768,"max_tokens":32768,"mode":"chat","supports_function_calling":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V25

{"litellm_provider":"tensormesh","max_input_tokens":131072,"max_output_tokens":131072,"mode":"chat","source":"https://serverless.tensormesh.ai/v1/models/openrouter","supports_function_calling":true,"supports_prompt_caching":true,"supports_reasoning":true,"supports_response_schema":true,"supports_system_messages":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V26

{"litellm_provider":"together_ai","max_input_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://api.together.ai/v1/models","supports_function_calling":true,"supports_parallel_function_calling":true,"supports_reasoning":true,"supports_response_schema":true,"supports_tool_choice":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V27

{"litellm_provider":"wandb","max_input_tokens":131000,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://wandb.ai/site/pricing/tokens/","supports_reasoning":true}

{"source":"primary-reference","sourcePath":"data/rate-limits/model_prices_and_context_window.json"}V28

{"litellm_provider":"watsonx","max_input_tokens":131072,"max_output_tokens":131072,"max_tokens":131072,"mode":"chat","source":"https://dataplatform.cloud.ibm.com/docs/content/wsj/analyze-data/fm-models.html?context=wx","supports_function_calling":false,"supports_parallel_function_calling":false,"supports_vision":false}

{"sourcePath":"data/rate-limits/tier0.json","tier":0,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":1.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":40000.0,"owner":"openai","provider":"azure"}}V13

{"sourcePath":"data/rate-limits/tier1.json","tier":1,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":250.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":450000.0,"owner":"openai","provider":"azure"}}V13

{"sourcePath":"data/rate-limits/tier2.json","tier":2,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":500.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":800000.0,"owner":"openai","provider":"azure"}}V13

{"sourcePath":"data/rate-limits/tier3.json","tier":3,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":750.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":1200000.0,"owner":"openai","provider":"azure"}}V13

{"sourcePath":"data/rate-limits/tier4.json","tier":4,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":1500.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":2000000.0,"owner":"openai","provider":"azure"}}V13

{"sourcePath":"data/rate-limits/tier5.json","tier":5,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":2500.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":4000000.0,"owner":"openai","provider":"azure"}}V13

{"sourcePath":"data/rate-limits/tier0.json","tier":0,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":1.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":10000.0,"owner":"openai","provider":"groq"}}V14

{"sourcePath":"data/rate-limits/tier1.json","tier":1,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":50.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":75000.0,"owner":"openai","provider":"groq"}}V14

{"sourcePath":"data/rate-limits/tier2.json","tier":2,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":75.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":100000.0,"owner":"openai","provider":"groq"}}V14

{"sourcePath":"data/rate-limits/tier3.json","tier":3,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":100.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":150000.0,"owner":"openai","provider":"groq"}}V14

{"sourcePath":"data/rate-limits/tier4.json","tier":4,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":500.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":200000.0,"owner":"openai","provider":"groq"}}V14

{"sourcePath":"data/rate-limits/tier5.json","tier":5,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":1000.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":250000.0,"owner":"openai","provider":"groq"}}V14

{"sourcePath":"data/rate-limits/tier0.json","tier":0,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":3.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":10000.0,"owner":"openai","provider":"nvidia_nim"}}V18

{"sourcePath":"data/rate-limits/tier1.json","tier":1,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":5.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":20000.0,"owner":"openai","provider":"nvidia_nim"}}V18

{"sourcePath":"data/rate-limits/tier2.json","tier":2,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":10.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":30000.0,"owner":"openai","provider":"nvidia_nim"}}V18

{"sourcePath":"data/rate-limits/tier3.json","tier":3,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":15.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":30000.0,"owner":"openai","provider":"nvidia_nim"}}V18

{"sourcePath":"data/rate-limits/tier4.json","tier":4,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":20.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":30000.0,"owner":"openai","provider":"nvidia_nim"}}V18

{"sourcePath":"data/rate-limits/tier5.json","tier":5,"values":{"max_audio_megabytes_per_1_minute":null,"max_images_per_1_minute":null,"max_requests_per_1_day":null,"max_requests_per_1_minute":25.0,"max_tokens_per_1_day":2147483647.0,"max_tokens_per_1_minute":40000.0,"owner":"openai","provider":"nvidia_nim"}}V18