Fireworks.ai

Fireworks.ai provides production inference for open-weight models. AvalAI exposes selected Fireworks.ai-hosted models through compatible API routes while the model owner remains the original developer, such as Meta or NVIDIA.

Available Models

• muse-glimmer-30b — Meta's 30B multimodal agentic model
• nemotron-3.5-lightning — NVIDIA's efficient 30B/3B-active reasoning model
• nemotron-3-ultra — NVIDIA's large-scale reasoning and agentic model

API Endpoint Support

Model	v1/chat/completions	v1/messages	v1/responses
muse-glimmer-30b	✅ Full	✅ Full	⚠️ Partial
nemotron-3.5-lightning	✅ Full	✅ Full	⚠️ Partial
nemotron-3-ultra	✅ Full	✅ Full	⚠️ Partial

Partial Responses support means some Responses-only fields or stateful features may not be available. Validate the exact request shape before production rollout.

Key Features

• OpenAI-compatible Chat Completions access
• Anthropic-compatible Messages access
• Function calling and agentic workflows
• Provider-side implicit prompt caching where eligible
• Cached-input pricing for repeated prompt prefixes

muse-glimmer-30b

Developed by Meta Superintelligence Lab and hosted by Fireworks.ai, Muse Glimmer is an approximately 30B-parameter dense causal model with a perception encoder. It combines text and image understanding, multilingual generation, tool use, multi-step reasoning, failure recovery, and a context window of at least 131,072 tokens.

Features

• Text and image input with text output
• More than 100 supported languages
• Agentic task completion, coding, and tool use
• Configurable reasoning strengths: low, medium, high, and xhigh
• Recommended upstream sampling: temperature: 1.0, top_p: 0.95, top_k: 64

Pricing

Type	Cost per 1M tokens
Input	$0.35
Cached input	$0.04
Output	$1.50

Endpoint Support

Endpoint	Support
v1/chat/completions	✅ Full
v1/messages	✅ Full
v1/responses	⚠️ Partial

Example

Bash

curl https://api.avalai.ir/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "muse-glimmer-30b",
    "messages": [{"role": "user", "content": "Plan a reliable tool-using research workflow."}]
  }'

Python

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["AVALAI_API_KEY"], base_url="https://api.avalai.ir/v1"
)
response = client.chat.completions.create(
    model="muse-glimmer-30b",
    messages=[
        {"role": "user", "content": "Plan a reliable tool-using research workflow."}
    ],
)
print(response.choices[0].message.content)

JavaScript

import OpenAI from "openai";

const client = new OpenAI({ apiKey: process.env.AVALAI_API_KEY, baseURL: "https://api.avalai.ir/v1" });
const response = await client.chat.completions.create({
  model: "muse-glimmer-30b",
  messages: [{ role: "user", content: "Plan a reliable tool-using research workflow." }],
});
console.log(response.choices[0].message.content);

nemotron-3.5-lightning

Developed by NVIDIA and hosted by Fireworks.ai, Nemotron 3.5 Lightning is a 30B-total, 3B-active hybrid Mixture-of-Experts model. It interleaves Mamba-2, MoE, and attention layers for efficient agentic reasoning, coding, RAG, structured output, and tool use. AvalAI records a 262,144-token context window for this route.

Features

• Efficient 30B-total / 3B-active hybrid MoE architecture
• Reasoning, coding, RAG, and autonomous-agent workloads
• Tool calling and structured output
• Upstream thinking can be enabled or disabled
• Recommended upstream sampling: temperature: 1.0, top_p: 0.95

Pricing

Type	Cost per 1M tokens
Input	$0.05
Cached input	$0.01
Output	$0.20

Endpoint Support

Endpoint	Support
v1/chat/completions	✅ Full
v1/messages	✅ Full
v1/responses	⚠️ Partial

Example

Bash

curl https://api.avalai.ir/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "nemotron-3.5-lightning",
    "messages": [{"role": "user", "content": "Review this deployment plan and list the three highest risks."}]
  }'

Python

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["AVALAI_API_KEY"], base_url="https://api.avalai.ir/v1"
)
response = client.chat.completions.create(
    model="nemotron-3.5-lightning",
    messages=[
        {
            "role": "user",
            "content": "Review this deployment plan and list the three highest risks.",
        }
    ],
)
print(response.choices[0].message.content)

JavaScript

import OpenAI from "openai";

const client = new OpenAI({ apiKey: process.env.AVALAI_API_KEY, baseURL: "https://api.avalai.ir/v1" });
const response = await client.chat.completions.create({
  model: "nemotron-3.5-lightning",
  messages: [{ role: "user", content: "Review this deployment plan and list the three highest risks." }],
});
console.log(response.choices[0].message.content);

nemotron-3-ultra

NVIDIA's large-scale Nemotron model is hosted on Fireworks.ai for complex reasoning, high-quality generation, and multi-step tool workflows.

Pricing

Type	Cost per 1M tokens
Input	$0.60
Cached input	$0.12
Output	$2.40

Endpoint Support

Endpoint	Support
v1/chat/completions	✅ Full
v1/messages	✅ Full
v1/responses	⚠️ Partial

Related Resources

• Pricing
• Chat Completions API
• Messages API
• Reasoning guide
• Prompt caching