Developer Dashboard

Moonshot.ai Provider and Alibaba Embedding Models Now Available

Date: 2025-11-10

Summary

AvalAI introduces support for Moonshot.ai, a new provider offering 10 advanced models including the powerful Kimi series with up to 128K context windows and reasoning capabilities. Additionally, we introduce 4 new multimodal and text embedding models from Alibaba (Dashscope), expanding your options for vector-based applications. All models are available through our unified API with support for multiple endpoints.


Details

Moonshot.ai

We introduce 10 new models from Moonshot.ai, featuring the advanced Kimi series with extended context windows, vision capabilities, reasoning features, and tool calling support:

  • kimi-k2-0711-preview: Preview release of the next-generation K2 model with enhanced performance and efficiency. 128K context length.

  • kimi-latest: The latest stable Kimi model with automatic version selection and optimization. 128K context length.

  • kimi-thinking-preview: Advanced reasoning model with Chain-of-Thought capabilities for complex multi-step problem-solving. 128K context length.

  • moonshot-v1-8k: Cost-effective model for shorter conversations. 8K context length.

  • moonshot-v1-8k-vision-preview: Vision-enabled model for multimodal tasks. 8K context length.

  • moonshot-v1-32k: Balanced model for medium-length conversations. 32K context length.

  • moonshot-v1-32k-vision-preview: Vision-enabled model with extended context. 32K context length.

  • moonshot-v1-128k: Extended context model for document processing. 128K context length.

  • moonshot-v1-128k-vision-preview: Vision-enabled model with maximum context window. 128K context length.

  • moonshot-v1-auto: Automatically selects the optimal model based on your input. Up to 128K context length.

Key Features:

  • Extended Context Windows: 8K to 128K tokens for handling extensive conversations and documents
  • Vision Capabilities: Vision-preview models support Base64-encoded images and image URLs
  • Reasoning Models: kimi-thinking-preview provides Chain-of-Thought reasoning for complex analysis
  • Tool Use (Function Calling): All models support function calling with up to 128 tools per request
  • JSON Mode: Structured output support via response_format parameter
  • Partial Mode: Ability to prefill assistant responses for better output control
  • Auto Selection: moonshot-v1-auto intelligently routes to the best model
  • Prompt Caching: All models support cached input for significant cost savings on repeated tokens
  • OpenAI Compatibility: Full support for OpenAI SDK and API format

Endpoint Support:

Pricing Details:

ModelInputCached InputOutput
kimi-k2-0711-preview$0.60/1M tokens$0.15/1M tokens$2.50/1M tokens
kimi-latest$0.20/1M tokens$0.15/1M tokens$5.00/1M tokens
kimi-thinking-preview$30.00/1M tokens$0.15/1M tokens$30.00/1M tokens
moonshot-v1-8k$0.20/1M tokens$0.15/1M tokens$2.00/1M tokens
moonshot-v1-8k-vision-preview$0.20/1M tokens$0.15/1M tokens$2.00/1M tokens
moonshot-v1-32k$1.00/1M tokens$0.15/1M tokens$3.00/1M tokens
moonshot-v1-32k-vision-preview$1.00/1M tokens$0.15/1M tokens$3.00/1M tokens
moonshot-v1-128k$2.00/1M tokens$0.15/1M tokens$5.00/1M tokens
moonshot-v1-128k-vision-preview$2.00/1M tokens$0.15/1M tokens$5.00/1M tokens
moonshot-v1-auto$2.00/1M tokens$0.15/1M tokens$5.00/1M tokens

Additional Costs:

  • Web Search Tool Call: $0.005 per call (when using external web search tools)

Alibaba (Dashscope) Embedding Models

We introduce 4 new embedding models from Alibaba Dashscope, including multimodal capabilities:

  • tongyi-embedding-vision-plus: Advanced multimodal embedding model supporting text, images, and videos. 1,152 dimensions, 1,024 token text limit.

  • tongyi-embedding-vision-flash: Fast multimodal embedding model optimized for speed. 768 dimensions, 1,024 token text limit.

  • text-embedding-v4: Latest generation text embedding model with configurable dimensions (64-2,048). Supports task instructions, sparse vectors, and batch processing.

  • text-embedding-v3: Previous generation text embedding model with proven performance. Configurable dimensions (512-1,024).

Key Features:

  • Multimodal Support: Vision models support text, images, and video inputs
  • Configurable Dimensions: Text models support multiple dimension options
  • OpenAI Compatibility: Works with OpenAI SDK through v1/embeddings endpoint
  • Native API Support: Also returns Alibaba native response format for advanced features
  • Task Instructions: text-embedding-v4 supports custom task optimization
  • Sparse Vectors: text-embedding-v4 can generate both dense and sparse vectors

Use Cases:

  • Cross-modal retrieval (text-to-image, image-to-video)
  • Semantic similarity calculation
  • Content classification and clustering
  • Text-based image search
  • Video content analysis

For native Alibaba API parameters with OpenAI SDK, use the extra_body field to pass non-OpenAI parameters.

API Request/Response Examples

Example Request - Moonshot.ai Chat

bash
curl https://api.avalai.ir/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "kimi-latest",
    "messages": [
      {
        "role": "user",
        "content": "Explain quantum computing in simple terms."
      }
    ]
  }'

Example Response - Moonshot.ai Chat

json
{
  "id": "cmpl-moonshot-1234567890",
  "created": 1762123456,
  "model": "kimi-latest",
  "object": "chat.completion",
  "system_fingerprint": null,
  "choices": [
    {
      "finish_reason": "stop",
      "index": 0,
      "message": {
        "content": "Quantum computing is a revolutionary approach to computation that leverages the principles of quantum mechanics...",
        "role": "assistant",
        "thinking_blocks": [],
        "annotations": []
      }
    }
  ],
  "usage": {
    "completion_tokens": 245,
    "prompt_tokens": 18,
    "total_tokens": 263,
    "completion_tokens_details": null,
    "prompt_tokens_details": {
      "audio_tokens": null,
      "cached_tokens": 0,
      "text_tokens": 18,
      "image_tokens": null
    }
  },
  "estimated_cost": {
    "unit": "0.0013474000",
    "irt": 154.36,
    "exchange_rate": 114600
  }
}

Example Request - Moonshot.ai Reasoning

bash
curl https://api.avalai.ir/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "kimi-thinking-preview",
    "messages": [
      {
        "role": "user",
        "content": "Design a scalable microservices architecture for an e-commerce platform"
      }
    ],
    "max_tokens": 4096
  }'

Example Request - Alibaba Text Embedding

bash
curl https://api.avalai.ir/v1/embeddings \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "text-embedding-v4",
    "input": "Machine learning is transforming technology",
    "dimensions": 1024
  }'

Example Response - Alibaba Text Embedding

json
{
  "object": "list",
  "data": [
    {
      "object": "embedding",
      "index": 0,
      "embedding": [
        -0.026611328125,
        -0.016571044921875,
        -0.02227783203125,
        0.0156707763671875,
        "...[1024 dimensions total]"
      ]
    }
  ],
  "model": "text-embedding-v4",
  "usage": {
    "prompt_tokens": 8,
    "total_tokens": 8
  },
  "estimated_cost": {
    "unit": "0.0000005600",
    "irt": 0.06,
    "exchange_rate": 114600
  }
}

Example Request - Alibaba Multimodal Embedding

bash
curl https://api.avalai.ir/v1/embeddings \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "tongyi-embedding-vision-plus",
    "input": {
      "contents": [
        {"text": "A beautiful sunset over mountains"},
        {"image": "https://dashscope.oss-cn-beijing.aliyuncs.com/images/256_1.png"}
      ]
    }
  }'

SDK Usage Examples

Moonshot.ai Chat Completions

bash
curl https://api.avalai.ir/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "kimi-latest",
    "messages": [
      {
        "role": "user",
        "content": "What are the key principles of sustainable architecture?"
      }
    ]
  }'
python
from openai import OpenAI

client = OpenAI(api_key="your-avalai-api-key", base_url="https://api.avalai.ir/v1")

completion = client.chat.completions.create(
    model="kimi-latest",
    messages=[
        {
            "role": "user",
            "content": "What are the key principles of sustainable architecture?",
        }
    ],
)

print(completion.choices[0].message.content)
javascript
import { OpenAI } from "openai";

const client = new OpenAI({
  apiKey: process.env.AVALAI_API_KEY,
  baseURL: "https://api.avalai.ir/v1",
});

const completion = await client.chat.completions.create({
  model: "kimi-latest",
  messages: [
    {
      role: "user",
      content: "What are the key principles of sustainable architecture?",
    },
  ],
});

console.log(completion.choices[0].message.content);

Moonshot.ai Vision Model

bash
curl https://api.avalai.ir/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "moonshot-v1-8k-vision-preview",
    "messages": [
      {
        "role": "user",
        "content": [
          {
            "type": "text",
            "text": "What is in this image?"
          },
          {
            "type": "image_url",
            "image_url": {
              "url": "https://dashscope.oss-cn-beijing.aliyuncs.com/images/256_1.png"
            }
          }
        ]
      }
    ]
  }'
python
completion = client.chat.completions.create(
    model="moonshot-v1-8k-vision-preview",
    messages=[
        {
            "role": "user",
            "content": [
                {"type": "text", "text": "What is in this image?"},
                {
                    "type": "image_url",
                    "image_url": {
                        "url": "https://dashscope.oss-cn-beijing.aliyuncs.com/images/256_1.png"
                    },
                },
            ],
        }
    ],
)

print(completion.choices[0].message.content)
javascript
const completion = await client.chat.completions.create({
  model: "moonshot-v1-8k-vision-preview",
  messages: [
    {
      role: "user",
      content: [
        { type: "text", text: "What is in this image?" },
        {
          type: "image_url",
          image_url: { url: "https://dashscope.oss-cn-beijing.aliyuncs.com/images/256_1.png" },
        },
      ],
    },
  ],
});

console.log(completion.choices[0].message.content);

Alibaba Text Embeddings

bash
curl https://api.avalai.ir/v1/embeddings \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "text-embedding-v4",
    "input": "Natural language processing enables computers to understand text",
    "dimensions": 1024
  }'
python
from openai import OpenAI

client = OpenAI(api_key="your-avalai-api-key", base_url="https://api.avalai.ir/v1")

response = client.embeddings.create(
    model="text-embedding-v4",
    input="Natural language processing enables computers to understand text",
    dimensions=1024,
)

print(response.data[0].embedding)
javascript
import { OpenAI } from "openai";

const client = new OpenAI({
  apiKey: process.env.AVALAI_API_KEY,
  baseURL: "https://api.avalai.ir/v1",
});

const response = await client.embeddings.create({
  model: "text-embedding-v4",
  input: "Natural language processing enables computers to understand text",
  dimensions: 1024,
});

console.log(response.data[0].embedding);

Alibaba Multimodal Embeddings with Native Parameters

bash
curl https://api.avalai.ir/v1/embeddings \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "tongyi-embedding-vision-plus",
    "input": {
      "contents": [
        {"text": "Product image for search"},
        {"image": "https://example.com/product.jpg"}
      ]
    }
  }'
python
from openai import OpenAI

client = OpenAI(api_key="your-avalai-api-key", base_url="https://api.avalai.ir/v1")

# Using extra_body for native Alibaba parameters
response = client.embeddings.create(
    model="tongyi-embedding-vision-plus",
    input="placeholder",  # Required by OpenAI SDK
    extra_body={
        "input": {
            "contents": [
                {"text": "Product image for search"},
                {"image": "https://example.com/product.jpg"},
            ]
        }
    },
)

print(response.data[0].embedding)
javascript
import { OpenAI } from "openai";

const client = new OpenAI({
  apiKey: process.env.AVALAI_API_KEY,
  baseURL: "https://api.avalai.ir/v1",
});

// Using non-standard parameters
const response = await client.embeddings.create({
  model: "tongyi-embedding-vision-plus",
  input: "placeholder", // Required by OpenAI SDK
  // Native Alibaba format in request body
  input: {
    contents: [
      { text: "Product image for search" },
      { image: "https://example.com/product.jpg" }
    ]
  }
});

console.log(response.data[0].embedding);

Reasoning Model Usage

The kimi-thinking-preview model provides Chain-of-Thought reasoning for complex problem-solving:

bash
curl https://api.avalai.ir/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "kimi-thinking-preview",
    "messages": [
      {
        "role": "user",
        "content": "Analyze the trade-offs between monolithic and microservices architectures"
      }
    ],
    "max_tokens": 4096
  }'
python
response = client.chat.completions.create(
    model="kimi-thinking-preview",
    messages=[
        {
            "role": "user",
            "content": "Analyze the trade-offs between monolithic and microservices architectures",
        }
    ],
    max_tokens=4096,
)

# The model will show its reasoning process
print(response.choices[0].message.content)
javascript
const response = await client.chat.completions.create({
    model: "kimi-thinking-preview",
    messages: [
        {
            role: "user",
            content: "Analyze the trade-offs between monolithic and microservices architectures",
        },
    ],
    max_tokens: 4096,
});

// The model will show its reasoning process
console.log(response.choices[0].message.content);

Advanced Text Embedding Features

The text-embedding-v4 model supports advanced features through the native API:

bash
curl https://api.avalai.ir/v1/embeddings \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $AVALAI_API_KEY" \
  -d '{
    "model": "text-embedding-v4",
    "input": "Research papers on machine learning",
    "dimensions": 1024,
    "text_type": "query",
    "instruct": "Given a research paper query, retrieve relevant research papers"
  }'
python
response = client.embeddings.create(
    model="text-embedding-v4",
    input="Research papers on machine learning",
    dimensions=1024,
    extra_body={
        "text_type": "query",
        "instruct": "Given a research paper query, retrieve relevant research papers",
    },
)

print(response.data[0].embedding)
javascript
const response = await client.embeddings.create({
  model: "text-embedding-v4",
  input: "Research papers on machine learning",
  dimensions: 1024,
  extra_body: {
    text_type: "query",
    instruct: "Given a research paper query, retrieve relevant research papers"
  }
});

console.log(response.data[0].embedding);