Migrating from Fireworks AI: Overview

Last updated: October 23, 2026

Fireworks AI and Sarvam’s /v2 API both speak the OpenAI Chat Completions format, so most migrations are a base URL, key, and model ID change. This page covers those setup changes. The Chat Completion and Responses API guides cover request fields, reasoning, tools, and the Fireworks-only features to remove.

Quick start

Change the client and the model ID. Use the openai package you already have, or Sarvam’s own SDK (SDKs & Libraries). If you use the Fireworks SDK, the Before (Fireworks SDK) option shows that version; the request shape is the same, so you can move to either the openai package or Sarvam’s SDK.

from openai import OpenAI
client = OpenAI(
    api_key="YOUR_FIREWORKS_API_KEY",
    base_url="https://api.fireworks.ai/inference/v1",
)
response = client.chat.completions.create(
    model="accounts/fireworks/models/kimi-k3",
    messages=[{"role": "user", "content": "Hello!"}],
)

For requests made directly over HTTP, change the URL, the auth header, and the model ID:

curl https://api.fireworks.ai/inference/v1/chat/completions \
  -H "Authorization: Bearer YOUR_FIREWORKS_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "accounts/fireworks/models/glm-5p3-flash",
    "messages": [{"role": "user", "content": "Explain UPI in two sentences."}],
    "max_tokens": 1000
  }'

Zero-code switch

The openai package for Python and JavaScript reads its endpoint and key from the OPENAI_BASE_URL and OPENAI_API_KEY environment variables when you create the client without them. If your app does that, and reads the model ID from configuration, you can switch without changing code:

export OPENAI_BASE_URL="https://api.sarvam.ai/v2"
export OPENAI_API_KEY="YOUR_SARVAM_API_KEY"

from openai import OpenAI
client = OpenAI()  # picks up OPENAI_BASE_URL and OPENAI_API_KEY

Then set your configured model to a Sarvam model ID. If your requests send Fireworks-only fields, remove them as described in the Chat Completion guide.

This works with the openai package only. If your code uses the Fireworks SDK, switch to the openai package first, as in the quick start.

Base URL and auth

Model IDs

Sarvam has one ID per model. Fireworks’ Fast and US router variants, and your own dedicated deployments of these models, map to the same Sarvam ID.

Sarvam’s deepseekv4-pro is the newer 0813 snapshot of DeepSeek V4 Pro, so outputs can differ from the April 2026 snapshot on Fireworks.

Gemma 4 31B and DeepSeek V4 Pro need a dedicated deployment on Fireworks. On Sarvam, call them by model ID like any other model, with no deployment to create or manage.

Model IDs are case-sensitive. An unknown ID returns 404 not_found_error. GET /v2/models lists the available models. Beta models need per-key access: without it, they return 400 invalid_request_error, even though the list shows them. Contact us to request access.

Models not on Sarvam

If you use a model that Sarvam doesn’t serve, start with the closest one below, then test it on your own prompts before switching traffic. These are suggestions, not drop-in equivalents.

For other model families, such as Qwen, Llama, gpt-oss, or MiniMax, choose by what you need:

Media input and request size

Sarvam accepts images, audio, and video only as inline base64 data URIs. Remote http(s) URLs return 400 on every model, even where your current provider fetches them for you, so download the file and encode it before sending.

import base64
def data_uri(path: str, mime: str) -> str:
    with open(path, "rb") as f:
        return f"data:{mime};base64," + base64.b64encode(f.read()).decode()
image_part = {"type": "image_url", "image_url": {"url": data_uri("chart.png", "image/png")}}
video_part = {"type": "video_url", "video_url": {"url": data_uri("clip.mp4", "video/mp4")}}

Request bodies, including base64 media, are limited to 40 MiB on kimi-k3 and the MiMo models, and 10 MiB on other models. Larger requests return 413 with the limit in the message. Base64 adds about 33%, so about 30 MB of raw media fits in a 40 MiB request.

Errors and rate limits

Sarvam returns 403 (not 401) for a missing or invalid key, 429 when you exceed a rate limit, and 503 when a model is overloaded. Retry 429 and 503 with backoff. Limits apply per API key, as requests per minute rather than Fireworks’ adaptive tokens-per-minute limits. See Errors & Troubleshooting and Credits & Rate Limits.

See also

• Migrating Chat Completion from Fireworks
• Migrating the Responses API from Fireworks
• Open-Weight Models
• Beta models
• Errors & Troubleshooting