Open-Weight Models on Sarvam AI

Sarvam serves a curated set of open-weight models using your existing Sarvam API key and credits. Open-weight models are available on /v2.

Available in beta. GLM-5.3, Gemma 4 31B, and DeepSeek V4 Flash are rolling out gradually. Your API key must be whitelisted for beta access before these models respond. Contact us to request access.

Available models

All three models support tool calling and produce text output. GLM-5.3 and DeepSeek V4 Flash expose reasoning output.

Model	Context window	Modality	Reasoning
GLM-5.3	1,048,576 tokens	Text → text	Yes
Gemma 4 31B	131,072 tokens	Text + image → text	No
DeepSeek V4 Flash	1,048,576 tokens	Text → text	Yes

Reasoning (`glm5.3`, `deepseekv4-flash`)

Three levels: low, high, and max. Default when omitted is max.

Route	Field	Values
Chat Completion V2	`reasoning_effort`	`low`, `high`, or `max` — omit or pass `max` for maximum
Responses	`reasoning.effort`	`low`, `high`, or omit for `max` — do not send the string `max` (`400`)

Chat: choices[].message.reasoning_content. Responses (glm5.3): reasoning item in output, summary[0].text. Reasoning tokens count toward max_tokens / max_output_tokens (default 2048 when omitted on glm5.3). Gemma 4 31B does not expose reasoning.

Using open-weight models

Chat Completion

from sarvamai import SarvamAI
client = SarvamAI(api_subscription_key="YOUR_SARVAM_API_KEY")
response = client.chat.completions_v2(
    model="glm5.3",
    messages=[
        {"role": "user", "content": "Summarise the causes of the 2008 financial crisis."}
    ],
    temperature=1,
    top_p=0.95,
    max_tokens=1000,
)
print(response.choices[0].message.content)

Shared behaviour

Endpoint — POST https://api.sarvam.ai/v2/chat/completions. See the Chat Completion V2 API Reference.
Responses API — the same models support POST /v2/responses.
Model discovery — GET /v2/models lists the model IDs currently available.
Authentication — pass api-subscription-key: sk_xxx. See Authentication.
Beta access — access is granted per API key. See Access to Beta APIs.
Streaming — set "stream": true to receive server-sent events.
Billing — usage is metered per token against your Sarvam credits. See Pricing.
Rate limits — limits are applied per API key. See Credits & Rate Limits.