Inkling 2 Small on Vercel AI Gateway

Inkling · Thinking Machines Lab

Serverless
Open Source

Last refreshed 2026-11-13. Next refresh: weekly.

Why use Inkling 2 Small on Vercel AI Gateway?

Vercel AI Gateway offers Inkling 2 Small with pay-as-you-go pricing at $0.30/1M input tokens. Vercel AI Gateway is a unified AI proxy providing a single OpenAI-compatible API endpoint to 275+ models from 25+ providers including Anthropic, OpenAI, Google, Meta, Mistral, DeepSeek, xAI, Alibaba, Amazon, ByteDance, Cohere, MiniMax, MoonshotAI, KwaiPilot, Black Forest Labs, Recraft, Voyage AI, NVIDIA, and more.

Compare Inkling 2 Small across 6 providers to find the best fit for your use case
Input / 1M
$0.30
Output / 1M
$1.00
Cache
read $0.030
Batch
Not sourced

Setup recipe

Python + curl
Install
pip install openai
Auth
export AI_GATEWAY_API_KEY=...
Call
import os
from openai import OpenAI
client = OpenAI(
    api_key=os.environ["AI_GATEWAY_API_KEY"],
Model ID
thinkingmachines/inkling-2-small

Request example

import os
from openai import OpenAI

client = OpenAI(
    api_key=os.environ["AI_GATEWAY_API_KEY"],
    base_url="https://ai-gateway.vercel.sh/v1"
)
response = client.chat.completions.create(
    model="thinkingmachines/inkling-2-small",
    messages=[{"role": "user", "content": "Hello"}]
)
print(response.choices[0].message.content)

Gotchas

  • Use provider model ID "thinkingmachines/inkling-2-small", not the LLMReference slug "inkling-2-small".
  • creator/model-name e.g. kwaipilot/kat-coder-pro-v2
  • The examples expect AI_GATEWAY_API_KEY; rename it only if your application config maps the new variable.

Compare Inkling 2 Small Across Providers

ProviderInput (per 1M)Output (per 1M)
Tinker$0.30$1.00
OpenRouterFreeFree
Together AI$0.30$1.00
Cloudflare Workers AI$0.30$1.00
DeepInfra$0.30$1.00
View all 6 providers →

Pricing

TypePrice (per 1M)
Input tokens$0.30
Output tokens$1.00

Capabilities

VisionMultimodalReasoningJSON / Tool useFine-tuning

About Inkling 2 Small

Inkling 2 Small is Thinking Machines Lab's first second-generation Inkling model, released November 5, 2026. It is a 594B-total / 17B-active mixture-of-experts model for text and image inputs with text output, a context window of up to 1M tokens and controllable reasoning effort. It launched for inference and fine-tuning on Tinker; on November 12, 2026 Thinking Machines released its weights on Hugging Face under Apache 2.0 (NVFP4, plus an MXFP8 variant), and it is also served by Together AI, Cloudflare Workers AI, DeepInfra and Vercel AI Gateway at $0.30 per 1M input and $1.00 per 1M output tokens.

Get Started

Model Specs

Released2026-11-05
Parameters594B (17B active)
Context1M
ArchitectureMixture of Experts