LLM Reference

Grok 4 vs Qwen3.5-397B-A17B

Grok 4 (2025) and Qwen3.5-397B-A17B (2026) are frontier-tier reasoning models from xAI and Alibaba. Grok 4 ships a 256k-token context window, while Qwen3.5-397B-A17B ships a 262k-token context window. On MMLU PRO, Qwen3.5-397B-A17B leads by 0.8 pts. On pricing, Qwen3.5-397B-A17B costs $0.39/1M input tokens versus $1.25/1M for the alternative. This comparison covers specs, pricing, API access, capabilities, benchmarks, input and output token costs, and production fit for coding and agent workloads.

Qwen3.5-397B-A17B is ~221% cheaper at $0.39/1M; pay for Grok 4 only for coding workflow support.

Decision scorecard

Local evidence first
SignalGrok 4Qwen3.5-397B-A17B
Best forreasoning-heavy apps, multimodal apps, and tool-calling agentsreasoning-heavy apps, multimodal apps, and tool-calling agents
Decision fitCoding, RAG, and AgentsCoding, RAG, and Agents
Context window256k262k
Cheapest output$2.50/1M tokens$2.34/1M tokens
Provider routes4 tracked4 tracked
Shared benchmarks3 rowsMMLU PRO leader

Decision tradeoffs

Choose Grok 4 when...
  • Grok 4 holds a shared-benchmark lead on SWE-bench Verified, ahead by 0.5 points.
  • Grok 4 uniquely exposes Code execution in local model data.
  • Local decision data tags Grok 4 for Coding, RAG, and Agents.
Choose Qwen3.5-397B-A17B when...
  • Qwen3.5-397B-A17B holds a shared-benchmark lead on MMLU PRO, ahead by 0.8 points.
  • Qwen3.5-397B-A17B has the larger context window for long prompts, retrieval packs, or transcript analysis.
  • Qwen3.5-397B-A17B has the lower cheapest tracked output price at $2.34/1M tokens.
  • Local decision data tags Qwen3.5-397B-A17B for Coding, RAG, and Agents.

Monthly cost at traffic

Estimate token spend from the cheapest tracked input and output route or tier on this page.

Lower estimate Qwen3.5-397B-A17B

Grok 4

$1,625

Cheapest tracked route/tier: xAI Console

Qwen3.5-397B-A17B

$897

Cheapest tracked route/tier: OpenRouter

Estimated monthly gap: $728. Batch, cache, alternate speed tiers, and negotiated pricing are excluded from this local estimate.

Switch friction

Grok 4 -> Qwen3.5-397B-A17B
  • Provider overlap exists on OpenRouter; start route-level A/B tests there.
  • Qwen3.5-397B-A17B is $0.16/1M tokens lower on cheapest tracked output pricing before cache, batch, or negotiated discounts.
  • Check replacement coverage for Code execution before moving production traffic.
Qwen3.5-397B-A17B -> Grok 4
  • Provider overlap exists on OpenRouter; start route-level A/B tests there.
  • Grok 4 is $0.16/1M tokens higher on cheapest tracked output pricing, so quality gains need to justify the spend.
  • Grok 4 adds Code execution in local capability data.

Specs

Specification
Released2025-07-092026-02-16
Context window256k262k
Parameters397B
Architecturedecoder onlyMoE
LicenseProprietaryApache 2.0(OSI)
OpennessProprietaryOpen source
Commercial useCommercial use with conditionsCommercial use allowed
Knowledge cutoff--

Pricing and availability

Pricing attributeGrok 4Qwen3.5-397B-A17B
Input price$1.25/1M tokens$0.39/1M tokens
Output price$2.50/1M tokens$2.34/1M tokens
Providers

Capabilities

CapabilityGrok 4Qwen3.5-397B-A17B
VisionYesYes
MultimodalYesYes
ReasoningYesYes
Function callingYesYes
Tool useYesYes
Structured outputsYesYes
Code executionYesNo
IDE integrationNoNo
Computer useNoNo
Parallel agentsNoNo

Benchmarks

BenchmarkGrok 4Qwen3.5-397B-A17B
MMLU PRO87.087.8
SWE-bench Verified76.776.2
τ-bench78.986.7

Deep dive

On shared benchmark coverage, MMLU PRO has Grok 4 at 87 and Qwen3.5-397B-A17B at 87.8, with Qwen3.5-397B-A17B ahead by 0.8 points; SWE-bench Verified has Grok 4 at 76.7 and Qwen3.5-397B-A17B at 76.2, with Grok 4 ahead by 0.5 points; τ-bench has Grok 4 at 78.9 and Qwen3.5-397B-A17B at 86.7, with Qwen3.5-397B-A17B ahead by 7.8 points. The largest visible gap is 7.8 points on τ-bench, which matters most when that benchmark mirrors your workload. Treat isolated benchmark wins as directional, because provider routing, prompt style, and tool access can move real application results.

The capability footprint differs most on code execution: Grok 4. Both models share vision, multimodal input, reasoning mode, and function calling, so the practical split is not just feature count. Use those differences to decide whether the page is about raw model quality, agentic coding support, multimodal ingestion, or predictable structured API behavior.

For cost, Grok 4 lists $1.25/1M input and $2.50/1M output tokens on the cheapest tracked provider, while Qwen3.5-397B-A17B lists $0.39/1M input and $2.34/1M output tokens on the cheapest tracked provider. A 70/30 input-output blend puts Qwen3.5-397B-A17B lower by about $0.65 per million blended tokens. Availability is 4 providers versus 4, so concentration risk also matters.

Choose Grok 4 when coding workflow support are central to the workload. Choose Qwen3.5-397B-A17B when long-context analysis, larger context windows, and lower input-token cost are more important. For production, rerun your own prompts through the exact provider, region, and tool stack you plan to ship.

FAQ

Which has a larger context window, Grok 4 or Qwen3.5-397B-A17B?

Qwen3.5-397B-A17B supports 262k tokens, while Grok 4 supports 256k tokens. That gap matters most for long documents, large codebases, retrieval-heavy agents, and conversations where earlier context must remain visible. Use this as a quick comparison signal, then confirm the provider-specific limits before committing to production.

Which is cheaper, Grok 4 or Qwen3.5-397B-A17B?

Qwen3.5-397B-A17B is cheaper on tracked token pricing. Grok 4 costs $1.25/1M input and $2.50/1M output tokens. Qwen3.5-397B-A17B costs $0.39/1M input and $2.34/1M output tokens. Provider discounts or batch pricing can still change the final bill.

Is Grok 4 or Qwen3.5-397B-A17B open source?

Grok 4 is listed under Proprietary. Qwen3.5-397B-A17B is listed under Apache 2.0. License labels affect whether you can self-host, redistribute weights, or rely only on hosted APIs, so confirm the upstream license before deployment.

Which is better for vision, Grok 4 or Qwen3.5-397B-A17B?

Both Grok 4 and Qwen3.5-397B-A17B expose vision. The better choice depends on benchmark fit, context budget, pricing, and whether your provider route exposes the same capability surface. Use this as a quick comparison signal, then confirm the provider-specific limits before committing to production.

Which is better for multimodal input, Grok 4 or Qwen3.5-397B-A17B?

Both Grok 4 and Qwen3.5-397B-A17B expose multimodal input. The better choice depends on benchmark fit, context budget, pricing, and whether your provider route exposes the same capability surface. Use this as a quick comparison signal, then confirm the provider-specific limits before committing to production.

Where can I run Grok 4 and Qwen3.5-397B-A17B?

Grok 4 is available on Microsoft Foundry, OpenRouter, Replicate API, and xAI Console. Qwen3.5-397B-A17B is available on OpenRouter, Together AI, Alibaba Cloud PAI-EAS, and Novita AI. Provider coverage can affect latency, region availability, compliance posture, and fallback options.

Continue comparing

Last reviewed: 2026-06-04. Data sourced from public model cards and provider documentation.