LLM Reference

Grok 4 vs Step 3.5 Flash

Grok 4 (2025) and Step 3.5 Flash (2026) are frontier-tier reasoning models from xAI and StepFun. Grok 4 ships a 256k-token context window, while Step 3.5 Flash ships a 256k-token context window. On SWE-bench Verified, Grok 4 leads by 2.3 pts. On pricing, Step 3.5 Flash costs $0.10/1M input tokens versus $1.25/1M for the alternative. This comparison covers specs, pricing, API access, capabilities, benchmarks, input and output token costs, and production fit for coding and agent workloads.

Step 3.5 Flash is ~1150% cheaper at $0.10/1M; pay for Grok 4 only for coding workflow support.

Decision scorecard

Local evidence first
SignalGrok 4Step 3.5 Flash
Best forreasoning-heavy apps, multimodal apps, and tool-calling agentsreasoning-heavy apps
Decision fitCoding, RAG, and AgentsCoding, Agents, and Long context
Context window256k256k
Cheapest output$2.50/1M tokens$0.30/1M tokens
Provider routes4 tracked1 tracked
Shared benchmarksSWE-bench Verified leader3 shared

Decision tradeoffs

Choose Grok 4 when...
  • Grok 4 holds a shared-benchmark lead on SWE-bench Verified, ahead by 2.3 points.
  • Grok 4 has broader tracked provider coverage for fallback and route flexibility.
  • Grok 4 uniquely exposes Vision, Multimodal, and JSON / Tool use in local model data.
  • Local decision data tags Grok 4 for Coding, RAG, and Agents.
Choose Step 3.5 Flash when...
  • Step 3.5 Flash holds a shared-benchmark lead on AIME 2025, ahead by 5.6 points.
  • Step 3.5 Flash has the lower cheapest tracked output price at $0.30/1M tokens.
  • Local decision data tags Step 3.5 Flash for Coding, Agents, and Long context.

Monthly cost at traffic

Estimate token spend from the cheapest tracked input and output route or tier on this page.

Lower estimate Step 3.5 Flash

Grok 4

$1,625

Cheapest tracked route/tier: xAI Console

Step 3.5 Flash

$155

Cheapest tracked route/tier: OpenRouter

Estimated monthly gap: $1,470. Batch, cache, alternate speed tiers, and negotiated pricing are excluded from this local estimate.

Switch friction

Grok 4 -> Step 3.5 Flash
  • Provider overlap exists on OpenRouter; start route-level A/B tests there.
  • Step 3.5 Flash is $2.20/1M tokens lower on cheapest tracked output pricing before cache, batch, or negotiated discounts.
  • Check replacement coverage for Vision, Multimodal, and JSON / Tool use before moving production traffic.
Step 3.5 Flash -> Grok 4
  • Provider overlap exists on OpenRouter; start route-level A/B tests there.
  • Grok 4 is $2.20/1M tokens higher on cheapest tracked output pricing, so quality gains need to justify the spend.
  • Grok 4 adds Vision, Multimodal, and JSON / Tool use in local capability data.

Specs

Specification
Released2025-07-092026-01-29
Context window256k256k
Parameters196B (11B active)
ArchitectureDecoder OnlyMixture of Experts
LicenseProprietaryProprietary
OpennessProprietaryProprietary
WeightsNot releasedNot released
CodeUnknownUnknown
Commercial useCommercial use: conditionalCommercial use: conditional
Knowledge cutoff--

Pricing and availability

Pricing attributeGrok 4Step 3.5 Flash
Input price$1.25/1M tokens$0.10/1M tokens
Output price$2.50/1M tokens$0.30/1M tokens
Providers

Capabilities

CapabilityGrok 4Step 3.5 Flash
VisionYesNo
MultimodalYesNo
ReasoningYesYes
JSON / Tool useYesNo
Structured outputsYesNo
Code executionYesNo
IDE integrationNoNo
Computer useNoNo
Parallel agentsNoNo

Benchmarks

BenchmarkGrok 4Step 3.5 Flash
SWE-bench Verified76.774.4
AIME 202591.797.3
LiveCodeBench79.086.4

Continue comparing

Last reviewed: 2026-07-10. Data sourced from public model cards and provider documentation.