All comparisons
HumanEval 90.1 96.7 LiveCodeBench 76.2 79.1 Aider Polyglot 55.1 81.3 Chatbot Arena 1320.0 1412.0 Massive Multi-discipline Multimodal Understanding 79.7 82.9 BFCL 56.2 — MMLU PRO 80.9 — SWE-bench Verified — 71.7 Google-Proof Q&A — 87.7
Gemini 2.5 Flash vs o3
Side-by-side comparison of specifications, capabilities, and pricing.
| Released | 2025-06-17 | 2025-03-31 |
| Context window | 1M | 128K |
| Parameters | — | — |
| Architecture | decoder only | decoder only |
| License | Proprietary | Unknown |
| Knowledge cutoff | 2025-01 | — |
Capabilities | ||
| Vision | ||
| Multimodal | ||
| Reasoning | ||
| Function calling | ||
| Tool use | ||
| Structured Outputs | ||
| Code execution | ||
Availability | ||
| Providers | ||
Benchmarks