BabyVision w/ tools
Visual reasoning benchmark evaluated with tool access. DeepSeek V4.1 Flash launch materials use the Claude Code harness with a 512k-token context window.
Models ranked
5
tracked on this benchmark
Score band
95.4 – 80.2
best → lowest tracked
Snapshot trend
+2.90
Oct 17 → Oct 23 · 1 models
Leaderboard
Tracked models ranked by Pass@1 (higher is better).
Notes: Moonshot self-reported launch table, row 'BabyVision w/ python', column 'Kimi K3.1 Pro (max)'. Settings: reasoning effort max, temperature 1.0, top-p 0.95 (blog footnote).
Configuration: MiniMax M3.1 Flash
Notes: MiniMax M3.1 Flash launch blog (2026-10-19) main benchmark table image m31-flash-en-2 (webp converted to png; values transcribed by eye from table) incl. footnotes. Retrieved 2026-10-19.
Notes: Meta HF model card Benchmarks table, xhigh reasoning effort.
How to read this benchmark
This benchmark scores models where higher is better. Use scores for directional filtering and shortlisting, not universal quality ranking; then validate pricing, context window, provider availability, and fit for your workload.
Trust this score when
- There is a fresh timestamped snapshot (or multiple snapshots) for this benchmark.
- The model list covers the same version family you can actually deploy today.
- Top candidates overlap with your required routing and feature requirements.
Be cautious when
- There is only one benchmark snapshot or the dataset appears stale.
- The benchmark metric direction is opposite of your decision objective.
- The score difference between options is narrow and likely within implementation variance.
Related benchmarks
Last reviewed: Sep 10, 2026