LLMReference — Data Quality Dashboard

Pulse summarizes weekly release velocity, freshness, cadence, and current frontier pricing. Changelog is the month-by-month archive; this page covers raw field completeness for maintainers.

Headline Coverage

1,877

Total model rows tracked

Full seed catalog, including embeddings and deprecated rows

1,746

Active public models

1,746 non-deprecated language-model rows shown by default on /models

1,840

Public models incl. deprecated

94 deprecated public rows remain available behind the toggle

1,783

Active tracked rows

1,783 non-deprecated rows in the full seed, including embeddings

Models added this month

Released in June 2026

1,220

Open-weights models

Self-hostable or open-license rows

140

API providers covered

Provider catalogs and routes

247

Labs and creators

Research labs, companies, and builders

135

Benchmarks covered

Evaluation sources in the seed data

Active public models Include deprecated

Database Totals

1,746

Active public models

523

Families

140

Providers

247

Researchers

135

Benchmarks

Concepts

1,852

Provider Links

License-Derived Openness

688

Open source

39% of active public models

486

Open weights

28% of active public models

565

Proprietary

32% of active public models

Unknown

0% of active public models

License coverage	Known	Missing / unknown
Active public models	1,687 (97%)	59 (3%)
Families	473 (90%)	50 (10%)

OSI classification	Count	Share
OSI-approved effective license	688 / 1,746	39%
Non-OSI effective license	999 / 1,746	57%
Missing / unknown effective license	59 / 1,746	3%

Commercial use	Models	Share
Yes	747 / 1,746	43%
Conditional	890 / 1,746	51%
No	50 / 1,746	3%
Unknown / blank	59 / 1,746	3%

Verification backlog	Count	Health
License records marked verify:true	5 / 39	5 (13%)
License records with unknown openness	1 / 39	1 (3%)
License records with unknown commercial use	1 / 39	1 (3%)
Models using verify:true licenses	25 / 1,746	25 (1%)
Models missing/unknown effective license	59 / 1,746	59 (3%)
Families missing/unknown license	50 / 523	50 (10%)

Model rows use the effective license resolver: model license first, then family license. Missing licenses and licenses classified as unknown remain visible as backlog instead of being inferred from legacy strings.

Data Freshness

Entity	Total	Placeholder 2026-01-01	Stale >90d
Active public models	1,746	241 (14%)	241 (14%)
Families	523	137 (26%)	137 (26%)
Providers	140	59 (42%)	59 (42%)
Benchmarks	135	0 (0%)	0 (0%)

Missing or invalid lastResearched dates are counted as stale so research queues do not hide unverified rows.

Benchmark Coverage

Source URL coverage

97%

1,154 / 1,193 scores start with http.

Benchmarks with stale score sets

gaokao: 11 rows, latest 2023-05-20
gaokao-mm: 7 rows, latest 2024-02-23

Metric	Count	Coverage / Health
Active public models with >=1 benchmark score	296 / 1,746	17%
Scores with verified URL source	1,154 / 1,193	97%
Benchmarks with zero scores	64 / 135	53%
Benchmark scores older than 1 year	77 / 1,193	94%
Benchmark scores older than 2 years	18 / 1,193	98%
Benchmarks with all scores older than 2 years	2 / 71	97%

Model Field Completeness

Group	Field	Filled	Coverage
Core	parameters	1,266 / 1,746	73%
Core	context	1,311 / 1,746	75%
Core	knowledge_cutoff	578 / 1,746	33%
Core	description	1,746 / 1,746	100%
Core	release	1,745 / 1,746	100%
Core	familySlug	1,741 / 1,746	100%
Capability	vision	289 / 1,746	17%
Capability	reasoning	165 / 1,746	9%
Capability	function_calling	256 / 1,746	15%
Capability	tool_use	235 / 1,746	13%
Capability	structured_outputs	411 / 1,746	24%
Capability	code_execution	91 / 1,746	5%
Capability	prompt_caching	30 / 1,746	2%
Capability	batch_api	26 / 1,746	1%
Capability	audio	104 / 1,746	6%
Capability	fine_tuning	5 / 1,746	0%
Capability	multimodal	385 / 1,746	22%
Metadata	max_output_tokens	67 / 1,746	4%
Metadata	licenseSlug	398 / 1,746	23%

Capability rows count truthy capability flags; empty, 0, and false mean the capability is not currently recorded as present.

Family and Concept Completeness

Field	Filled	Coverage
family.description	427 / 523	82%
family.researcherSlug	521 / 523	100%
concept.lastResearched	25 / 68	37%

Pricing Coverage

Metric	Count	Coverage / Health
Provider links with pricing	1,435 / 1,677	86%
Excludes non-token-priced rows (per-image, per-second, gpu-hour, etc.).
Models with ≥1 pricing record	718 / 1,746	41%
Provider links with model ID (providerModelId)	761 / 1,852	41%
Non-token links missing all prices	266 / 1,852	86%
Provider links with $0 token price	20 / 1,852	99%

Missing-price rows have no token, image, video, audio, query, or gpu-hour price recorded. $0 token rows may include true free-tier entries and should be reviewed before changing seed data.

Data Quality

Indicator	Count
Duplicate model slugs	0
Duplicate model+provider pairs	0
Models without family	5
Families missing description	96
Concepts missing lastResearched	43
Broken family references (model→family)	0
Broken researcher references (family→researcher)	0
Broken provider references (link→provider)	0
Broken model references (link→model)	0

Provider Link Completeness

Field	Filled	Coverage
docs	89 / 140	64%
pricing	79 / 140	56%
portal	78 / 140	56%
tier	121 / 140	86%
providerType	124 / 140	89%

Provider Coverage (top 25 by model count)

Provider	Models	Priced	Pricing %
Fireworks AI	216	213	99%
OpenRouter	195	191	98%
Vercel AI Gateway	151	143	95%
GCP Vertex AI	106	83	78%
Microsoft Foundry	104	79	76%
Replicate API	99	86	87%
Together AI	99	97	98%
Novita AI	99	99	100%
AWS Bedrock	98	93	95%
DeepInfra	50	47	94%
Alibaba Cloud PAI-EAS	44	22	50%
Google AI Studio	40	18	45%
Cloudflare Workers AI	32	17	53%
IBM watsonx	31	31	100%
OpenAI API	27	27	100%
Bitdeer AI	18	18	100%
Mistral AI Studio	14	12	86%
Anthropic	14	12	86%
Baseten API	13	0	0%
SiliconFlow	13	12	92%
OctoAI API (Deprecated)	12	12	100%
Lepton AI API	12	12	100%
Azure OpenAI	11	5	45%
Databricks Foundation Model Serving	11	5	45%
Baidu Qianfan	10	10	100%

Model Releases by Month

Month	New Models
2026-06	32
2026-05	36
2026-04	62
2026-03	60
2026-02	38
2026-01	32
2025-12	47
2025-11	35
2025-10	31
2025-09	30
2025-08	29
2025-07	15
2025-06	17
2025-05	13
2025-04	44
2025-03	42
2025-02	17
2025-01	80
2024-12	35
2024-11	39
2024-10	43
2024-09	55
2024-08	39
2024-07	51
2024-06	77
2024-05	53
2024-04	58
2024-03	39
2024-02	64
2024-01	81
2023-12	80
2023-11	67
2023-10	45
2023-09	15
2023-08	35
2023-07	37
2023-06	23
2023-05	19
2023-04	28
2023-03	29
2023-02	2
2023-01	13
2022-12	3
2022-11	1
2022-10	12
2022-09	1
2022-07	7
2022-04	2
2022-03	2
2022-02	1
2022-01	1
2021-08	5
2021-05	3
2020-06	5
2020-01	5
2019-11	1
2019-08	4
2019-02	2
2018-10	2
2018-06	1

Generated at build time from seed JSON. Last updated: 2026-06-09.