LLMReference — Data Quality Dashboard

Pulse summarizes weekly release velocity, freshness, cadence, and current frontier pricing. Changelog is the month-by-month archive; this page covers raw field completeness for maintainers.

Headline Coverage

2,046

Total model rows tracked

Full seed catalog, including embeddings and deprecated rows

1,901

Active public models

1,901 non-deprecated language-model rows shown by default on /models

2,005

Public models incl. deprecated

104 deprecated public rows remain available behind the toggle

1,942

Active tracked rows

1,942 non-deprecated rows in the full seed, including embeddings

Models added this month

Released in October 2026

1,317

Open-weights models

Self-hostable or open-license rows

151

API providers covered

Provider catalogs and routes

267

Labs and creators

Research labs, companies, and builders

180

Benchmarks covered

Evaluation sources in the seed data

Active public models Include deprecated

Database Totals

1,901

Active public models

589

Families

151

Providers

267

Researchers

180

Benchmarks

Concepts

2,186

Provider Links

License-Derived Openness

784

Open source

41% of active public models

485

Open weights

26% of active public models

628

Proprietary

33% of active public models

Unknown

0% of active public models

License coverage	Known	Missing / unknown
Active public models	1,878 (99%)	23 (1%)
Families	577 (98%)	12 (2%)

OSI classification	Count	Share
OSI-approved effective license	784 / 1,901	41%
Non-OSI effective license	1,094 / 1,901	58%
Missing / unknown effective license	23 / 1,901	1%

Commercial use	Models	Share
Yes	848 / 1,901	45%
Conditional	968 / 1,901	51%
No	62 / 1,901	3%
Unknown / blank	23 / 1,901	1%

Verification backlog	Count	Health
License records marked verify:true	0 / 45	0 (0%)
License records with unknown openness	1 / 45	1 (2%)
License records with unknown commercial use	1 / 45	1 (2%)
Models using verify:true licenses	0 / 1,901	0 (0%)
Models missing/unknown effective license	23 / 1,901	23 (1%)
Families missing/unknown license	12 / 589	12 (2%)

Model rows use the effective license resolver: model license first, then family license. Missing licenses and licenses classified as unknown remain visible as backlog instead of being inferred from legacy strings.

Data Freshness

Entity	Total	Placeholder 2026-01-01	Stale >90d	Stale >180d
Active public models	1,901	78 (4%)	1,548 (81%)	78 (4%)
Families	589	133 (23%)	496 (84%)	133 (23%)
Providers	151	33 (22%)	129 (85%)	33 (22%)
Benchmarks	180	0 (0%)	157 (87%)	0 (0%)

Missing or invalid lastResearched dates are counted as stale so research queues do not hide unverified rows.

Benchmark Coverage

Source URL coverage

97%

1,472 / 1,511 scores start with http.

Benchmarks with stale score sets

gaokao: 11 rows, latest 2023-05-20
gaokao-mm: 7 rows, latest 2024-02-23

Metric	Count	Coverage / Health
Active public models with >=1 benchmark score	326 / 1,901	17%
Scores with verified URL source	1,472 / 1,511	97%
Benchmarks with zero scores	59 / 180	67%
Benchmark scores older than 1 year	92 / 1,511	94%
Benchmark scores older than 2 years	29 / 1,511	98%
Benchmarks with all scores older than 2 years	2 / 121	98%

Model Field Completeness

Group	Field	Filled	Coverage
Core	parameters	1,338 / 1,901	70%
Core	context	1,421 / 1,901	75%
Core	knowledgeCutoff	594 / 1,901	31%
Core	description	1,901 / 1,901	100%
Core	release	1,877 / 1,901	99%
Core	familySlug	1,901 / 1,901	100%
Capability	vision	375 / 1,901	20%
Capability	reasoning	247 / 1,901	13%
Capability	functionCalling	337 / 1,901	18%
Capability	toolUse	320 / 1,901	17%
Capability	structuredOutputs	467 / 1,901	25%
Capability	codeExecution	101 / 1,901	5%
Capability	promptCaching	81 / 1,901	4%
Capability	batchApi	46 / 1,901	2%
Capability	audio	137 / 1,901	7%
Capability	fineTuning	18 / 1,901	1%
Capability	multimodal	480 / 1,901	25%
Metadata	maxOutputTokens	118 / 1,901	6%
Metadata	licenseSlug	589 / 1,901	31%

Capability rows count truthy capability flags; empty, 0, and false mean the capability is not currently recorded as present.

Family and Concept Completeness

Field	Filled	Coverage
family.description	545 / 589	93%
family.researcherSlug	587 / 589	100%
concept.lastResearched	69 / 69	100%

Pricing Coverage

Metric	Count	Coverage / Health
Provider links with pricing	1,647 / 1,965	84%
Excludes non-token-priced rows (per-image, per-second, gpu-hour, etc.).
Models with ≥1 pricing record	800 / 1,901	42%
Provider links with model ID (providerModelId)	1,329 / 2,186	61%
Non-token links missing all prices	374 / 2,186	83%
Provider links with $0 token price	35 / 2,186	98%

Missing-price rows have no token, image, video, audio, query, or gpu-hour price recorded. $0 token rows may include true free-tier entries and should be reviewed before changing seed data.

Data Quality

Indicator	Count
Duplicate model slugs	0
Duplicate model+provider pairs	0
Models without family	0
Families missing description	44
Concepts missing lastResearched	0
Broken family references (model→family)	0
Broken researcher references (family→researcher)	0
Broken provider references (link→provider)	0
Broken model references (link→model)	0

Provider Link Completeness

Field	Filled	Coverage
docs	105 / 151	70%
pricing	90 / 151	60%
portal	89 / 151	59%
tier	125 / 151	83%
providerType	135 / 151	89%

Provider Coverage (top 25 by model count)

Provider	Models	Priced	Pricing %
OpenRouter	293	289	99%
Fireworks AI	212	208	98%
Vercel AI Gateway	153	143	93%
AWS Bedrock	114	100	88%
GCP Vertex AI	113	87	77%
Microsoft Foundry	110	83	75%
Together AI	100	98	98%
Replicate API	99	86	87%
Novita AI	99	99	100%
DeepInfra	52	49	94%
OpenAI API	50	46	92%
Alibaba Cloud PAI-EAS	49	28	57%
Google AI Studio	46	27	59%
Cloudflare Workers AI	32	17	53%
IBM watsonx	31	31	100%
Featherless	27	27	100%
Volcengine	23	9	39%
Anthropic	21	19	90%
Mistral AI Studio	18	16	89%
Bitdeer AI	18	18	100%
Prodia	16	0	0%
Baseten API	14	1	7%
Zhipu AI GLM API	14	0	0%
Databricks Foundation Model Serving	13	5	38%
SiliconFlow	13	13	100%

Model Releases by Month

Month	New Models
2026-09	64
2026-08	20
2026-07	20
2026-06	51
2026-05	41
2026-04	61
2026-03	59
2026-02	39
2026-01	30
2025-12	50
2025-11	36
2025-10	33
2025-09	29
2025-08	30
2025-07	18
2025-06	18
2025-05	17
2025-04	47
2025-03	42
2025-02	17
2025-01	75
2024-12	35
2024-11	38
2024-10	44
2024-09	56
2024-08	39
2024-07	51
2024-06	77
2024-05	53
2024-04	57
2024-03	36
2024-02	63
2024-01	81
2023-12	80
2023-11	67
2023-10	45
2023-09	15
2023-08	35
2023-07	37
2023-06	23
2023-05	19
2023-04	28
2023-03	29
2023-02	2
2023-01	12
2022-12	3
2022-11	1
2022-10	12
2022-09	1
2022-07	7
2022-04	2
2022-03	2
2022-02	1
2022-01	1
2021-08	5
2021-05	3
2020-06	5
2020-01	5
2019-11	1
2019-08	4
2019-02	2
2018-10	2
2018-06	1

Generated at build time from seed JSON. Last updated: 2026-10-01.