LLM Reference
LMSYS Org

LMSYS Org

8 models across 1 family · Latest: Vicuna 13B 16K (2023-10)

Crowdsourced AI model benchmarking

ClassificationJSON / Tool useNon-Profit

LMSYS Org's portfolio covers 8 active models across 1 current family, spanning classification and json / tool use. Open a model detail page to compare provider routes and sourced benchmarks.

Covers 2 workload areas across 8 active tracked models; last verified 2026-04-19.

Use it for

  • Teams evaluating classification and json / tool use across this lab's releases
  • Comparing model families before committing to a flagship
  • Migration and pricing follow-ups across 8 tracked models

Do not use it for

  • Choosing a hosting provider without opening a model page for price ladders

Active models

8

Current models from this lab, excluding deprecated ones

Active families

1

Current model families from this lab

Open catalog

8 open

0 open source / 8 open weights

Lowest output price

$0.200 /1M

Cheapest tracked output across active models, per 1M tokens

Latest dated release

2023-10-23

Vicuna 13B 16K

Freshness

2026-04-19

Researched 135d ago

stale

Information

Founded2023
Berkeley, California, United States

Release cadence

Dated releases
5
Latest model
Vicuna 13B 16K
Latest date
2023-10-23

Where this lab wins

  • Classification: 6 tracked models with MMLU-class moderation/safety coverage.
  • JSON/tool-use: 6 tracked models with BFCL / Nexus strict-JSON routing coverage.

Flagship quality / price signal

Selection source
Best sourced coding Q/$
Coding grade
unknown
Benchmark / output price
Not enough sourced benchmark and price coverage

About

LMSYS Org, an open research initiative based in Berkeley, California, is pioneering the democratization of large model technologies. Established through a collaboration among students and faculty from prestigious institutions such as UC Berkeley, Stanford, UCSD, and CMU, the organization focuses on making advanced tools in artificial intelligence accessible and scalable to all. Their efforts span both machine learning and systems research, emphasizing the training of large language models (LLMs) and the advancement of distributed systems to optimize training and inference processes.

Featured models

ModelReleasedContextInput price ($/1M)Output price ($/1M)LicenseOpenness
Vicuna 13B 16K2023-10-2316k--Llama 2 CommunityOpen weights
Vicuna 13B2023-10-232k$0.10$0.50Llama 2 CommunityOpen weights
Vicuna 7B 16K2023-10-2316k--Llama 2 CommunityOpen weights

Model families

Recent releases

  1. Vicuna 13B 16K- 2023-10-23
  2. Vicuna 13B- 2023-10-23
  3. Vicuna 7B 16K- 2023-10-23
  4. Vicuna 7B- 2023-10-23
  5. Vicuna 13B V1.5 16K- 2023-10-23

Explore related pages

Last reviewed: 2026-04-19. Data sourced from public lab announcements and provider documentation.