Cambrian Models by New York University
About
The Cambrian family of LLMs is a set of multimodal large language models (MLLMs) focused on enhancing visual understanding. Unlike typical MLLMs that emphasize language abilities, Cambrian models prioritize sensory grounding through visual perception, facilitating their application in real-world scenarios. These models are characterized by five foundational elements: diverse visual representations via various vision encoders, a unique Spatial Vision Aggregator (SVA) that integrates visual and language features efficiently, high-quality visual instruction-tuning data, innovative instruction tuning methodologies, and a dedicated vision-centric benchmark known as CV-Bench. Available in parameter sizes of 8B, 13B, and 34B, Cambrian models are open-source, offering comprehensive resources such as model weights, code, datasets, and detailed training instructions. They achieve state-of-the-art results on numerous benchmarks aimed at visual understanding, illustrating their robust performance in the field 12.
Current Variants
Use-when guidance is derived from seed capabilities, context, release, and replacement fields.
Use when the workload needs 8k context and 8B parameters.
Use when the workload needs 8k context and 13B parameters.
Use when the workload needs 8k context and 34B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| Cambrian-1 8B | Use when the workload needs 8k context and 8B parameters. | 2024-06 | 8k context8B parameters | Current |
| Cambrian-1 13B | Use when the workload needs 8k context and 13B parameters. | 2024-06 | 8k context13B parameters | Current |
| Cambrian-1 34B | Use when the workload needs 8k context and 34B parameters. | 2024-06 | 8k context34B parameters | Current |
Release Timeline
1 release groupSpecifications(3 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Cambrian-1 8B | 2024-06 | 8k | 8B |
| Cambrian-1 13B | 2024-06 | 8k | 13B |
| Cambrian-1 34B | 2024-06 | 8k | 34B |
Frequently Asked Questions
- What is Cambrian used for?
- Cambrian is used for coding. The family description and listed model capabilities point to those workloads as the best fit.
- How does Cambrian compare to Claude 3?
- Cambrian by New York University is strongest where you need coding, while Claude 3 by Anthropic is the closest related family to check for vision and multimodal work. Cambrian has 3 listed variants and reaches up to 8k context, while Claude 3 reaches up to 200k context, so compare the specs and pricing tables before choosing a production model.
- Which Cambrian model should I use?
- If price is the main constraint, use the pricing table first because Cambrian does not have complete provider pricing in the local data. For the most capable/latest local choice, evaluate Cambrian-1 8B with 8k context.