Snorkel Models by Snorkel AI
About
The Snorkel AI team is noted for its innovative approach to developing large language models (LLMs) that are specifically aligned to cater to niche requirements and enhance performance on targeted tasks. Their unique method leverages smaller, specialized reward models to guide alignment, moving beyond the conventional reliance on extensive datasets. A prominent example is the Snorkel-Mistral-PairRM-DPO model, which refines the Mistral-7B-Instruct-v0.2 model through iterative Direct Preference Optimization (DPO) alongside a Pairwise Reward Model (PairRM) 2. This advanced refinement process involves generating multiple prompt responses, reranking with PairRM, followed by further honing with DPO based on evaluative rankings 2. The outcomes showcase enhanced performance metrics on benchmarks like AlpacaEval 2.0 2. Snorkel AI's broader strategies emphasize a data-centric paradigm, focusing on optimized data labeling and annotation to boost model accuracy while minimizing training expenses 3. They equip enterprises with tools such as Snorkel Flow and Snorkel Custom to streamline data operations 3. Further details about the comprehensive range of Snorkel LLMs suggest a commitment to developing custom-fit models with improved training and operational efficiency.
Current Variants
Use-when guidance is derived from seed capabilities, context, release, and replacement fields.
Use when the workload needs 32k context and 7B parameters.
| Model | Use when | Released | Signals | Status |
|---|---|---|---|---|
| Snorkel Mistral PairRM | Use when the workload needs 32k context and 7B parameters. | 2023-11 | 32k context7B parameters | Current |
Release Timeline
1 release groupSpecifications(1 models)
| Model | Released | Context | Parameters |
|---|---|---|---|
| Snorkel Mistral PairRM | 2023-11 | 32k | 7B |
Available From(2 providers)
Pricing
| Model | Provider | Input / 1M | Output / 1M | Type |
|---|---|---|---|---|
| Snorkel Mistral PairRM | Together AI | $0.2 | $0.2 | Serverless |
| Snorkel Mistral PairRM | Fireworks AI | $0.2 | $0.2 | Provisioned |
Frequently Asked Questions
- What is Snorkel used for?
- The Snorkel AI team is noted for its innovative approach to developing large language models (LLMs) that are specifically aligned to cater to niche requirements and enhance performance on targeted tasks.
- How does Snorkel compare to Claude 3?
- Snorkel by Snorkel AI is strongest where you need its listed use cases, while Claude 3 by Anthropic is the closest related family to check for vision and multimodal work. Snorkel has 1 listed variant and reaches up to 32k context, while Claude 3 reaches up to 200k context, so compare the specs and pricing tables before choosing a production model.
- Which Snorkel model should I use?
- For the lowest listed input price, start with Snorkel Mistral PairRM through Fireworks AI at $0.2/1M input tokens. For the most capable/latest local choice, evaluate Snorkel Mistral PairRM with 32k context.