Starling
About
The Starling family of Large Language Models (LLMs) stems from the innovative Berkeley-Nest AI research group. Among its models, Starling-LM-7B-alpha stands out as a 7-billion parameter language model specifically fine-tuned using Reinforcement Learning from AI Feedback (RLAIF). This fine-tuning process harnessed the extensive Nectar dataset, comprising GPT-4-ranked chat prompts and responses. Starling-LM-7B-alpha focuses on enhancing its helpfulness and maintaining a non-harmful approach, evolving from the Openchat 3.5 model. The project also introduced the Starling-RM-7B-alpha reward model, pivotal for RLAIF processes. To foster advancements in RLHF mechanisms and AI safety, the dataset, reward model, and language model are openly accessible. Additionally, a more refined iteration, Starling-LM-7B-beta, has been made available for further research and development.
Specifications(1 models)
| Model | Released | Parameters |
|---|---|---|
| Starling LM 7B Beta | 2024-02 | 7B |
Available From(1 provider)
Frequently Asked Questions
- What is Starling?
- The Starling family of Large Language Models (LLMs) stems from the innovative Berkeley-Nest AI research group. Among its models, Starling-LM-7B-alpha stands out as a 7-billion parameter language model specifically fine-tuned using Reinforcement Learning from AI Feedback (RLAIF). This fine-tuning process harnessed the extensive Nectar dataset, comprising GPT-4-ranked chat prompts and responses. Starling-LM-7B-alpha focuses on enhancing its helpfulness and maintaining a non-harmful approach, evolving from the Openchat 3.5 model. The project also introduced the Starling-RM-7B-alpha reward model, pivotal for RLAIF processes. To foster advancements in RLHF mechanisms and AI safety, the dataset, reward model, and language model are openly accessible. Additionally, a more refined iteration, Starling-LM-7B-beta, has been made available for further research and development.
- How many models are in the Starling family?
- The Starling family contains 1 model.
- What is the latest Starling model?
- The latest model is Starling LM 7B Beta, released in 2024-02.
