LLM Reference

airoboros L2 70B 2.2.1 on DeepInfra

airoboros · Jon Durbin

Serverless

Pricing

TypePrice (per 1M)
Input tokens$0.45
Output tokens$0.65

Capabilities

VisionMultimodalReasoningFunction CallingTool UseJSON ModeCode Execution

About airoboros L2 70B 2.2.1

The Airoboros L2 70B 2.2.1, built on the Llama 2 architecture, is a large language model optimized for instruction following rather than casual conversation. With 70 billion parameters, it excels in tasks like instruction following, question answering, summarization, and coding. The model employs a unique prompting format, A chat.\nUSER: {prompt}\nASSISTANT:, and benefits from using explicit delimiters to reduce hallucinations in closed-context instructions. A limitation is that Q4_0 quantization yields unusable outputs. Additionally, the model uses a substantial amount of synthetic data generated by the Airoboros tool, and its licensing remains ambiguous, potentially restricting commercial use due to OpenAI's GPT-4 API involvement in data generation.

Get Started

Model Specs

Released2023-07-15
Parameters70B
ArchitectureDecoder Only