LLM Reference

Using WizardLM-2 8x22B on Novita AI

Implementation guide · WizardLM-2 · Dreamgen

Serverless

Quick Start

  1. 1
    Create an account at Novita AI and generate an API key.
  2. 2
    Use the Novita AI SDK or REST API to call wizardlm-2-8x22b.
  3. 3
    You'll be billed $0.62/1M input, $0.62/1M output tokens. See full pricing.
API PortalPricingModel Card

Code Examples

Code examples for this provider have not been sourced yet.

About Novita AI

Novita AI offers a GPU-based inference API for image, video, and language model generation with a broad catalog of open-source models.

View all models on Novita AI →

Pricing on Novita AI

TypePrice (per 1M)
Input tokens$0.62
Output tokens$0.62

Capabilities

Structured Outputs

About WizardLM-2 8x22B

WizardLM-2 8x22B, developed by WizardLM@Microsoft AI, is a powerful large language model (LLM) featuring 141 billion parameters and utilizing a Mixture of Experts (MoE) architecture. It excels in complex tasks such as chat, multilingual conversations, reasoning, and agent-based interactions. Trained with an AI-powered synthetic system incorporating techniques like Evol-Instruct and AI Align AI, the model surpasses many open-source alternatives. Despite its performance on various benchmarks, further research is essential to address potential biases and enhance reliability post "toxicity testing."

Full model details →

Model Specs

Released2024-01-09
Parameters8x22B
ArchitectureMixture of Experts

Also available on(4)

Lepton AI API$0.50/1MOpenRouter$0.62/1MDeepInfra$0.65/1M
Compare all providers →

Provider

Novita AI