Using WizardLM-2 8x22B on OctoAI API (Deprecated)
Implementation guide · WizardLM-2 · Dreamgen
Quick Start
- 1Create an account at OctoAI API (Deprecated) and generate an API key.
- 2Use the OctoAI API (Deprecated) SDK or REST API to call
wizardlm-2-8x22b.
Code Examples
About OctoAI API (Deprecated)
No public independent OctoAI API, model catalog, portal, documentation, or pricing surface was verified on the former OctoAI routes checked. Those routes redirect to NVIDIA’s general site; do not treat that site as a successor to the former OctoAI API.
OctoAI was a hosted inference platform for running third-party foundation models. OctoAI’s company profile states that NVIDIA acquired it in September 2024 and that it was dissolved as an independent corporate entity. This entry is retained only as historical provider coverage.
Pricing on OctoAI API (Deprecated)
Capabilities
About WizardLM-2 8x22B
WizardLM-2 8x22B, developed by WizardLM@Microsoft AI, is a powerful large language model (LLM) featuring 141 billion parameters and utilizing a Mixture of Experts (MoE) architecture. It excels in complex tasks such as chat, multilingual conversations, reasoning, and agent-based interactions. Trained with an AI-powered synthetic system incorporating techniques like Evol-Instruct and AI Align AI, the model surpasses many open-source alternatives. Despite its performance on various benchmarks, further research is essential to address potential biases and enhance reliability post "toxicity testing."