What is the context window of Mixtral 8x7B SlimOrca?

Mixtral 8x7B SlimOrca has a context window of 32K tokens.

When was Mixtral 8x7B SlimOrca released?

Mixtral 8x7B SlimOrca was released on 2023-12-11.

Name: Mixtral 8x7B SlimOrca
Author: Alignment Lab AI

Mixtral 8x7B mixture-of-experts tuned with SlimOrca for improved performance.

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

Released2023-12-11

Parameters56B

Context32K

ArchitectureDecoder Only

Knowledge cutoff2023-12

Specializationgeneral

Trainingfinetuning

Human-centered approach to safe AI

N/A

Founded N/A