Mixtral 8x22B Instruct

Mixtral 8x22B Instruct - Sparse Mixture-of-Experts Instruction-Tuned Model

Mixtral 8x22B Instruct is the instruction fine-tuned version of Mixtral-8x22B-v0.1, a sparse Mixture-of-Experts (SMoE) model by Mistral AI under Apache 2.0. Its defining architectural property is selective parameter activation: only a subset of the model's parameters activate per token during inference, which shapes its throughput characteristics.

Architecture Detail

The SMoE routing mechanism selects which expert sub-networks process each token independently, leaving the remaining experts inactive for that token. This is distinct from dense models where all parameters participate in every forward pass.

Deployment & Status

Both base (Mixtral-8x22B-v0.1) and instruct (Mixtral-8x22B-Instruct-v0.1) checkpoints are available under Apache 2.0. The API endpoint open-mixtral-8x22b has been retired, with Mistral Small 3.2 designated as the official replacement per Mistral's model documentation.