inference/research
verifiedhigh · 0.90updated 2026-10-03

Mixtral of Experts

paper

Fields

id
sources/model-fr-arxiv-mixtral-8x7b
URL
https://arxiv.org/abs/2401.04088
Publisher
Mistral AI
Kind
paper
Published
2024-01-08
Accessed
2026-10-03
notes
States 47B total parameters with 13B active, 8 experts per layer with 2 routed per token, trained at 32k context, Apache 2.0.

Notes

States 47B total parameters with 13B active, 8 experts per layer with 2 routed per token, trained at 32k context, Apache 2.0.

Cross-references

This record references no other records.