Mixtral-8x7B-Instruct-v0.1 config.json

Fields

id

sources/model-fr-hf-config-mixtral-8x7b

URL

https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1/raw/main/config.json

Publisher

Hugging Face (Mistral AI)

Kind

repo

Published

2023-12-11

Accessed

2026-10-03

notes

hidden 4096, 32 layers, 32 q heads, 8 kv heads, intermediate 14336, 8 local experts, 2 per token, vocab 32000, max_position_embeddings 32768, no sliding window. | SOURCE AUDIT 2026-10-03: kind was 'spec-sheet' but the URL is a raw Hugging Face config.json served as text/plain, not a vendor spec sheet; set to 'repo'. The schema field it fills (layer/window/head counts) is machine-readable model metadata and should be read as such.

Notes

hidden 4096, 32 layers, 32 q heads, 8 kv heads, intermediate 14336, 8 local experts, 2 per token, vocab 32000, max_position_embeddings 32768, no sliding window. | SOURCE AUDIT 2026-10-03: kind was 'spec-sheet' but the URL is a raw Hugging Face config.json served as text/plain, not a vendor spec sheet; set to 'repo'. The schema field it fills (layer/window/head counts) is machine-readable model metadata and should be read as such.

Cross-references

This record references no other records.