Ministral-8B-Instruct-2410 config.json
repo
Fields
id
sources/model-fr-hf-config-ministral-8bPublisher
Hugging Face (Mistral AI)
Kind
repo
Published
2024-10-16
Accessed
2026-10-03
notes
hidden 4096, 36 layers, 32 q heads, 8 kv heads, head_dim 128, intermediate 12288, sliding_window 32768 equal to max_position_embeddings so the window never binds, rope_theta 1e8, vocab 131072. | SOURCE AUDIT 2026-10-03: kind was 'spec-sheet' but the URL is a raw Hugging Face config.json served as text/plain, not a vendor spec sheet; set to 'repo'. The schema field it fills (layer/window/head counts) is machine-readable model metadata and should be read as such.
Notes
hidden 4096, 36 layers, 32 q heads, 8 kv heads, head_dim 128, intermediate 12288, sliding_window 32768 equal to max_position_embeddings so the window never binds, rope_theta 1e8, vocab 131072. | SOURCE AUDIT 2026-10-03: kind was 'spec-sheet' but the URL is a raw Hugging Face config.json served as text/plain, not a vendor spec sheet; set to 'repo'. The schema field it fills (layer/window/head counts) is machine-readable model metadata and should be read as such.
Cross-references
This record references no other records.