config.json, unsloth/Llama-4-Scout-17B-16E-Instruct (Llama-4 community mirror)
repo
Fields
id
sources/arch-hf-config-llama4-scoutPublisher
Hugging Face
Kind
repo
Accessed
2026-10-03
notes
48 layers, hidden 5120, intermediate 8192, num_attention_heads 40, num_key_value_heads 8, head_dim 128, num_experts_per_tok 1, max_position_embeddings 10485760. NOTE: the gated meta-llama repo could not be read; this mirror was used instead. The config exposes NO sliding-window field, so any claim about a Llama-4 local window size is unverified here. | SOURCE AUDIT 2026-10-03: the 'publisher' field held a paragraph of prose (authors + affiliations, 74 chars) instead of a publisher name; trimmed to 'Hugging Face' with the authorship detail moved here.
Notes
48 layers, hidden 5120, intermediate 8192, num_attention_heads 40, num_key_value_heads 8, head_dim 128, num_experts_per_tok 1, max_position_embeddings 10485760. NOTE: the gated meta-llama repo could not be read; this mirror was used instead. The config exposes NO sliding-window field, so any claim about a Llama-4 local window size is unverified here. | SOURCE AUDIT 2026-10-03: the 'publisher' field held a paragraph of prose (authors + affiliations, 74 chars) instead of a publisher name; trimmed to 'Hugging Face' with the authorship detail moved here.
Cross-references
This record references no other records.