lmsys/vicuna-33b-v1.3 config.json
repo
Fields
id
sources/hf-config-vicuna-33b-v1-3Publisher
LMSYS / Hugging Face
Kind
repo
Accessed
2026-10-18
notes
LlamaForCausalLM config read 2026-10-18. hidden_size 6656, num_hidden_layers 60, num_attention_heads 52, max_position_embeddings 2048, torch_dtype float16, vocab_size 32000. No num_key_value_heads key, so this is MHA: 52 KV heads, head_dim 6656/52 = 128. Used only to derive the KV bytes behind the SGLang RadixAttention hit-rate record.
Notes
LlamaForCausalLM config read 2026-10-18. hidden_size 6656, num_hidden_layers 60, num_attention_heads 52, max_position_embeddings 2048, torch_dtype float16, vocab_size 32000. No num_key_value_heads key, so this is MHA: 52 KV heads, head_dim 6656/52 = 128. Used only to derive the KV bytes behind the SGLang RadixAttention hit-rate record.
Cross-references
This record references no other records.