inference/research
verifiedhigh · 0.90updated 2026-10-18

Qwen3.5-9B config.json (text_config, official repo)

repo

Fields

id
sources/hf-config-qwen3-5-9b
Publisher
Hugging Face
Kind
repo
Accessed
2026-10-18
notes
Read raw from the official Qwen/Qwen3.5-9B repo on 2026-10-18. text_config: num_hidden_layers 32, full_attention_interval 4, layer_types is 24 linear_attention plus 8 full_attention (every 4th layer), num_attention_heads 16, num_key_value_heads 4, head_dim 256, max_position_embeddings 262144, dtype bfloat16. Linear-attention state: linear_num_key_heads 16, linear_num_value_heads 32, linear_key_head_dim 128, linear_value_head_dim 128, linear_conv_kernel_dim 4. The file is the vendors own config, not a mirror.

Notes

Read raw from the official Qwen/Qwen3.5-9B repo on 2026-10-18. text_config: num_hidden_layers 32, full_attention_interval 4, layer_types is 24 linear_attention plus 8 full_attention (every 4th layer), num_attention_heads 16, num_key_value_heads 4, head_dim 256, max_position_embeddings 262144, dtype bfloat16. Linear-attention state: linear_num_key_heads 16, linear_num_value_heads 32, linear_key_head_dim 128, linear_value_head_dim 128, linear_conv_kernel_dim 4. The file is the vendors own config, not a mirror.

Cross-references

This record references no other records.