gemma-4-31B-it config.json (text_config)

gemma4. text_config: num_hidden_layers 60, hidden_size 5376, num_attention_heads 32, num_key_value_heads 16, head_dim 256, global_head_dim 512, num_global_key_value_heads 4, sliding_window 1024. layer_types over 60 layers = 50 sliding_attention + 10 full_attention. enable_moe_block FALSE, num_experts null -> dense. rope_parameters full_attention proportional theta 1e6 / sliding_attention default theta 1e4. max_position_embeddings 262144. Read raw 2026-10-04.