Solar Open 2 config.json
repo
Fields
id
sources/solar-open2-250b-config-jsonPublisher
Upstage
Kind
repo
Published
2026-07-22
Accessed
2026-10-18
notes
config.json fetched 2026-10-18. model_type solar_open2. hidden 4096, 48 layers, 64 query heads, 8 kv heads, head_dim 128, gqa_layers the 12 softmax positions at interval 3, linear_attn_config num_heads 64 head_dim 128, use_rope false, n_routed_experts 320, num_experts_per_tok 8, n_shared_experts 1, moe_intermediate_size 1280, first_k_dense_replace 0, max_position_embeddings 1048576, vocab 196608. No activation field.
Notes
config.json fetched 2026-10-18. model_type solar_open2. hidden 4096, 48 layers, 64 query heads, 8 kv heads, head_dim 128, gqa_layers the 12 softmax positions at interval 3, linear_attn_config num_heads 64 head_dim 128, use_rope false, n_routed_experts 320, num_experts_per_tok 8, n_shared_experts 1, moe_intermediate_size 1280, first_k_dense_replace 0, max_position_embeddings 1048576, vocab 196608. No activation field.
Cross-references
This record references no other records.