inference/research
verifiedhigh · 0.90updated 2026-10-18

Solar Open 2 config.json

repo

Fields

id
sources/solar-open2-250b-config-json
Publisher
Upstage
Kind
repo
Published
2026-07-22
Accessed
2026-10-18
notes
config.json fetched 2026-10-18. model_type solar_open2. hidden 4096, 48 layers, 64 query heads, 8 kv heads, head_dim 128, gqa_layers the 12 softmax positions at interval 3, linear_attn_config num_heads 64 head_dim 128, use_rope false, n_routed_experts 320, num_experts_per_tok 8, n_shared_experts 1, moe_intermediate_size 1280, first_k_dense_replace 0, max_position_embeddings 1048576, vocab 196608. No activation field.

Notes

config.json fetched 2026-10-18. model_type solar_open2. hidden 4096, 48 layers, 64 query heads, 8 kv heads, head_dim 128, gqa_layers the 12 softmax positions at interval 3, linear_attn_config num_heads 64 head_dim 128, use_rope false, n_routed_experts 320, num_experts_per_tok 8, n_shared_experts 1, moe_intermediate_size 1280, first_k_dense_replace 0, max_position_embeddings 1048576, vocab 196608. No activation field.

Cross-references

This record references no other records.