allenai/OLMo-3-7B-Instruct config.json

Unsloth/meta repo was gated; allenai/OLMo-3-7B-Instruct is the public release. num_hidden_layers 32, hidden_size 4096, num_attention_heads 32, num_key_value_heads 32, sliding_window 4096, max_position_embeddings 65536, rope_scaling {"type":"yarn","factor":8,"original_max_position_embeddings":8192,"beta_fast":32,"beta_slow":1,"attention_factor":1.2079441541679836}. layer_types alternating 3 sliding_attention : 1 full_attention. Read raw 2026-10-04.