ibm-granite/granite-4.0-h-tiny config.json

granitemoehybrid. num_hidden_layers 40, hidden_size 1536, num_attention_heads 12, num_key_value_heads 4, position_embedding_type "nope" (NoPE), rope_theta 10000, rope_scaling null, max_position_embeddings 131072. layer_types = 36 mamba + 4 attention at 0-based indices 5,15,25,35. MoE: num_local_experts 64, num_experts_per_tok 6, shared_intermediate_size 1024 (always-on shared expert). Mamba-2: mamba_d_state 128, mamba_d_head 64, mamba_n_heads 48. Read raw 2026-10-04.