inference/research
verifiedhigh · 0.92updated 2026-10-03

config.json, openai/gpt-oss-20b

repo

Fields

id
sources/arch-hf-config-gpt-oss
URL
https://huggingface.co/openai/gpt-oss-20b/raw/main/config.json
Publisher
Hugging Face
Kind
repo
Accessed
2026-10-03
notes
24 layers with layer_types alternating sliding_attention / full_attention 12 each; sliding_window 128; hidden 2880, num_attention_heads 64, num_key_value_heads 8, head_dim 64, intermediate 2880, num_experts_per_tok 4, max_position_embeddings 131072, vocab 201088.

Notes

24 layers with layer_types alternating sliding_attention / full_attention 12 each; sliding_window 128; hidden 2880, num_attention_heads 64, num_key_value_heads 8, head_dim 64, intermediate 2880, num_experts_per_tok 4, max_position_embeddings 131072, vocab 201088.

Cross-references

This record references no other records.