inference/research
verifiedhigh · 0.90updated 2026-10-04

DeepSeek-R1-Distill-Qwen-7B config.json

repo

Fields

id
sources/mbl-cfg-r1-distill-qwen-7b
URL
https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B/raw/main/config.json
Publisher
Hugging Face
Kind
repo
Accessed
2026-10-04
notes
num_hidden_layers 28, hidden_size 3584, num_attention_heads 28, num_key_value_heads 4, rope_theta 1000000, max_position_embeddings 131072, rope_scaling null. Read raw 2026-10-04.

Notes

num_hidden_layers 28, hidden_size 3584, num_attention_heads 28, num_key_value_heads 4, rope_theta 1000000, max_position_embeddings 131072, rope_scaling null. Read raw 2026-10-04.

Cross-references

This record references no other records.