inference/research
verifiedhigh · 0.90updated 2026-10-17

Qwen/Qwen3.8-27B model card

repo

Fields

id
sources/hf-qwen3-8-27b-card
Publisher
Alibaba Qwen
Kind
repo
Published
2026-08-05
Accessed
2026-10-17
notes
Card read 2026-10-17. States 27B dense causal LM with vision encoder, hidden 5120, 64 layers in the pattern 16 x (3 x Gated DeltaNet + 1 x Gated Attention), Gated Attention 24 Q / 4 KV heads at head dim 256 with RoPE dim 64, Gated DeltaNet 48 V heads and 16 QK heads at dim 128, FFN intermediate 17408, vocab 248320, native context 262144. Benchmark table (vendor, Claude Code harness where noted): Terminal Bench 2.1 73.0 vs Qwen3.6-27B 63.4; SWE-bench Pro 61.7 vs Qwen3.6-27B 53.5; GPQA Diamond 89.2 vs Qwen3.6-27B 87.8. Card says the weights are compatible with Hugging Face Transformers, vLLM, SGLang, and TokenSpeed, and links vLLM and SGLang recipes. HF API createdAt 2026-08-05T08:22:59Z, lastModified 2026-08-14; safetensors total 27,781,427,952 BF16. Benchmark numbers are vendor claims.

Notes

Card read 2026-10-17. States 27B dense causal LM with vision encoder, hidden 5120, 64 layers in the pattern 16 x (3 x Gated DeltaNet + 1 x Gated Attention), Gated Attention 24 Q / 4 KV heads at head dim 256 with RoPE dim 64, Gated DeltaNet 48 V heads and 16 QK heads at dim 128, FFN intermediate 17408, vocab 248320, native context 262144. Benchmark table (vendor, Claude Code harness where noted): Terminal Bench 2.1 73.0 vs Qwen3.6-27B 63.4; SWE-bench Pro 61.7 vs Qwen3.6-27B 53.5; GPQA Diamond 89.2 vs Qwen3.6-27B 87.8. Card says the weights are compatible with Hugging Face Transformers, vLLM, SGLang, and TokenSpeed, and links vLLM and SGLang recipes. HF API createdAt 2026-08-05T08:22:59Z, lastModified 2026-08-14; safetensors total 27,781,427,952 BF16. Benchmark numbers are vendor claims.

Cross-references

This record references no other records.