inference/research
verifiedmedium · 0.80updated 2026-10-18

gemma-3-4b-it config.json (unsloth mirror of google/gemma-3-4b-it)

repo

Fields

id
sources/hf-config-gemma3-4b-it-unsloth
Publisher
Hugging Face
Kind
repo
Accessed
2026-10-18
notes
google/gemma-3-4b-it config.json is license-gated (HTTP 401). Read raw from the unsloth/gemma-3-4b-it mirror on 2026-10-18. text_config: num_hidden_layers 34, num_attention_heads 8, num_key_value_heads 4, head_dim 256, sliding_window 1024, sliding_window_pattern 6, max_position_embeddings 131072, rope_scaling linear factor 8.0, torch_dtype bfloat16. The file carries unsloth_fixed: true, so it is a mirror rather than Google's own file; the layer count, head counts, window and pattern match the Gemma 3 report's 5:1 design.

Notes

google/gemma-3-4b-it config.json is license-gated (HTTP 401). Read raw from the unsloth/gemma-3-4b-it mirror on 2026-10-18. text_config: num_hidden_layers 34, num_attention_heads 8, num_key_value_heads 4, head_dim 256, sliding_window 1024, sliding_window_pattern 6, max_position_embeddings 131072, rope_scaling linear factor 8.0, torch_dtype bfloat16. The file carries unsloth_fixed: true, so it is a mirror rather than Google's own file; the layer count, head counts, window and pattern match the Gemma 3 report's 5:1 design.

Cross-references

This record references no other records.