inference/research
verifiedhigh · 0.90updated 2026-10-03

gemma-4-12B-it config.json

repo

Fields

id
sources/model-fr-hf-config-gemma-4-12b
Publisher
Hugging Face (Google)
Kind
repo
Published
2026-05-23
Accessed
2026-10-03
notes
model_type gemma4_unified. text_config: hidden 3840, 48 layers, 16 q heads, 8 kv heads, head_dim 256, global_head_dim 512, num_global_key_value_heads 1, sliding_window 1024, 8 full_attention layers, 262144 context. Separate gemma4_unified_vision and gemma4_unified_audio towers. | SOURCE AUDIT 2026-10-03: kind was 'spec-sheet' but the URL is a raw Hugging Face config.json served as text/plain, not a vendor spec sheet; set to 'repo'. The schema field it fills (layer/window/head counts) is machine-readable model metadata and should be read as such.

Notes

model_type gemma4_unified. text_config: hidden 3840, 48 layers, 16 q heads, 8 kv heads, head_dim 256, global_head_dim 512, num_global_key_value_heads 1, sliding_window 1024, 8 full_attention layers, 262144 context. Separate gemma4_unified_vision and gemma4_unified_audio towers. | SOURCE AUDIT 2026-10-03: kind was 'spec-sheet' but the URL is a raw Hugging Face config.json served as text/plain, not a vendor spec sheet; set to 'repo'. The schema field it fills (layer/window/head counts) is machine-readable model metadata and should be read as such.

Cross-references

This record references no other records.