Llama-3.3-70B-Instruct config.json

Fields

id

sources/model-fr-hf-config-llama-3-3-70b

URL

https://huggingface.co/unsloth/Llama-3.3-70B-Instruct/raw/main/config.json

Publisher

Hugging Face (unsloth mirror of Meta weights)

Kind

repo

Published

2024-12-06

Accessed

2026-10-03

notes

hidden 8192, 80 layers, 64 q heads, 8 kv heads, head_dim 128, intermediate 28672, llama3 rope scaling factor 8 from an 8192 base, 131072 context. | SOURCE AUDIT 2026-10-03: kind was 'spec-sheet' but the URL is a raw Hugging Face config.json served as text/plain, not a vendor spec sheet; set to 'repo'. The schema field it fills (layer/window/head counts) is machine-readable model metadata and should be read as such.

Notes

hidden 8192, 80 layers, 64 q heads, 8 kv heads, head_dim 128, intermediate 28672, llama3 rope scaling factor 8 from an 8192 base, 131072 context. | SOURCE AUDIT 2026-10-03: kind was 'spec-sheet' but the URL is a raw Hugging Face config.json served as text/plain, not a vendor spec sheet; set to 'repo'. The schema field it fills (layer/window/head counts) is machine-readable model metadata and should be read as such.

Cross-references

This record references no other records.