tiiuae/Falcon-H1-7B-Base model repo

Fields

id

sources/hf-eco-falcon-h1-7b-base

URL

https://huggingface.co/tiiuae/Falcon-H1-7B-Base

Publisher

TII / Hugging Face

Kind

repo

Published

2025-05-01

Accessed

2026-10-03

notes

config.json (FalconH1ForCausalLM, 44 layers, 2 KV heads, head_dim 128, max_position_embeddings 262144) plus model.safetensors.index.json, which shows every one of the 44 layers carrying BOTH self_attn (q/k/v/o) and mamba tensors. Safetensors total 7585648736.

Notes

config.json (FalconH1ForCausalLM, 44 layers, 2 KV heads, head_dim 128, max_position_embeddings 262144) plus model.safetensors.index.json, which shows every one of the 44 layers carrying BOTH self_attn (q/k/v/o) and mamba tensors. Safetensors total 7585648736.

Cross-references

This record references no other records.