Falcon-H1 release blogpost · inference-research

Fields

id

sources/hf-eco-falcon-h1-blog

URL

https://falcon-lm.github.io/blog/falcon-h1/

Publisher

TII Falcon Team

Kind

blog

Published

2025-05-20

Accessed

2026-10-03

notes

States the hybrid design: attention and Mamba-2 heads combined in parallel within the same hybrid mixer block, with the attention/SSM ratio adjustable per size. Source for the architecture classification.

Notes

States the hybrid design: attention and Mamba-2 heads combined in parallel within the same hybrid mixer block, with the attention/SSM ratio adjustable per size. Source for the architecture classification.

Cross-references

This record references no other records.