inference/research
verifiedhigh · 0.92updated 2026-10-03

Jamba-1.5: Hybrid Transformer-Mamba Models at Scale

paper

Fields

id
sources/arch-jamba-15
URL
https://arxiv.org/abs/2408.12570
Publisher
AI21 Labs (arXiv)
Kind
paper
Published
2024-08-22
Accessed
2026-10-03
notes
Scale-up of Jamba; Jamba-1.5-Large has 94B active parameters, Jamba-1.5-Mini the smaller size.

Notes

Scale-up of Jamba; Jamba-1.5-Large has 94B active parameters, Jamba-1.5-Mini the smaller size.

Cross-references

This record references no other records.