A showcase of the Falcon-H1 architecture, which combines parallel Mamba and Attention heads in the mixer block.
Powered by Transformers.js v4 (preview)