Mamba is a fresh state Room model architecture exhibiting promising performance on info-dense data for instance language modeling, where earlier subquadratic models drop wanting Transformers.
Mamba, like Flash https://k2spiceshop.com/product/liquid-k2-on-paper-online/