Resumen

BESTARD COLUMBIE, Ana Beatriz; CRUZ MORETE, Daniela Elizabeth; SOLER JAY, Lianet  y  LOPEZ RAMOS, Dionis. MAMBA: SSM model as alternative to the transformers. Enfoque UTE [online]. 2026, vol.17, n.2, pp.8-17. ISSN 1390-6542.  https://doi.org/10.29019/enfoqueute.1204.

Mamba is a recent State Space Model (SSM) architecture to improve the computational and scalability limitations of transformer-based sequence models. In this review, we synthesize and compare Mamba’s core design—interleaved SSM and feed-forward layers with hardware-aware memory management—to standard Transformers, highlighting its linear complexity and ability to process extremely long contexts. We analyze published benchmarks showing that Mamba outperforms or matches open-source baselines (e.g. Pythia, RWKV) of similar and even twice the size on zero-shot tasks, scales more efficiently on genomic sequences (processing >1 M tokens with only 74 K parameters), and supports variants such as Jamba (MoE extension), Falcon Mamba 7B, Mamba-2 (Structured SSM), and Mamba-4 with further speed or capacity gains. We discuss adaptations to vision (VIM) and dependency parsing (DepMamba), and emerging hybrids (e.g. Bamba, IBM Granite) that fuse SSM efficiency with Transformer accuracy. Finally, we interpret these findings in the context of real-world constraints—compute cost, energy, and tooling maturity—outlining where Mamba excels, and hybrid models may be preferable, and which areas require further optimization. Our conclusions suggest that Mamba and its derivatives offer a viable path toward more sustainable, scalable sequence modeling.

Palabras clave : language models; hybrid architectures; mamba; state space models; scalability.

        · resumen en Español     · texto en Inglés     · Inglés ( pdf )