Jamba: Production-grade Mamba-based AI model

AI21 Labs, has just released Jamba, the world's first production-grade AI model based on the innovative Mamba architecture. Jamba combines the strengths of both the Mamba Structured State Space model and the traditional Transformer architecture, delivering impressive performance and efficiency gains. One of the key advantages of Jamba is its ability to deliver 3x throughput on long contexts compared to Transformer-based models of similar size, like Mixtral 8x7B. This is made possible by the model's unique hybrid architecture, which is composed of Transformer, Mamba, and mixture-of-experts layers, optimizing for memory, throughput, and performance simultaneously. AI21 Labs says this approach allows the model to maximize quality and throughput on a single GPU, leaving ample memory for common inference workloads. The model has already demonstrated remarkable results on various benchmarks, matching or outperforming state-of-the-art models in its size class across a wide range of tasks. For now, Jamba is currently released as a research model without the necessary safeguards for commercial use. As the AI community continues to explore and refine new architectures, we can expect to see even more impressive gains in performance, efficiency, and accessibility, paving the way for a new generation of more capable AI models.