JAMBA, the First Powerful Hybrid Model is Here
Toward a Subquadratic Future
Published in
6 min readApr 8, 2024
For almost six years, nothing has beaten the Transformer, the heart of all Generative AI models.
However, due to its excessive costs, many have tried to dethrone it, to no avail.
But we can finally hear the winds of change.