Beyond Transformers: New AI Architectures Could Revolutionize Large Language Models – Decrypt

In the past weeks, researchers from Google and Sakana unveiled two cutting-edge neural network designs that could upend the AI industry.

These technologies aim to challenge the dominance of transformers—a type of neural network that connects inputs and outputs based on context—the technology that has defined AI for the past six years.

The new approaches are Google’s “Titans,” and “Transformers Squared,” which was designed by Sakana, a Tokyo AI startup known for using nature as…