Devs are finally getting serious about efficiency

Feature If you’ve been following AI development over the past few years, one trend has remained constant: bigger models are usually smarter, but also harder to run.

This is particularly problematic in parts of the world where access to America’s most sophisticated AI chips is restricted – like, say, China.

But even outside of China, model builders are increasingly turning to mixture of experts (MoE) architectures along with emerging compression tech to drive down the compute requirements of…