Meta’s benchmarks for its new AI models are a bit misleading | TechCrunch

Meta’s benchmarks for its new AI models are a bit misleading | TechCrunch

One of the new flagship AI models Meta released on Saturday, Maverick, ranks second on LM Arena, a test that has human raters compare the outputs of models and choose which they prefer. But it seems the version of Maverick that Meta deployed to LM Arena differs from the version that’s widely available to developers.

As several AI researchers pointed out on X, Meta noted in its announcement that the Maverick on LM Arena is an “experimental chat version.” A chart on the official Llama…

Article Source
https://techcrunch.com/2025/04/06/metas-benchmarks-for-its-new-ai-models-are-a-bit-misleading/

More From Author

Oracle privately notifies Cloud data breach to customers

Oracle privately notifies Cloud data breach to customers

NUTANIX 24 HOUR DEADLINE ALERT: FORMER LOUISIANA ATTORNEY GENERAL AND KAHN SWICK & FOTI, LLC REMIND INVESTORS WITH LOSSES IN EXCESS OF $100,000 of Deadline in Class Action Lawsuit Against Nutanix, Inc. – NTNX – ACCESS Newswire

Listen to the Podcast Overview

Watch the Keynote