LLM routing for quality, low-cost responses

LLM routing for quality, low-cost responses

Just two years ago, a few proprietary, general-purpose large language models dominated the AI market. Today, there are 141,000 LLMs open-sourced on Hugging Face alone — many of them relatively small and built for specialized tasks. Not only are… Article Source https://research.ibm.com/blog/LLM-routers

IBM Unveils Full 6.48 TB LLM Training Dataset

IBM Unveils Full 6.48 TB LLM Training Dataset

IBM recently announced the release of an open source language model, Your Granite 13B LLM, designed for enterprise applications. Armand Ruiz, IBM’s vice president of AI platform products, has now shared details of the extensive 6.48TB dataset used to train Granite 13B. This dataset, which underwent thorough preprocessing, was ultimately reduced to 2.07TB, representing a … Read more

Robust Intelligence partners with Nutanix AI to streamline the safety and security of AI applications

Robust Intelligence partners with Nutanix AI to streamline the safety and security of AI applications

Robust Intelligence, an AI application security company, has announced its partnership with the Nutanix partner program to offer businesses a secure solution for their AI transformation journey. By combining the Robust Intelligence platform with Nutanix’s GPT-in-a-Box, customers can create, validate, and protect generative AI applications with automated testing and customized guardrails. While the potential of … Read more

NTT Introduces Tsuzumi LLM Powered by Microsoft Azure AI MaaS Service

NTT Introduces Tsuzumi LLM Powered by Microsoft Azure AI MaaS Service

NTT DATA, a global leader in digital business and IT services, has launched Tsuzumi through Microsoft Azure AI Models as a Service (MaaS) offering. This marks a significant milestone in their 25-year partnership aimed at developing technology solutions that promote sustainability and innovation. Tsuzumi is a large language model (LLM) proficient in Japanese and English, … Read more

Oracle Launches HeatWave GenAI, a New In-Database LLM and Database Vector Store now Available for General Use

Oracle Launches HeatWave GenAI, a New In-Database LLM and Database Vector Store now Available for General Use

Oracle has introduced a new innovation called HeatWave GenAI, the industry’s first database LLMs and automated vector warehouse in databases. This technology allows enterprise customers to utilize generative AI capabilities directly within Oracle databases without requiring AI expertise, data migration, or extra costs. HeatWave GenAI is being touted as surpassing competitors such as Snowflake, Google … Read more

Tech Mahindra, Intel, and Dell Technologies team up to introduce Project Indus LLM

Tech Mahindra, Intel, and Dell Technologies team up to introduce Project Indus LLM

Mahindra Technology, a global technology consulting company, has unveiled Project Indus, a foundational model designed to communicate in multiple Indian languages and dialects. The first phase of this Broad Language Model (LLM) focuses on the Hindi language and its various dialects. The Indus LLM will be implemented using a ‘GenAI in a box’ framework, making … Read more

Google Unveils Gemma 2 Series: Enhanced LLM Models Available in 9B and 27B Sizes, Trained on 13T Tokens

Google Unveils Gemma 2 Series: Enhanced LLM Models Available in 9B and 27B Sizes, Trained on 13T Tokens

Google has released two new models in its Gemma Series 2: The 27B and the 9B. The 27B model boasts 27 billion parameters and excels in handling complex tasks with precision and depth in language comprehension. On the other hand, the 9B model offers a lightweight option with 9 billion parameters, suitable for applications requiring … Read more

Google Translate to Expand Language Support with Introduction of 110 New Languages, Including Cantonese via PaLM 2 LLM

Google Translate to Expand Language Support with Introduction of 110 New Languages, Including Cantonese via PaLM 2 LLM

Google has utilized AI technology to enhance and expand the functionality of Google Translate. With the addition of 110 new languages, the company has nearly doubled the number of languages offered by the translation service. This expansion covers approximately eight percent of the world’s population, allowing for easier communication and information access for users around … Read more

Experience and Performance Results of Early LLM Serving with AMD Instinct MI300X GPUs on Oracle

Recently, Oracle has released its first benchmark results for the new AMD Instinct MI300X GPUs, showcasing impressive performance gains in their LLM service. The results reflect the company’s commitment to providing cutting-edge technology solutions to their customers. The AMD Instinct MI300X GPUs have proven to significantly enhance the performance of Oracle’s LLM service. These GPUs … Read more

Google DeepMind, Anthropic’s LLM, and OpenAI Co-Founder’s New Venture: AI News This Week

Google DeepMind, Anthropic’s LLM, and OpenAI Co-Founder’s New Venture: AI News This Week

The AI landscape is seeing significant advancements with Google’s DeepMind introducing a video-to-audio tool that can revolutionize content creation. This tool combines pixels with text prompts to generate soundtracks, effects, and dialogues for AI-generated clips, making it a game-changer for marketers and filmmakers. Anthropic has unveiled Claude 3.5 Sonnet, an advanced chatbot that can capture … Read more