Nutanix has integrated Nvidia NIM and Hugging Face Large Language Models into its GPT-in-a-Box offering, aimed at simplifying Enterprise AI adoption with tight integration with Nutanix Objects and Files for model and data storage. The company announced a Nutanix AI Partner Program to support customers looking to run, manage, and secure generative AI applications on the Nutanix Cloud Platform and GPT-in-a-Box.
GPT-in-a-Box 2.0 will offer expanded NVIDIA accelerated computing and LLM support, along with simplified model management and integrations with NVIDIA NIMs microservices and the Hugging Face LLM library. It will provide a unified user interface for foundation model management, API endpoint creation, and end-user access key management. The partnership with Hugging Face will enable integrated access to LLMs for Nutanix customers, allowing them to efficiently execute validated LLMs from Hugging Face within GPT-in-a-Box 2.0.
Nutanix has also enhanced its unstructured data platform for AI/ML applications, supporting a new low-cost all-NVMe platform and increased sequential read throughput. The company has collaborated with major server OEMs to support a wide range of AI-optimized GPUs and density-optimized GPU systems on Nutanix GPT-in-a-Box. An updated Data Lens Frankfurt-based point of presence will broaden adoption for EU customers.
The Nutanix AI Partner Program will provide customers with access to an ecosystem of AI partners to deliver GenAI solutions on the Nutanix Cloud Platform and GPT-in-a-Box. Partners will receive Nutanix AI Ready validation, full-stack solutions briefs, and promotional support to drive awareness and demand for AI use cases in various industries.
Nutanix GPT-in-a-Box 2.0 is set to be available in the second half of 2024, with support for NVIDIA GPU Direct and the NX-9151 currently in development. The company aims to simplify AI adoption and management for Enterprise customers through these new integrations and partnerships, providing a comprehensive solution for GenAI applications.
Article Source
https://gadget.co.za/nutanixai20/?amp=1