Nutanix, a hybrid multi-cloud company, is expanding its Nutanix GPT-in-a-Box technology to enhance business applications with AI intelligence. This technology includes integrations with Nvidia NIM inference microservices and the Hugging Face Large Language Models library. Nutanix GPT-in-a-Box is a software-defined AI-ready platform that simplifies the deployment and management of AI models and inference endpoints.
The release of GPT-in-a-Box 2.0 offers expanded Nvidia accelerated computing and LLM support, along with simplified foundation model management and integrations with Nvidia’s NIM microservices and the Hugging Face LLM library. The platform provides a unified user interface for base model management, API endpoint creation, and Nvidia Tensor Core GPUs.
Furthermore, Nutanix has enhanced its unstructured data platform for AI/ML with increased performance and density, supporting a new low-cost, high-density NVMe platform. The company also announced the AI Partner Program to provide customers with access to an expanded ecosystem of AI partners.
Nutanix has partnered with Hugging Face to provide access to the Hugging Face library and execute LLMs. This partnership enables AI application developers to use Nutanix GPT-in-a-Box 2.0 to consume validated Hugging Face LLMs. The collaboration aims to develop a custom integration with Text Generation Inference for the production deployment of large language models.
CEO and co-founder of Hugging Face, Clem Delangue, stated that the partnership with Nutanix will enable more companies to have private and secure control over their LLMs for AI applications using text generation inference. The goal is to provide a jointly validated and supported workflow for Hugging Face libraries and LLMs to offer a single management point for consistent model inference.
Nutanix CEO Rajiv Ramaswami emphasized the company’s commitment to bringing consumer-like simplicity to business while delivering total cost of ownership benefits. The focus is on modernizing infrastructure for AI deployment and ensuring technology has freedom of choice built into it. The company aims to become a platform for modern applications with the ability to work with containerized cloud-native solutions.
The renaissance of AI in this decade has prompted organizations to consider back-end infrastructure, front-end user interfaces, media impact, and societal implications of AI applications. Additionally, managing the costs of cloud-based AI using FinOps principles and meeting regulatory compliance pressures are crucial considerations. The path to better AI infrastructure involves addressing these challenges, and Nutanix is taking steps to provide solutions. While there may be obstacles along the way, Nutanix is committed to paving the way for improved AI infrastructure.
Article Source
https://www.forbes.com/sites/adrianbridgwater/2024/05/21/nutanix-cements-enterprise-ai-foundations-with-gpt-in-a-box-20/