At Dell Technologies World 2024, Liqid introduced the UltraStack 30, which features thirty NVIDIA L40S GPUs in a Dell PowerEdge R760 server. This solution offers a cost-effective and scalable option for organizations seeking high-performance inference capabilities in their data centers.
Despite being less powerful than other Nvidia accelerators, the L40S GPUs are versatile and suitable for tasks like AI, data analysis, and 3D rendering. The UltraStack 30 aims to enhance enterprise-level GPU infrastructure capabilities while reducing energy consumption and operating costs. It also improves operations per second and total cost of ownership compared to similar GPU density solutions.
Liqid’s co-founder and chief strategy officer, Sumit Puri, mentioned plans to expand the capabilities of the UltraStack 30 by incorporating composableCXL technology. This advancement aims to enhance performance through optimal memory bandwidth and deliver high-performance, low-latency solutions.
Furthermore, Liqid is looking to support GPUs and accelerators from vendors like AMD and Intel in the future. There is also a possibility of marketing SmartStack and UltraStack technologies to Managed Service Providers (MSPs) interested in providing GPU rentals.
In summary, Liqid’s UltraStack 30 offers a cost-effective and scalable solution for organizations looking to deploy high-performance inference capabilities in their data centers. The system features thirty NVIDIA L40S GPUs in a single Dell PowerEdge R760 server, providing enhanced enterprise-level GPU infrastructure capabilities. Liqid plans to further improve performance through composableCXL technology and expand support for GPUs from vendors like AMD and Intel. Additionally, there is potential for marketing their technologies to MSPs interested in offering GPU rentals.
Article Source
https://www.techradar.com/pro/want-to-shove-30-gpus-in-a-computer-system-heres-an-ai-solution-that-will-work-as-long-as-you-are-using-dell-liqid-allows-one-r760-server-to-connect-to-a-whopping-30-nvidia-gpus-for-now-with-amd-and-intel-likely-soon