NVIDIA has enhanced the AI performance of its GeForce RTX GPUs and AI PC platforms with the latest R555 driver update. These improvements were announced during Microsoft Build and include optimizations for Large Language Models (LLMs) to enhance generative AI experiences. With the R555 drivers, NVIDIA RTX GPUs and AI PC platforms now deliver up to 3 times faster AI performance using ONNX Runtime (ORT) and DirectML tools for running AI models locally on Windows PCs.
In addition, WebNN has also been accelerated with RTX through DirectML, an API for web developers to implement new AI models. Microsoft is collaborating with NVIDIA to enhance RTX GPU performance and add DirectML support to PyTorch. The new R555 drivers offer a range of capabilities for GeForce RTX GPUs and RTX PCs, such as support for DQ-GEMM metacommand, RMSNorm normalization methods, group care mechanisms, and improvements for GEMM of tensors.
Performance benchmarks for ORT, a generative AI extension by Microsoft, show significant gains in both INT4 and FP16 data types, with up to 3 times performance improvements for LLM models like Phi-3, Llama 3, Gemma, and Mistral. NVIDIA is also leading in the AI consumer PC space with its TensorRT and TensorRT-LLM suite, offering solutions powered by AI hardware like Tensor Cores. These solutions include Super resolution DLSS technology, NVIDIA AS, RTX Remix, Omniverse, Transmission, RTX Video, and other technologies. NVIDIA GPUs provide up to 1,300 TOPS of AI computing, surpassing the performance of other chips expected to only reach 100 TOPS.
Overall, the latest R555 driver update from NVIDIA enhances the AI performance of GeForce RTX GPUs and AI PC platforms, making them ideal for various AI applications and experiences. The collaboration with Microsoft to optimize AI tools and support for new AI models further solidifies NVIDIA’s position as a leader in the AI computing space for consumer PCs. The advancements in AI capabilities on NVIDIA GPUs are paving the way for more efficient and powerful AI-driven applications in the future.
Article Source
https://wccftech.com/nvidia-boosts-ai-performance-3x-geforce-rtx-gpus-rtx-pc-rtx-workstations-latest-driver/