New Co-pilot+ PCs Utilize Azure LLMs and Built-In SLMs for Virtualization in Virtualization Review

Microsoft has introduced Copilot+ PCs that utilize small language model (SLM) technology and cloud-based large language models (LLM) to deliver advanced AI experiences. These PCs are equipped with powerful processors and multiple AI models, including the Phi-3-mini model with 3.8 billion parameters.

The Copilot+ PCs combine SLMs with Azure-hosted LLMs to provide new AI capabilities. It is suggested that the SLMs are integrated into the devices and run locally, enhancing AI performance on the devices. Dell has also referenced “on-device AI” in its announcement of the new Copilot+ PCs.

In addition to AI models, the Copilot+ PCs are powered by Snapdragon X Elite and Snapdragon processors. A new system architecture has been introduced by Microsoft to combine the power of CPU, GPU, and a new neural processing unit (NPU) for enhanced performance. The PCs leverage LLMs running on Azure cloud alongside SLMs, enabling unprecedented levels of performance.

The company also announced new features for the Surface Pro and Surface Laptop, such as enhanced memory capabilities, co-creator at Paint, and live subtitles. Developers working with NPUs for AI workloads can now access tools like DaVinci resolution, Cephable, and Cap Cut for improved AI experiences.

Azure cloud plays a significant role in Microsoft’s AI innovations, with the company signaling that this wave of PC Copilot+ is just the beginning. They have reinvented the entire PC ecosystem, from silicon to the operating system, application layer, and cloud, with AI at the core, marking a significant change to the Windows platform.

More AI news, along with Azure-related updates, are expected to be announced at the Build 2024 developer conference, which will be ongoing until May 23.

In conclusion, Microsoft’s Copilot+ PCs represent a new era of AI-enabled devices that leverage advanced AI models to deliver enhanced user experiences. The integration of SLMs and LLMs on the device level, alongside powerful processors and NPUs, showcases Microsoft’s commitment to AI innovation in the PC ecosystem. Stay tuned for further updates from the Build 2024 conference on AI developments and Azure integration.

Article Source
https://virtualizationreview.com/Articles/2024/05/20/ai-pcs.aspx