New from Microsoft: GenAI now residing within laptops instead of the cloud

New from Microsoft: GenAI now residing within laptops instead of the cloud

Microsoft recently launched its new ‘Copilot+ PC’ in collaboration with ecosystem players like Qualcomm, Intel, and AMD, along with OEM partners Dell, HP, and Samsung. This PC is powered by OpenAI GPT-40 and is claimed to be 20 times more powerful and up to 100 times more efficient in running AI workloads compared to Apple’s MacBook Air. The PC aims to outperform Apple’s devices in sustained multithreaded performance and battery life.

Windows-based PCs have been trailing behind Apple’s devices, especially with the introduction of the M1 chip for MacBooks in 2020. However, Microsoft seems to be leading in the AI race with its new AI-enabled PCs. These AI PCs incorporate NPUs, specialized processors optimized for running AI applications locally on the device, unlike relying on cloud-based services. This push for AI PCs comes at a time when there is a growing demand for new hardware and software post-Covid.

With the latest Windows version, a dedicated Copilot key, and an NPU capable of over 40 trillion operations per second, consumers can run Microsoft Copilot locally on their personal devices. Unlike traditional GPUs or CPUs, NPUs are specifically designed for AI computing, enhancing performance and energy efficiency. This shift towards on-device machine learning is gaining traction as it offers lower latency and improved privacy compared to cloud-based solutions.

The development in AI models from training to inference highlights the shift towards running models directly on the device, known as edge computing. On-device machine learning processes input data on the device itself, providing benefits such as reduced latency and enhanced privacy. Microsoft’s Copilot+ PCs emphasize these advantages, offering features like Recall, Cocreator, and Live Caption to enhance user experience and privacy.

Microsoft’s focus on AI and edge computing gives it an advantage in the AI race over Apple. However, Apple is expected to showcase its own AI applications and hardware, including new M4 Pro and M4 Max chips at its annual Worldwide Developers Conference event. This competition between Macs and Windows PCs in the AI space could make the battle more interesting.

In conclusion, Microsoft’s new Copilot+ PC signifies a shift towards on-device machine learning and edge computing, offering improved performance and privacy for users. The AI race between Microsoft and Apple is heating up, with both companies striving to deliver advanced AI applications and hardware to cater to the evolving consumer needs.

Article Source
https://indianexpress.com/article/technology/artificial-intelligence/microsofts-new-hard-sell-genai-that-lives-inside-laptops-than-in-the-cloud-9352104/