Microsoft’s latest Windows Copilot Runtime targets AI developers with hopes of winning them over

Microsoft unveiled a new line of Copilot Plus PCs with integrated AI features in Windows 11. Over 40 AI models are now running on Windows 11 through the new Windows Copilot Runtime, giving developers the ability to utilize these models in their own applications. At the Microsoft Build event, more details were shared about the Windows Copilot Runtime, which offers APIs for developers to incorporate AI frameworks and tools into their apps.

Pavan Davuluri, head of Windows and Surface, noted that the Windows Copilot library includes AI APIs like Studio Effects, Live Captions, OCR, and Recall with User Activity, set to be accessible to developers in June. Developers can use the library to integrate features such as studio effects, filters, and portrait blur into their apps. Meta is even incorporating Windows Studio effects into WhatsApp for video calls.

One standout feature demonstrated by Microsoft is the Bring Back AI function, allowing Copilot Plus PCs to record and save user activities on the device for easy recall and timeline searching. This feature is made possible by a new Windows semantic index that stores data locally.

Developers will have the opportunity to enhance the Windows Recover feature by adding contextual information to their apps. This integration helps users seamlessly transition between Windows and their specific apps. These improvements signal the beginning of more AI-powered apps on Microsoft’s new Arm-powered systems and NPUs from AMD and Intel in the near future.

Overall, Microsoft is paving the way for developers to create AI applications for Windows, with a focus on making Windows the most open platform for AI. This strategic move by Microsoft shows the company’s dedication to AI development in the coming years.

Article Source
https://www.theverge.com/2024/5/21/24161688/microsoft-windows-copilot-runtime-build-2024