Microsoft unveiled Phi Silica, a small language model designed to run on the NPUs of Copilot+ PCs, at the 2023 Microsoft Build event. This model is derived from Phi-3-mini, which was announced in April and is small enough to run on a local PC. Microsoft’s Copilot service typically interacts with a remote server in the cloud, utilizing large language models (LLMs) with billions of parameters to enhance response accuracy.
In contrast, the new Phi Silica model is designed to operate locally on Copilot+ PCs, offering more privacy for users. This localization is crucial for services like Microsoft’s Recall PC Search Engine, which relies on the NPU and runs locally to avoid indexing anonymous or incognito searches. Small language models (SLMs) like Phi Silica are preferred in these scenarios due to their lower memory and storage requirements.
With a 3.3 billion parameter model, Microsoft has optimized Phi Silica for both accuracy and speed, making it suitable for running on the smallest language model. Microsoft emphasized the importance of SLMs for AI applications like Recall and highlighted Windows as the first platform to feature a next-generation SLM customized for NPUs and Inbox Send.
Despite the promising features of Phi Silica, Microsoft has hinted at the possibility of it being an “out of the box” solution, leaving uncertainty about whether it will be included on Copilot+ PCs like an on-premise version of Copilot. The company is expected to clarify this before the launch of Copilot+ PCs on June 23.
In conclusion, Microsoft’s development of Phi Silica demonstrates a shift towards utilizing SLMs for local AI applications, paving the way for enhanced privacy and efficiency in AI services. The company’s commitment to optimizing language models for specific hardware, such as NPUs, showcases its dedication to advancing AI technology across various platforms. As Microsoft continues to explore the capabilities of SLMs, future innovations in AI development are likely to prioritize localized solutions for enhanced user privacy and performance.
Article Source
https://www.pcworld.com/article/2340495/microsoft-debuts-phi-silica-ai-specifically-for-copilot-pcs.html
