Hugging Face this week announced HUGS, its answer to Nvidia’s Inference Microservices (NIMs), which the AI repo claims will let customers deploy and run LLMs and models on a much wider variety of hardware.
Like Nvidia’s previously announced…
Article Source
https://www.theregister.com/2024/10/24/huggingface_hugs_nvidia/