SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints | Amazon Web Services
When you deploy a model to a GPU endpoint, the smallest unit of GPU you can request is one whole…
Tag: endpoints
Introducing tunnel endpoints for private access to network segments | Amazon Web Services
AWS PrivateLink has introduced tunnel endpoints, which you can use to privately access a network segment in another AWS account.…
Citrix UniconOS Dual Boot Builds Business Resilience Into Windows Endpoints, Helping Enterprises Recover Within Minutes When Downtime Hits
By Business Wire Publication Date: 2026-08-25 13:28:00 Citrix, a Cloud Software Group company, announced Citrix UniconOS™ dual boot, a new…
Microsoft Defender can now automatically isolate hacked endpoints
By Sergiu Gatlan Publication Date: 2026-05-26 12:19:00 Microsoft is testing a new Defender for Endpoint capability that will automatically isolate…
Announcing OpenAI-compatible API support for Amazon SageMaker AI endpoints | Amazon Web Services
Today, Amazon SageMaker AI introduces OpenAI-compatible API support for real-time inference endpoints. If you use the OpenAI SDK, LangChain, or…
Perplexity Open-Sources Bumblebee: A Read-Only Supply-Chain Scanner for Developer Endpoints
By Asif Razzaq Publication Date: 2026-05-23 08:17:00 Attackers increasingly target the packages, editor extensions, and AI tool configs on developer…
Capacity-aware inference: Automatic instance fallback for SageMaker AI endpoints | Amazon Web Services
As organizations scale generative AI workloads in production, securing reliable GPU compute has become one of the most persistent operational…
Enhanced metrics for Amazon SageMaker AI endpoints: deeper visibility for better performance | Amazon Web Services
Running machine learning (ML) models in production requires more than just infrastructure resilience and scaling efficiency. You need nearly continuous…
Building custom model provider for Strands Agents with LLMs hosted on SageMaker AI endpoints | Amazon Web Services
Organizations increasingly deploy custom large language models (LLMs) on Amazon SageMaker AI real-time endpoints using their preferred serving frameworks—such as…
Build with Kimi K2.5 Multimodal VLM Using NVIDIA GPU-Accelerated Endpoints | NVIDIA Technical Blog
By Anu Srivastava Publication Date: 2026-02-04 19:46:00 Kimi K2.5 is the newest open vision language model (VLM) from the Kimi…