EKS

Deploying Generative AI Applications with NVIDIA NIM Microservices on Amazon Elastic Kubernetes Service (Amazon EKS) – Part 2 | Amazon Web Services

by
Deploying Generative AI Applications with NVIDIA NIM Microservices on Amazon Elastic Kubernetes Service (Amazon EKS) – Part 2 | Amazon Web Services

This post was contributed by Abhishek Sawarkar (NVIDIA), Alex Iankoulski (AWS), Aman Shanbhag (AWS), Deepika Padmanabhan (NVIDIA), Eliuth Triana Isaza (NVIDIA), Jiahong Liu (NVIDIA), Joey Chou (AWS) Today, we’ll continue with… Article Source https://aws.amazon.com/blogs/hpc/deploying-generative-ai-applications-with-nvidia-nim-microservices-on-amazon-elastic-kubernetes-service-amazon-eks-part-2/

Amazon EKS optimized Amazon Linux 2023 accelerated AMIs now available | Amazon Web Services

by
Amazon EKS optimized Amazon Linux 2023 accelerated AMIs now available | Amazon Web Services

Introduction Earlier this year we announced support for Amazon EKS optimized AL2023 AMIs that provided many enhancements in terms of security and performance. Amazon Linux 2023 (AL2023) is the next generation of Amazon Linux from… Article Source https://aws.amazon.com/blogs/containers/amazon-eks-optimized-amazon-linux-2023-accelerated-amis-now-available/

Scaling a Large Language Model with NVIDIA NIM on Amazon EKS with Karpenter | Amazon Web Services

by
Scaling a Large Language Model with NVIDIA NIM on Amazon EKS with Karpenter | Amazon Web Services

Many organizations are building artificial intelligence (AI) applications using Large Language Models (LLMs) to deliver new experiences to their customers, from content creation to customer service and data analysis. However, the… Article Source https://aws.amazon.com/blogs/containers/scaling-a-large-language-model-with-nvidia-nim-on-amazon-eks-with-karpenter/

Use Terraform to deploy a complete AWS Batch environment on Amazon EKS | Amazon Web Services

by
Use Terraform to deploy a complete AWS Batch environment on Amazon EKS | Amazon Web Services

When we announced AWS Batch support for Amazon Elastic Kubernetes Service (Amazon EKS), we laid out our thinking. Compute intensive, high scale batch workloads have materially different operational challenges from microservices. The… Article Source https://aws.amazon.com/blogs/hpc/use-terraform-to-deploy-a-complete-aws-batch-environment-on-amazon-eks/

Inside Pinterest’s Custom Spark Job logging and monitoring on Amazon EKS: Using AWS for Fluent Bit, Amazon S3, and ADOT | Amazon Web Services

by
Inside Pinterest’s Custom Spark Job logging and monitoring on Amazon EKS: Using AWS for Fluent Bit, Amazon S3, and ADOT | Amazon Web Services

In Part 1, we explored Moka’s high-level design and logging infrastructure, showcasing how AWS for Fluent Bit, Amazon S3, and a robust logging framework make sure of operational visibility and facilitate issue resolution. For more… Article Source https://aws.amazon.com/blogs/containers/inside-pinterests-custom-spark-job-logging-and-monitoring-on-amazon-eks-using-aws-for-fluent-bit-amazon-s3-and-adot-2/

Automating custom Amazon EKS worker node builds using EC2 Image Builder | Amazon Web Services

by
Automating custom Amazon EKS worker node builds using EC2 Image Builder | Amazon Web Services

Customers who are building their “Golden Image” Amazon Machine Images (AMIs) using EC2 Image Builder may wish to extend their Image Builder pipelines to build out their Amazon Elastic Kubernetes Service (Amazon EKS) worker nodes as… Article Source https://aws.amazon.com/blogs/containers/automating-custom-amazon-eks-worker-node-builds-using-ec2-image-builder/

Amazon EKS and Amazon EKS Distro now supports Kubernetes version 1.31 – AWS

by
Amazon EKS and Amazon EKS Distro now supports Kubernetes version 1.31 – AWS

Kubernetes version 1.31 introduced several new features and bug fixes, and AWS is excited to announce that you can now use Amazon Elastic Kubernetes Service (EKS) and Amazon EKS Distro to run Kubernetes version 1.31. Starting today,… Article Source https://aws.amazon.com/about-aws/whats-new/2024/09/amazon-eks-distro-kubernetes-version-1-31/

AWS and Kubecost Collaborate to Deliver Kubecost 2.0 for Amazon EKS Users | Amazon Web Services

by
AWS and Kubecost Collaborate to Deliver Kubecost 2.0 for Amazon EKS Users | Amazon Web Services

Introduction In August 2022, Amazon Elastic Kubernetes Service (Amazon EKS) announced the availability of an Amazon EKS-optimized bundle of Kubecost for cluster cost visibility. The bundle is available to Amazon EKS users free… Article Source https://aws.amazon.com/blogs/containers/aws-and-kubecost-collaborate-to-deliver-kubecost-2-0-for-amazon-eks-users/

Facilitate Service Mesh Deployment with Solo.io’s AWS Marketplace add-on for Amazon EKS | AWS

by
Facilitate Service Mesh Deployment with Solo.io’s AWS Marketplace add-on for Amazon EKS | AWS

As microservices architectures gain popularity, the importance of service mesh solutions, such as the open-source Istio project, has increased. Istio offers a range of capabilities in security, observability, and traffic management, but deploying and managing it can be complex, especially for those new to microservices. To simplify this process, Amazon Web Services (AWS) has collaborated … Read more

Enhance ML workload monitoring on Amazon EKS with AWS Neuron Monitor container for simplified scaling

by
Enhance ML workload monitoring on Amazon EKS with AWS Neuron Monitor container for simplified scaling

Amazon Web Services has introduced the AWS Neuron Monitor container, aimed at enhancing the monitoring functionalities of AWS Inferentia and AWS Trainium chips on Amazon Elastic Kubernetes Service (EKS). This tool makes it easier to integrate advanced monitoring tools like Prometheus and Grafana, allowing users to set up and manage their machine learning workflows with … Read more