Containers

One Amazon EKS, Many edges: How to choose your edge container strategy on AWS

One Amazon EKS, many edges: How to choose your edge container strategy on AWS

Choosing the right edge container strategy across many locations can fragment your fleet into dozens of special cases. This post shows how to avoid that by standardizing on Amazon EKS, then choosing a deployment model per site: gate on connectivity, then match to existing infrastructure, so every edge runs the same Kubernetes standard.

The operations gap between deploying an application and running it forever

This post features the new Cluster Mode deployment model in AWS Elastic Beanstalk that extends the operational promise of the service to containerized application portfolios. You bring your applications as source code, Dockerfiles, or container images, and Elastic Beanstalk takes ongoing operational responsibility for the production environment underneath.

Implement per-pod image pull permissions with ECR repository policies on Amazon EKS

Implement per-pod image pull permissions with ECR repository policies on Amazon EKS

Learn how to scope Amazon ECR image pull permissions to individual Kubernetes pods on a multi-tenant Amazon EKS cluster using KEP 4412 credential providers and ECR repository deny policies, so teams sharing the same nodes can pull only their own container images.

How Ramp runs GPU AI workloads at scale with ECS Managed Instances

How Ramp runs GPU AI workloads at scale with ECS Managed Instances

Ramp runs GPU-powered AI inference continuously on Amazon ECS. This post walks through how Ramp’s infrastructure team moved those GPU workloads onto Amazon ECS Managed Instances: the architecture pattern, Terraform implementation, and the lessons learned migrating 50 to 60 EC2 instances.

Fast model loading for AI inference on Amazon EKS

Fast model loading for AI inference on Amazon EKS

When you scale AI inference on Amazon EKS, every new pod must load model weights into GPU memory before serving traffic. We investigated where cold-start time goes and found two configuration-only changes to Run:ai Model Streamer that cut model startup time by 80-93% on subsequent launches, with no code changes.

Break-glass access for Amazon EKS when federated identity fails

Break-glass access for Amazon EKS when federated identity fails

Implementing break-glass access for Amazon EKS clusters removes the circular dependency where a federated identity provider outage locks you out of the clusters you need to reach to fix it. This post supplies a cross-account IAM role with enforced MFA, infrastructure-as-code templates, validation tests, and a post-incident recovery procedure.

Deep dive into Amazon EKS certificate authority rotation

Deep dive into Amazon EKS certificate authority rotation

Amazon EKS now provides a managed, non-disruptive lifecycle for rotating your cluster’s certificate authority (CA), with automated safeguards and rollback. This deep dive explains how CA rotation works, what AWS handles versus what you must update, and how to walk through the rotation lifecycle on your own timeline.