Auto-scaling

Adding and removing instances automatically based on a metric such as CPU. New instances take minutes to become useful, so scaling follows gradual trends well but does not absorb an instant spike alone.

Where it shows up in real systems

  • Auto-scaling group

    Instances are added when CPU exceeds the target and removed when it falls. New instances need a warm-up period before taking traffic, so sudden spikes still hurt: keep enough minimum capacity. Failed instances are replaced automatically.

    In production: AWS Auto Scaling groups, Azure VM Scale Sets, GCP Managed Instance Groups, Kubernetes HPA

See it break, then fix it

Build an architecture, send it a day of traffic and outages, and learn why it holds or fails. Free to start.