- Intermediate
- Scalability
Where it shows up in real systems
-
Auto-scaling group
Instances are added when CPU exceeds the target and removed when it falls. New instances need a warm-up period before taking traffic, so sudden spikes still hurt: keep enough minimum capacity. Failed instances are replaced automatically.
In production: AWS Auto Scaling groups, Azure VM Scale Sets, GCP Managed Instance Groups, Kubernetes HPA
-
Serverless function
There is no server to size: capacity is the concurrency limit. When traffic rises faster than warm instances exist, requests pay a cold start, which is much longer for Java than for Go. Very cheap at low volume, expensive at a steady high volume.
In production: AWS Lambda, Azure Functions, Google Cloud Functions, Cloudflare Workers
See it break, then fix it
Build an architecture, send it a day of traffic and outages, and learn why it holds or fails. Free to start.