System design

Architect

Five times cheaper, just as reliable

A Berlin recipe platform serves 12,000 requests per second at its afternoon peak and pays about 65,000 dollars a month for it. Investors want the bill under 12,000 dollars without losing the SLO: 99.9 % availability, a p99 under 200 ms, and no lost write when the database primary fails at 10:00 or a web server crashes at 13:00.

Traffic at night is about a third of the peak. 95 % of reads target recipes that fit in about 6 GiB. The application runs on .NET 8, which runs just as well on Linux. Look at what each line of the bill pays for: licences are charged per core, provisioned IOPS per IOPS, servers per hour whether busy or not.

What your design must achieve

  • Monthly bill < 12,000 $
  • Availability ≥ 99.9 %
  • Latency p99 < 200 ms
  • Lost writes = 0

What you will master