Latency versus throughput

Latency is how long one request takes; throughput is how many requests are handled per second. You can raise throughput by adding servers, but latency only drops by doing less work or moving closer to the user.