Load Balancing

Long-lived connections

Most API calls finish in 80ms, but `/export` opens a 2-minute streaming response. With one shared pool of 20 servers, why might round-robin hurt? What algorithm or routing split would you use?

Intermediate drill question.

Write it as you would say it in the interview: assumptions, the design, tradeoffs, and what you would do next. The draft saves in this browser.

Review the lesson