Power of two choices load balancer. For each request the load balancer randomly picks two candidate servers and routes to whichever has fewer active connections. The two candidates briefly light up during the decision, and the winner is the less-loaded of the two.

Client Incoming Load balancer Power of 2 choices Next: — Server 1 Done 0 · Active 0 Server 2 Done 0 · Active 0 Server 3 Done 0 · Active 0 Server 4 Done 0 · Active 0
Latest decision
Send a request to see the LB pick two candidates and compare.
500 ms
Completed
0
In progress
0
Spread (max − min)
0
Peak active
0