Is Load balancing limited at 1000 requests per second?

April 13, 2017 1k views
Load Balancing Ubuntu 16.04

Hi everyone,

Currently I want to scale my API servers, so I create some additional droplets and try to use the Load Balancing feature for those droplets. When I try to test the performance with loader.io (Sending 5k requests per second) I realize that the maximum number of success request/s is exactly 1000 (and a lot of timeout requests). Then I try to create another droplet as a load balancer using nginx and do the same test. The result shows that there are over 3000 request/s (and just a little timeout requests). So I guess that Load Balancing is limited at 1000 request/s. Is that true? Can I do anything to lift this limit?

2 Answers

@yenthanh132

As far as I'm aware there's not a concrete limit on requests for the Load Balancer service.

That being said, a lot more goes in to handling numerous requests per second that just the LB. Since the LB is simply proxying the request to a server, or group of servers, and isn't actually handling the physical request for more than a split second, the limitation is most likely elsewhere (i.e. the sever(s) the request is being proxied to).

It's hard to really say either way without knowing more about the setup, configuration, and what we're working with.

@yenthanh132 I seem to be having the same issue. After so many request the load balancer fails. Haven't been able to get an answer from DO about this. Had to switch my application to use cloudflare which hasn't had any issues but cost a lot more.

Have another answer? Share your knowledge.