Menu
yenthanh132
By:
yenthanh132

Is Load balancing limited at 1000 requests per second?

April 13, 2017 655 views
Load Balancing Ubuntu 16.04

Hi everyone,

Currently I want to scale my API servers, so I create some additional droplets and try to use the Load Balancing feature for those droplets. When I try to test the performance with loader.io (Sending 5k requests per second) I realize that the maximum number of success request/s is exactly 1000 (and a lot of timeout requests). Then I try to create another droplet as a load balancer using nginx and do the same test. The result shows that there are over 3000 request/s (and just a little timeout requests). So I guess that Load Balancing is limited at 1000 request/s. Is that true? Can I do anything to lift this limit?

Log In to Comment
2 Answers
jtittle1 April 23, 2017

@yenthanh132

As far as I'm aware there's not a concrete limit on requests for the Load Balancer service.

That being said, a lot more goes in to handling numerous requests per second that just the LB. Since the LB is simply proxying the request to a server, or group of servers, and isn't actually handling the physical request for more than a split second, the limitation is most likely elsewhere (i.e. the sever(s) the request is being proxied to).

It's hard to really say either way without knowing more about the setup, configuration, and what we're working with.

Reply
timothyleland June 23, 2017

@yenthanh132 I seem to be having the same issue. After so many request the load balancer fails. Haven't been able to get an answer from DO about this. Had to switch my application to use cloudflare which hasn't had any issues but cost a lot more.

Reply
Have another answer? Share your knowledge.

Related Questions