Question

Is Load balancing limited at 1000 requests per second?

Hi everyone,

Currently I want to scale my API servers, so I create some additional droplets and try to use the Load Balancing feature for those droplets. When I try to test the performance with loader.io (Sending 5k requests per second) I realize that the maximum number of success request/s is exactly 1000 (and a lot of timeout requests). Then I try to create another droplet as a load balancer using nginx and do the same test. The result shows that there are over 3000 request/s (and just a little timeout requests). So I guess that Load Balancing is limited at 1000 request/s. Is that true? Can I do anything to lift this limit?

Show comments

Submit an answer

This textbox defaults to using Markdown to format your answer.

You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

Sign In or Sign Up to Answer

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

Yes, it’s true. We have the same problem. Our backend can handle 70k client / s (7k * 10 servers), while the load balancer limits the throughput to only 1,000 client / s.

I am having the same issue. I Just terminated the ssl on the load balancer and their tls handhsake took almost 16 sec with only 200 per second.

@yenthanh132 I seem to be having the same issue. After so many request the load balancer fails. Haven’t been able to get an answer from DO about this. Had to switch my application to use cloudflare which hasn’t had any issues but cost a lot more.