By Yen Thanh Le
Hi everyone,
Currently I want to scale my API servers, so I create some additional droplets and try to use the Load Balancing feature for those droplets. When I try to test the performance with loader.io (Sending 5k requests per second) I realize that the maximum number of success request/s is exactly 1000 (and a lot of timeout requests). Then I try to create another droplet as a load balancer using nginx and do the same test. The result shows that there are over 3000 request/s (and just a little timeout requests). So I guess that Load Balancing is limited at 1000 request/s. Is that true? Can I do anything to lift this limit?
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
@yenthanh132 I seem to be having the same issue. After so many request the load balancer fails. Haven’t been able to get an answer from DO about this. Had to switch my application to use cloudflare which hasn’t had any issues but cost a lot more.
I am having the same issue. I Just terminated the ssl on the load balancer and their tls handhsake took almost 16 sec with only 200 per second.
Yes, it’s true. We have the same problem. Our backend can handle 70k client / s (7k * 10 servers), while the load balancer limits the throughput to only 1,000 client / s.
Become a contributor for community
Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.
DigitalOcean Documentation
Full documentation for every DigitalOcean product.
Resources for startups and SMBs
The Wave has everything you need to know about building a business, from raising funding to marketing your product.
The developer cloud
Scale up as you grow — whether you're running one virtual machine or ten thousand.
Get started for free
Sign up and get $200 in credit for your first 60 days with DigitalOcean.*
*This promotional offer applies to new accounts only.