Question
Is Load balancing limited at 1000 requests per second?
Hi everyone,
Currently I want to scale my API servers, so I create some additional droplets and try to use the Load Balancing feature for those droplets. When I try to test the performance with loader.io (Sending 5k requests per second) I realize that the maximum number of success request/s is exactly 1000 (and a lot of timeout requests). Then I try to create another droplet as a load balancer using nginx and do the same test. The result shows that there are over 3000 request/s (and just a little timeout requests). So I guess that Load Balancing is limited at 1000 request/s. Is that true? Can I do anything to lift this limit?
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.
@yenthanh132 @timothyleland @shatrughanjha
Hi guys, did you guys figure out the problem with Load Balancer ?
I did a test with loader.io and it seems to work with more than 5000 requests per second, there are timed out about 33%. So it didn’t seem to fit the description of @yenthanh132 question.
Not sure are you still able to reproduce the issue with Load Balancer limit of 1000 requests/per second ? I’m about to roll out a distributed back-end and wonder whether should use Load Balancer or just simple Route 53 load balancing using weighted AAA record.
I was unable to figure out the fix, so i have created my own load balancer using haproxy.
Hi, any official answer on this subject?
We plan to handle a lot of traffic so it’s important to know in advance if there’s a chance we’re gonna hit any hard limit or not.