Hello-there!
In many tutorials, caching significantly improves requests per second using benchmarking tools like WRK and AB. For some reason, caching doesn’t seem to improve request per second at all - it might even make it worse. I’ve been stuck between 1k to 3k requests per second.
Can someone please help me understand how some people seem to reach 12k to 30k requests per second using the same benchmarking tools?
I’m using the following optimizations:
- Load balancing w/ 5 web servers
- Browser cache
- FastCGI cache
- HTTP2 w/ server push
- Gzip compression
- Image resizing w/ resized image cache
- Cache in RAM
- Webp images
- HTML and CSS minification
- Removing unused CSS
- Lazy loading images
I’ve also tried:
- CDN
- Dedicated CPU web server
- Systemctl
- HAProxy
Here is my nginx.conf file.
I’ve been trying to figure this out for over three weeks now but I’m stumped…
This textbox defaults to using Markdown to format your answer.
You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!
The only thing I can think of would be that even though you have layers upon layers of caches, somehow requests still get through to the php (or backend service), and not being loaded from cache.
From reading “Browser Cache”, I’m assuming you’re not using an API backend entirely.
What I’d do would be to strip off all the caching layers, then start with each one by one.
So you might start with only FastCGI, then test to see. See if it improves rps.
Considering the layers of caches, would it be possible that somehow, each layer makes the request going to the layer seem like a new dynamic request, thus triggering a brand new request on each cycle? Just a thought.
Become a contributor for community
Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.
DigitalOcean Documentation
Full documentation for every DigitalOcean product.
Resources for startups and SMBs
The Wave has everything you need to know about building a business, from raising funding to marketing your product.
The developer cloud
Scale up as you grow — whether you're running one virtual machine or ten thousand.
Get started for free
Sign up and get $200 in credit for your first 60 days with DigitalOcean.*
*This promotional offer applies to new accounts only.