Analyzing / Preventing Bandwidth Spikes
I just had a huge spike in bandwidth, which seems to have cause spikes in all else - RAM, CPU, Disk I/O. It caused the site to go down for a few minutes. I looked at my Google Analytics data and there was no particular user activity at that time.
I have LAMP stack (wordpress backend), with Nginx reverse proxy. Nodejs is doing rendering. It’s a headless wordpress.
How can I analyze what caused this bandwidth spike?
I suspect it could be a scraper. I am disallowing some scrapers from my robots.txt, but obviously not all scrapers are going to obey that. What would be a way to deal with that situation at digitalocean? A firewall?
Another suspicion I have it could be due to Digital Ocean backup. It was scheduled for today - I wonder if anyone has run into a similar issue with backups.
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.