Issues with ip address causing 403 error on web scraping tool

June 21, 2016 2.3k views
Ruby on Rails Dokku

Hi there

So i have a nokogiri web scrape on my website. It works lovely and fine on my local dev machine but when putting it live on here or heroku. I get a 403 forbidden error code.

Don’t suppose anyone knows how to fix this?


1 Answer

Hey Sam,

It could be the web properties you are trying to scrape have blocked DigitalOcean or Heroku’s IP ranges. Lots of places do this to prevent cloud servers from scraping their site.



Have another answer? Share your knowledge.

You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!