Related

Product App Platform: Run Rails apps without managing servers Product
Deployment fails for Rails App with App Platform - No such file or directory - /workspace/node_modules/.bin/webpack (Errno::ENOENT) Question Question
/etc/init.d/nginx restart -> failed Question Question

Question

Issues with ip address causing 403 error on web scraping tool

Posted June 21, 2016 2.9k views
Ruby on RailsDokku

Hi there

So i have a nokogiri web scrape on my website. It works lovely and fine on my local dev machine but when putting it live on here or heroku. I get a 403 forbidden error code.

Don’t suppose anyone knows how to fix this?

Thanks
Sam

Add a comment
samnymr
By:
samnymr

Related

Product App Platform: Run Rails apps without managing servers Product
Deployment fails for Rails App with App Platform - No such file or directory - /workspace/node_modules/.bin/webpack (Errno::ENOENT) Question Question
/etc/init.d/nginx restart -> failed Question Question

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

×
1 answer
AndewTheTechie August 10, 2016

Hey Sam,

It could be the web properties you are trying to scrape have blocked DigitalOcean or Heroku’s IP ranges. Lots of places do this to prevent cloud servers from scraping their site.

Regards,

–Andrew

Reply Report
Submit an Answer

Related

Looking for something else?

Ask a new question Search for more help