Power up with new SaaS Add-Ons from the DigitalOcean Marketplace

Related

Deployment fails for Rails App with App Platform - No such file or directory - /workspace/node_modules/.bin/webpack (Errno::ENOENT)
Question
/etc/init.d/nginx restart -> failed
Question

Question

Issues with ip address causing 403 error on web scraping tool

Hi there

So i have a nokogiri web scrape on my website. It works lovely and fine on my local dev machine but when putting it live on here or heroku. I get a 403 forbidden error code.

Don’t suppose anyone knows how to fix this?

Thanks Sam

Subscribe
Share
Submit an answer
You can type!ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

Andrew Herrington • August 10, 2016

Hey Sam,

It could be the web properties you are trying to scrape have blocked DigitalOcean or Heroku’s IP ranges. Lots of places do this to prevent cloud servers from scraping their site.

Regards,

–Andrew

Join the DigitalOcean CommunityCommunity

Join 1M+ other developers and:

  • Get help and share knowledge in Q&A
  • Subscribe to topics of interest
  • Get courses & tools that help you grow as a developer or small business owner

Related

Deployment fails for Rails App with App Platform - No such file or directory - /workspace/node_modules/.bin/webpack (Errno::ENOENT)
Question
/etc/init.d/nginx restart -> failed
Question
Join the DigitalOcean CommunityCommunity

Join 1M+ other developers and:

  • Get help and share knowledge in Q&A
  • Subscribe to topics of interest
  • Get courses & tools that help you grow as a developer or small business owner