I just moved my site to DigitalOcean from a shared server. The site is working fine, but Google is having a hard time crawling it. I tried to do Fetch as Google but on every page, I get an ‘Unreachable’ error. Do I need to do something to the server to help google see my page?
My site is a Laravel based site, using a LAMP server on Ubuntu 14.04.
These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.
Solved. Had a look at my Laravel logs and found a php error. Fixed that and its working smoothly now. Thanks for your input, Woet!
As it shows in the access log, Google gets a 500 Internal Server Error as a response. Check your error logs.
Heres the most recent attempt from a google bot in the access log: “GET / HTTP/1.1” 500 4753 “-” “Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)”