Question

Robots.txt doesnt update on Google Search Console

I have updated my robots.txt and removed all restrictions for google-bot.

I saw this question and they suggested it might be cdn cache. But I dont have that activated on my digitalocean project.

Why doesnt my robots.txt update? It has been updated for over 2 weeks now and google still doesnt find my new robots.txt.


Submit an answer
Answer a question...

This textbox defaults to using Markdown to format your answer.

You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

Sign In or Sign Up to Answer

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

alexdo
Site Moderator
Site Moderator badge
March 17, 2022

Hello there,

Have you submitted a new request so the site can be re-crawled via the Google Developer tools so you can have the suite re-indexed?

I believe this link should help you to complete the process:

https://developers.google.com/search/docs/advanced/crawling/ask-google-to-recrawl

Hope that this helps!