DigitalOcean Kubernetes: new control plane is faster and free, enable HA for 99.95% uptime SLA

Question

How do i unblock SEMrush bot from cloud fare?

I’m trying to audit my site on SEMrush but it is showing me the error that SEMrush bot is blocked from Cloudflare.

Submit an answer

This textbox defaults to using Markdown to format your answer.

You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

Sign In or Sign Up to Answer

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

Want to learn more? Join the DigitalOcean Community!

Join our DigitalOcean community of over a million developers for free! Get help and share knowledge in Q&A, subscribe to topics of interest, and get courses and tools that will help you grow as a developer and scale your project or business.

Sign up now

Bobby Iliev • August 5, 2020

Hi there @annefreeman120,

I believe that what you could do is get in touch with SEMrush support team and ask them for their IP ranges in order to allow them via your Cloudflare firewall.

To allow IP addresses via your CloudFlare firewall you can follow these steps here:

  • Log in to your Cloudflare account.
  • Select your domain.
  • Click the Firewall app.
  • Click on the Tools tab.
  • Under IP Access Rules, enter the following details:
  • Enter the Value as an IP, IP range, or two-letter country code.
  • Select an Action.
  • Select whether the rule applies to This website or All websites in the account.
  • (Optional) add a Note (i.e. SEMrush).
  • Click Add.

Hope that this helps! Regards, Bobby

Try DigitalOcean for free

Click below to sign up and get $100 of credit to try our products over 60 days!

Sign up