Whitelist IP Address?

September 21, 2016 2.7k views
Security Ubuntu

I'm using a service/tool to help improve SEO on my site. They have a feature that crawls the site and analyzes it. Their crawler isn't working on my site. They say it is because my host needs to whitelist a specific ip address. How do I do that?

  • What service/tool are you using? Maybe that should be done under settings of that tool. You can contact support directly, they will be happy to assist you and you will probably get fast response can it be done.

  • Sorry, this is something I really don't know about.
    As far as I see this are bots who crawl your website and analyze data. There could be many reasons.
    I would contact support to check their policy for or against SEMRush.
    Also I read somewhere that mod_security can make problem, if you have it enabled, you should see how you can config it.
    As far as I know mod_security is not enabled in Apache by default

1 Answer

DigitalOcean does not do any blocking of specific IPs by default. I recommend reaching out to the service you are using as this type of error may indicate another reason why they cannot reach your site like a DNS misconfiguratoin.

If you have set up a firewall or have a robots.txt file on your site these would be potential places to check as well.

Have another answer? Share your knowledge.