Report this

What is the reason for this report?

Nginx: Same root folder for multiple website different robots.txt

Posted on August 6, 2021

Hello,

I have a first website with this configuration:

server {
        server_name mywebsite.com;

        root /var/www/website/prod;
...
}

and a second one like this with the same root folder:

server {
        server_name pro.mywebsite.com;

        root /var/www/website/prod;
...
}

And the only problem is they have the same robots.txt file.

Is it possible to tell the second server to link the file robots.txt to another file like robots-pro.txt?

And by the way the url http://pro.mywebsite.com/robots.txt would open the file robots-pro.txt.

Thanks, Vincent.



This textbox defaults to using Markdown to format your answer.

You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

These answers are provided by our Community. If you find them useful, show some love by clicking the heart. If you run into issues leave a comment, or add your own answer to help others.

Hello,

Yes, this is doable with Nginx aliases.

In each server block you could specify the following:

    location /robots.txt { alias /var/www/html/site1-robots.txt ; }

And then just change the site1 part depending on the name of your file for each site accordingly.

Hope that this helps! Regards, Bobby

The developer cloud

Scale up as you grow — whether you're running one virtual machine or ten thousand.

Get started for free

Sign up and get $200 in credit for your first 60 days with DigitalOcean.*

*This promotional offer applies to new accounts only.