Tutorial

How To Serve Django Applications with uWSGI and Nginx on Ubuntu 16.04

How To Serve Django Applications with uWSGI and Nginx on Ubuntu 16.04

Introduction

Django is a powerful web framework that can help you get your Python application or website off the ground. Django includes a simplified development server for testing your code locally, but for anything even slightly production related, a more secure and powerful web server is required.

In this guide, we will demonstrate how to install and configure some components on Ubuntu 16.04 to support and serve Django applications. We will configure the uWSGI application container server to interface with our applications. We will then set up Nginx to reverse proxy to uWSGI, giving us access to its security and performance features to serve our apps.

Prerequisites and Goals

In order to complete this guide, you should have a fresh Ubuntu 16.04 server instance with a non-root user with sudo privileges configured. You can learn how to set this up by running through our initial server setup guide.

We will be installing Django within two different virtual environments. This will allow your projects and their requirements to be handled separately. We will be creating two sample projects so that we can run through the steps in a multi-project environment.

Once we have our applications, we will install and configure the uWSGI application server. This will serve as an interface to our applications which will translate client requests using HTTP to Python calls that our application can process. We will then set up Nginx in front of uWSGI to take advantage of its high performance connection handling mechanisms and its easy-to-implement security features.

Let’s get started.

Install and Configure VirtualEnv and VirtualEnvWrapper

We will be installing our Django projects in their own virtual environments to isolate the requirements for each. To do this, we will be installing virtualenv, which can create Python virtual environments, and virtualenvwrapper, which adds some usability improvements to the virtualenv work flow.

We will be installing both of these components using pip, the Python package manager. We can install this utility from the Ubuntu repositories.

If you are building your Django projects with Python 2, type:

  1. sudo apt-get update
  2. sudo apt-get install python-pip

If you are using Python 3, type:

  1. sudo apt-get update
  2. sudo apt-get install python3-pip

Now that you have pip installed, we can install virtualenv and virtualenvwrapper globally. We will also upgrade pip to the latest version using pip itself.

If you are using Python 2, type:

  1. sudo -H pip install --upgrade pip
  2. sudo -H pip install virtualenv virtualenvwrapper

If you are using Python 3, type:

  1. sudo -H pip3 install --upgrade pip
  2. sudo -H pip3 install virtualenv virtualenvwrapper

With these components installed, we can now configure our shell with the information it needs to work with the virtualenvwrapper script. Our virtual environments will all be placed within a directory in our home folder called Env for easy access. This is configured through an environmental variable called WORKON_HOME. We can add this to our shell initialization script and can source the virtual environment wrapper script.

If you are using Python 3 and the pip3 command, you will have to add an additional line to your shell initialization script as well:

  1. echo "export VIRTUALENVWRAPPER_PYTHON=/usr/bin/python3" >> ~/.bashrc

Regardless of which version of Python you are using, you need to run the following commands:

  1. echo "export WORKON_HOME=~/Env" >> ~/.bashrc
  2. echo "source /usr/local/bin/virtualenvwrapper.sh" >> ~/.bashrc

Now, source your shell initialization script so that you can use this functionality in your current session:

  1. source ~/.bashrc

You should now have directory called Env in your home folder which will hold virtual environment information.

Create Django Projects

Now that we have our virtual environment tools, we will create two virtual environments, install Django in each, and start two projects.

Create the First Project

We can create a virtual environment easily by using some commands that the virtualenvwrapper script makes available to us.

Create your first virtual environment with the name of your first site or project by typing:

  1. mkvirtualenv firstsite

This will create a virtual environment, install Python and pip within it, and activate the environment. Your prompt will change to indicate that you are now operating within your new virtual environment. It will look something like this: (firstsite)user@hostname:~$. The value in the parentheses is the name of your virtual environment. Any software installed through pip will now be installed into the virtual environment instead of on the global system. This allows us to isolate our packages on a per-project basis.

Our first step will be to install Django itself. We can use pip for this without sudo since we are installing this locally in our virtual environment:

  1. pip install django

With Django installed, we can create our first sample project by typing:

  1. cd ~
  2. django-admin.py startproject firstsite

This will create a directory called firstsite within your home directory. Within this is a management script used to handle various aspects of the project and another directory of the same name used to house the actual project code.

Move into the first level directory so that we can begin setting up the minimum requirements for our sample project.

  1. cd ~/firstsite

Begin by migrating the database to initialize the SQLite database that our project will use. You can set up an alternative database for your application if you wish, but this is outside of the scope of this guide:

  1. ~/firstsite/manage.py migrate

You should now have a database file called db.sqlite3 in your project directory. Now, we can create an administrative user by typing:

  1. ~/firstsite/manage.py createsuperuser

At this point, your project directory (~/firstsite in our case) should have the following content:

  • ~/firstsite/manage.py: A Django project management script.
  • ~/firstsite/firstsite/: The Django project package. This should contain the __init__.py, settings.py, urls.py, and wsgi.py files.
  • ~/firstsite/db.sqlite3: The SQLite database file used to store your site information.

Next, open the settings file for the project with your text editor:

  1. nano ~/firstsite/firstsite/settings.py

Start by locating the ALLOWED_HOSTS directive. This defines a list of the server’s addresses or domain names that may be used to connect to the Django instance. Any incoming requests with a Host header that is not in this list will raise an exception. Django requires that you set this to prevent a certain class of security vulnerability.

In the square brackets, list the IP addresses or domain names that are associated with your Django server. Each item should be listed in quotations with entries separated by a comma. If you wish requests for an entire domain and any subdomains, prepend a period to the beginning of the entry. In the snippet below, there are a few commented out examples used to demonstrate:

~/firstsite/firstsite/settings.py
. . .
# The simplest case: just add the domain name(s) and IP addresses of your Django server
# ALLOWED_HOSTS = [ 'example.com', '203.0.113.5']
# To respond to 'example.com' and any subdomains, start the domain with a dot
# ALLOWED_HOSTS = ['.example.com', '203.0.113.5']
ALLOWED_HOSTS = ['your_server_domain_or_IP', 'second_domain_or_IP', . . .]

Since we will be setting up Nginx to serve our site, we need to configure a directory which will hold our site’s static assets. This will allow Nginx to serve these directly, which will have a positive impact on performance. We will tell Django to place these into a directory called static in our project’s base directory. Add this line to the bottom of the file to configure this behavior:

~/firstsite/firstsite/settings.py
. . .
STATIC_URL = '/static/'
STATIC_ROOT = os.path.join(BASE_DIR, 'static/')

Save and close the file when you are finished. Now, collect our site’s static elements and place them within that directory by typing:

  1. ~/firstsite/manage.py collectstatic

You may be asked to type “yes” to confirm the action and collect the static content. There will be a new directory called static in your project directory.

Next, we can open a port so that we can access the Django development server. If you followed the initial server setup guide, you should have a UFW firewall enabled. Allow connections to port 8080 by typing:

  1. sudo ufw allow 8080

With all of that out of the way, we can test our project by temporarily starting the development server. Type:

  1. ~/firstsite/manage.py runserver 0.0.0.0:8080

This will start up the development server on port 8080. Visit your server’s domain name or IP address followed by 8080 in your browser:

http://server_domain_or_IP:8080

You should see a page that looks like this:

Django sample site

Add /admin to the end of the URL in your browser’s address bar and you will be taken to the admin login page:

Django admin login

Using the administrative login credentials you selected with the createsuperuser command, log into the server. You will then have access to the administration interface:

Django admin interface

After testing this functionality out, stop the development server by typing CTRL-C in your terminal. We can now move on to our second project.

Create the Second Project

The second project will be created in exactly the same way as the first. We will abridge the explanation in this section, seeing as how you have already completed this once.

Move back to your home directory and create a second virtual environment for your new project. Install Django inside of this new environment once it is activated:

  1. cd ~
  2. mkvirtualenv secondsite
  3. pip install django

The new environment will be created and changed to, leaving your previous virtual environment. This Django instance is entirely separate from the other one you configured. This allows you to manage them independently and customize as necessary.

Create the second project and move into the project directory:

  1. cd ~
  2. django-admin.py startproject secondsite
  3. cd ~/secondsite

Initialize the database and create an administrative user:

  1. ~/secondsite/manage.py migrate
  2. ~/secondsite/manage.py createsuperuser

Open the settings file:

  1. nano ~/secondsite/secondsite/settings.py

Set the ALLOWED_HOSTS to your second project’s domain, the server’s IP address, or both, just like you did with the first project:

ALLOWED_HOSTS = ['second_project_domain_or_IP', 'another_domain_or_IP', . . .]

Add the location for the static files, just as you did in the previous project:

~/secondsite/secondsite/settings.py
. . .
STATIC_URL = '/static/'
STATIC_ROOT = os.path.join(BASE_DIR, 'static/')

Save and close the file. Now, collect the static elements into that directory by typing:

  1. ~/secondsite/manage.py collectstatic

Finally, fire up the development server to test out the site:

  1. ~/secondsite/manage.py runserver 0.0.0.0:8080

You should check the regular site at:

http://server_domain_or_IP:8080

Also log into the admin site:

http://server_domain_or_IP:8080/admin

When you’ve confirmed that everything is working as expected, type CTRL-C in your terminal to stop the development server.

Backing Out of the Virtual Environment

Since we are now done with the Django portion of the guide, we can deactivate our second virtual environment:

  1. deactivate

If you need to work on either of your Django sites again, you should reactivate their respective environments. You can do that by using the workon command:

  1. workon firstsite

Or:

  1. workon secondsite

Again, deactivate when you are finished working on your sites:

  1. deactivate

We can now move on to configuring the application server.

Setting up the uWSGI Application Server

Now that we have two Django projects set up and ready to go, we can configure uWSGI. uWSGI is an application server that can communicate with applications over a standard interface called WSGI. To learn more about this, read this section of our guide on setting up uWSGI and Nginx on Ubuntu 14.04.

Installing uWSGI

Unlike the guide linked above, in this tutorial, we will be installing uWSGI globally. This will create less friction in handling multiple Django projects. Before we can install uWSGI, we need the Python development files that the software relies on. We can install this directly from Ubuntu’s repositories.

If you are using Django with Python 2, type:

  1. sudo apt-get install python-dev

If you are using Python 3, type:

  1. sudo apt-get install python3-dev

Now that the development files are available, we can install uWSGI globally through pip.

If you are using Python 2, type:

  1. sudo -H pip install uwsgi

If you are using Python 3, type:

  1. sudo -H pip3 install uwsgi

We can quickly test this application server by passing it the information for one of our sites. For instance, we can tell it to serve our first project by typing:

  1. uwsgi --http :8080 --home /home/sammy/Env/firstsite --chdir /home/sammy/firstsite -w firstsite.wsgi

Here, we’ve told uWSGI to use our virtual environment located in our ~/Env directory, to change to our project’s directory, and to use the wsgi.py file stored within our inner firstsite directory to serve the file (using the firstsite.wsgi Python module syntax). For our demonstration, we told it to serve HTTP on port 8080.

If you go to server’s domain name or IP address in your browser, followed by :8080, you will see your site again (the static elements in the /admin interface, like CSS, won’t work yet). When you are finished testing out this functionality, type CTRL-C in the terminal.

Creating Configuration Files

Running uWSGI from the command line is useful for testing, but isn’t particularly helpful for an actual deployment. Instead, we will run uWSGI in “Emperor mode”, which allows a master process to manage separate applications automatically given a set of configuration files.

Create a directory that will hold your configuration files. Since this is a global process, we will create a directory called /etc/uwsgi/sites to store our configuration files:

  1. sudo mkdir -p /etc/uwsgi/sites

In this directory, we will place our configuration files. We need a configuration file for each of the projects we are serving. The uWSGI process can take configuration files in a variety of formats, but we will use .ini files due to their simplicity.

Create a file for your first project and open it in your text editor:

  1. sudo nano /etc/uwsgi/sites/firstsite.ini

Inside, we must begin with the [uwsgi] section header. All of our information will go beneath this header. We are also going to use variables to make our configuration file more reusable. After the header, set a variable called project with the name of your first project. Add a variable called uid which holds your sudo username.

We will also add a variable called base with the path to your user’s home directory. This will be constructed from the username we set using the %(variable_name) syntax. This will be replaced by the value of the variable when the config is read:

/etc/uwsgi/sites/firstsite.ini
[uwsgi]
project = firstsite
uid = sammy
base = /home/%(uid)

Next, we need to configure uWSGI so that it handles our project correctly. We need to change into the root project directory by setting the chdir option. We can combine the home directory and project name using the same variable syntax.

In a similar way, we will indicate the virtual environment for our project. By setting the module, we can indicate exactly how to interface with our project (by importing the “application” callable from the wsgi.py file within our inner project directory). The configuration of these items will look like this:

/etc/uwsgi/sites/firstsite.ini
[uwsgi]
project = firstsite
uid = sammy
base = /home/%(uid)

chdir = %(base)/%(project)
home = %(base)/Env/%(project)
module = %(project).wsgi:application

We want to create a master process with 5 workers. We can do this by adding this:

/etc/uwsgi/sites/firstsite.ini
[uwsgi]
project = firstsite
uid = sammy
base = /home/%(uid)

chdir = %(base)/%(project)
home = %(base)/Env/%(project)
module = %(project).wsgi:application

master = true
processes = 5

Next we need to specify how uWSGI should listen for connections. In our test of uWSGI, we used HTTP and a network port. However, since we are going to be using Nginx as a reverse proxy, we have better options.

Instead of using a network port, since all of the components are operating on a single server, we can use a Unix socket. This is more secure and offers better performance. This socket will not use HTTP, but instead will implement uWSGI’s uwsgi protocol, which is a fast binary protocol for designed for communicating with other servers. Nginx can natively proxy using the uwsgi protocol, so this is our best choice.

We will also modify the ownership and permissions of the socket because we will be giving the web server write access. We’ll set the vacuum option so that the socket file will be automatically cleaned up when the service is stopped:

/etc/uwsgi/sites/firstsite.ini
[uwsgi]
project = firstsite
uid = sammy
base = /home/%(uid)

chdir = %(base)/%(project)
home = %(base)/Env/%(project)
module = %(project).wsgi:application

master = true
processes = 5

socket = /run/uwsgi/%(project).sock
chown-socket = %(uid):www-data
chmod-socket = 660
vacuum = true

With this, our first project’s uWSGI configuration is complete. Save and close the file.

The advantage of setting up the file using variables is that it makes it incredibly simple to reuse. Copy your first project’s configuration file to use as a base for your second configuration file:

  1. sudo cp /etc/uwsgi/sites/firstsite.ini /etc/uwsgi/sites/secondsite.ini

Open the second configuration file with your text editor:

  1. sudo nano /etc/uwsgi/sites/secondsite.ini

We only need to change a single value in this file in order to make it work for our second project. Modify the project variable with the name you’ve used for your second project:

/etc/uwsgi/sites/secondsite.ini
[uwsgi]
project = secondsite
uid = sammy
base = /home/%(uid)

chdir = %(base)/%(project)
home = %(base)/Env/%(project)
module = %(project).wsgi:application

master = true
processes = 5

socket = /run/uwsgi/%(project).sock
chown-socket = %(uid):www-data
chmod-socket = 660
vacuum = true

Save and close the file when you are finished. Your second project should be ready to go now.

Create a systemd Unit File for uWSGI

We now have the configuration files we need to serve our Django projects, but we still haven’t automated the process. Next, we’ll create a systemd unit file to manage the uWSGI emperor process and automatically start uWSGI at boot.

We will create the unit file in the /etc/systemd/system directory, where administrator-created unit files are kept. We will call our file uwsgi.service:

  1. sudo nano /etc/systemd/system/uwsgi.service

Start with the [Unit] section, which is used to specify metadata and ordering information. We’ll simply put a description of our service here:

/etc/systemd/system/uwsgi.service
[Unit]
Description=uWSGI Emperor service

Next, we will open up the [Service] section. We’ll use the ExecStartPre directive to set up the pieces we need to run our server. This will make sure the /run/uwsgi directory is created and that our normal user owns it with the www-data group as the group owner. Both mkdir with the -p flag and the chown command return successfully even if their operation is not needed. This is what we want.

For the actual start command, specified by the ExecStart directive, we will point to the uwsgi executable. We will tell it to run in “Emperor mode”, allowing it to manage multiple applications using the files it finds in /etc/uwsgi/sites. We will also add the pieces needed for systemd to correctly manage the process. These are taken from the uWSGI documentation here.

/etc/systemd/system/uwsgi.service
[Unit]
Description=uWSGI Emperor service

[Service]
ExecStartPre=/bin/bash -c 'mkdir -p /run/uwsgi; chown sammy:www-data /run/uwsgi'
ExecStart=/usr/local/bin/uwsgi --emperor /etc/uwsgi/sites
Restart=always
KillSignal=SIGQUIT
Type=notify
NotifyAccess=all

Now, all we need to do is add the [Install] section. This allows us to specify when the service should be automatically started. We will tie our service to the multi-user system state. Whenever the system is set up for multiple users (the normal operating condition), our service will be activated:

/etc/systemd/system/uwsgi.service
[Unit]
Description=uWSGI Emperor service

[Service]
ExecStartPre=/bin/bash -c 'mkdir -p /run/uwsgi; chown sammy:www-data /run/uwsgi'
ExecStart=/usr/local/bin/uwsgi --emperor /etc/uwsgi/sites
Restart=always
KillSignal=SIGQUIT
Type=notify
NotifyAccess=all

[Install]
WantedBy=multi-user.target

When you are finished, save and close the file.

We will be unable to start the service successfully at this point because it relies on the www-data user being available. We will have to wait to start the uWSGI service until after Nginx is installed.

Install and Configure Nginx as a Reverse Proxy

With uWSGI configured and ready to go, we can now install and configure Nginx as our reverse proxy. This can be downloaded from Ubuntu’s default repositories:

  1. sudo apt-get install nginx

Once Nginx is installed, we can go ahead and create a server block configuration file for each of our projects. Start with the first project by creating a server block configuration file:

  1. sudo nano /etc/nginx/sites-available/firstsite

Inside, we can start our server block by indicating the port number and domain name where our first project should be accessible. The server_name block must match one of the server’s domain names or its IP address or else the default Nginx page may be used instead. We’ll assume that you have a domain name for each:

/etc/nginx/sites-available/firstsite
server {
    listen 80;
    server_name firstsite.com www.firstsite.com;
}

Next, we can tell Nginx not to worry if it can’t find a favicon. We will also point it to the location of our static files directory where we collected our site’s static elements:

/etc/nginx/sites-available/firstsite
server {
    listen 80;
    server_name firstsite.com www.firstsite.com;

    location = /favicon.ico { access_log off; log_not_found off; }
    location /static/ {
        root /home/sammy/firstsite;
    }
}

Next we can create a catch-all location block that will pass all additional queries straight to our application. We will include the uwsgi parameters found in the /etc/nginx/uwsgi_params and pass the traffic to the socket that the uWSGI server sets up:

/etc/nginx/sites-available/firstsite
server {
    listen 80;
    server_name firstsite.com www.firstsite.com;

    location = /favicon.ico { access_log off; log_not_found off; }
    location /static/ {
        root /home/sammy/firstsite;
    }

    location / {
        include         uwsgi_params;
        uwsgi_pass      unix:/run/uwsgi/firstsite.sock;
    }
}

With that, our first server block is complete.

We will use this as a basis for our second project’s Nginx configuration file. Copy it over now:

  1. sudo cp /etc/nginx/sites-available/firstsite /etc/nginx/sites-available/secondsite

Open the new file in your text editor:

  1. sudo nano /etc/nginx/sites-available/secondsite

Here, you’ll have to change any reference to firstsite with a reference to secondsite. You’ll also have to modify the server_name so that your second project responds to a different domain name or change the port if you don’t have more than one domain name or IP address. When you are finished, it will look something like this:

/etc/nginx/sites-available/secondsite
server {
    listen 80;
    server_name secondsite.com www.secondsite.com;

    location = /favicon.ico { access_log off; log_not_found off; }
    location /static/ {
        root /home/sammy/secondsite;
    }

    location / {
        include         uwsgi_params;
        uwsgi_pass      unix:/run/uwsgi/secondsite.sock;
    }
}

Save and close the file when you are finished.

Next, link both of your new configuration files to Nginx’s sites-enabled directory to enable them:

  1. sudo ln -s /etc/nginx/sites-available/firstsite /etc/nginx/sites-enabled
  2. sudo ln -s /etc/nginx/sites-available/secondsite /etc/nginx/sites-enabled

Check the configuration syntax by typing:

  1. sudo nginx -t

If no syntax errors are detected, you can restart your Nginx service to load the new configuration:

  1. sudo systemctl restart nginx

If you remember from earlier, we never actually started the uWSGI server. Do that now by typing:

  1. sudo systemctl start uwsgi

Let’s delete the UFW rule to port 8080 and instead allow access to our Nginx server:

  1. sudo ufw delete allow 8080
  2. sudo ufw allow 'Nginx Full'

You should now be able to reach your two projects by going to their respective domain names. Both the public and administrative interfaces should work as expected.

If this goes well, you can enable both of the services to start automatically at boot by typing:

  1. sudo systemctl enable nginx
  2. sudo systemctl enable uwsgi

Note

After configuring Nginx, the next step should be securing traffic to the server using SSL/TLS. This is important because without it, all information, including passwords are sent over the network in plain text.

If you have a domain name, the easiest way get an SSL certificate to secure your traffic is using Let’s Encrypt. Follow this guide to set up Let’s Encrypt with Nginx on Ubuntu 16.04.

If you do not have a domain name, you can still secure your site for testing and learning with a self-signed SSL certificate.

Troubleshooting Nginx and uWSGI

If you are not able to access your application, you will need to troubleshoot your installation.

Nginx Is Showing the Default Page Instead of the Django Application

If Nginx displays the default page instead of proxying to your application, it usually means that you need to adjust the server_name within the /etc/nginx/sites-available/firstsite file to point to your server’s IP address or domain name.

Nginx uses the server_name to determine which server block to use to respond to requests. If you are seeing the default Nginx page, it is a sign that Nginx wasn’t able to match the request to a sever block explicitly, so it’s falling back on the default block defined in /etc/nginx/sites-available/default.

The server_name in your project’s server block must be more specific than the one in the default server block to be selected.

Nginx Is Displaying a 502 Bad Gateway Error Instead of the Django Application

A 502 error indicates that Nginx is unable to successfully proxy the request. A wide range of configuration problems express themselves with a 502 error, so more information is required to troubleshoot properly.

The primary place to look for more information is in Nginx’s error logs. Generally, this will tell you what conditions caused problems during the proxying event. Follow the Nginx error logs by typing:

  1. sudo tail -F /var/log/nginx/error.log

Now, make another request in your browser to generate a fresh error (try refreshing the page). You should see a fresh error message written to the log. If you look at the message, it should help you narrow down the problem.

You might see some of the following message:

connect() to unix:/run/uwsgi/firstsite.sock failed (2: No such file or directory)

This indicates that Nginx was unable to find the socket file at the given location. You should compare the uwsgi_pass location defined in the firstsite and secondsite files in /etc/nginx/sites-available file to the actual location of the firstsite.sock and secondsite.sock socket files in the /run/uwsgi directory.

Check for the existence of the socket files within the /run/uwsgi directory by typing:

  1. sudo ls /run/uwsgi

If there are no socket files in /run/uwsgi, it generally means that the uwsgi process was unable to create it. Check the status of the uwsgi process to find out whether it was able to start:

  1. sudo systemctl status uwsgi

If the systemctl status command indicated that an error occurred or if you do not find the socket files in the directory, it’s an indication that uWSGI was not able to start correctly. Check the uWSGI process logs by typing:

  1. sudo journalctl -u uwsgi

Take a look at the messages in the logs to find out where uWSGI ran into problems. There are many reasons that you may have run into problems, but often, if uWSGI was unable to create the socket file, it is for one of these reasons:

  • The project files are owned by the root user instead of a sudo user
  • The ExecStartPre line in the /etc/systemd/system/uwsgi.service file does not include the correct command to create the directory and assign ownership
  • The uwsgi_pass path in the site configuration files in the /etc/nginx/sites-available directory are not aimed at the correct socket location
  • The uWSGI configuration defined in the .ini files within the /etc/uwsgi/sites directory is incorrect. Check the following items:
    • The chdir directive, once interpolated, points to the main project directory.
    • The home directive, once interpolated, points to the virtual environment directory.
    • The module directive uses the Python module import syntax to load the wsgi.py file from within the inner project directory.
    • The socket directive points a file in the /run/uwsgi file (that should be created by ExecStartPre line in the service file mentioned above).

If you make changes to the /etc/systemd/system/uwsgi.service file, reload the daemon to reread the service definition and restart the uWSGI process by typing:

  1. sudo systemctl daemon-reload
  2. sudo systemctl restart uwsgi

Fixing these issues should allow Nginx to find the socket file correctly.

connect() to unix:/run/uwsgi/firstsite.sock failed (13: Permission denied)

This indicates that Nginx was unable to connect to the uWSGI socket because of permissions problems. Usually, this happens when the socket is being created in a restricted environment or if the permissions were wrong. While the uWSGI process is able to create the socket file, Nginx is unable to access it.

This can happen if there are limited permissions at any point between the root directory (/) the socket file. We can see the permissions and ownership values of the socket file and each of its parent directories by passing the absolute path to our socket file to the namei command:

  1. namei -nom /run/uwsgi/firstsite.sock
Output
f: /run/uwsgi/firstsite.sock drwxr-xr-x root root / drwxr-xr-x root root run drwxr-xr-x sammy www-data uwsgi srw-rw---- sammy www-data firstsite.sock

The output displays the permissions of each of the directory components. By looking at the permissions (first column), owner (second column) and group owner (third column), we can figure out what type of access is allowed to the socket file.

In the above example, each of the directories leading up to the socket file have world read and execute permissions (the permissions column for the directories end with r-x instead of ---). The www-data group has group ownership over the socket itself. With these settings, Nginx process should be able to access the socket successfully.

If any of the directories leading up to the socket are not owned by the www-data group or do not have world read and execute permission, Nginx will not be able to access the socket. Usually, this means that the configuration files have a mistake.

If the directory paths have too restrictive of permissions or ownership, look at the /etc/systemd/system/uwsgi.service file. The ExecStartPre directive is responsible for creating the /run/uwsgi directory and assigning group ownership to the www-data group. If the commands here are not correct, the directory paths might be too restrictive.

If the socket file itself is inaccessible to the Nginx process, the settings defined in the .ini files within /etc/uwsgi/sites may be incorrect. Check the values of chown-socket and chmod-socket to make sure that the web process is given permission to access the files.

Further Troubleshooting

For additional troubleshooting, the logs can help narrow down root causes. Check each of them in turn and look for messages indicating problem areas.

The following logs may be helpful:

  • Check the Nginx process logs by typing: sudo journalctl -u nginx
  • Check the Nginx access logs by typing: sudo less /var/log/nginx/access.log
  • Check the Nginx error logs by typing: sudo less /var/log/nginx/error.log
  • Check the uWSGI application logs by typing: sudo journalctl -u uwsgi

As you update your configuration or application, you will likely need to restart the processes to adjust to your changes.

If you update your Django application, you can restart the uWSGI process to pick up the changes by typing:

  1. sudo systemctl restart uwsgi

If you change uwsgi systemd service file, reload the daemon and restart the process by typing:

  1. sudo systemctl daemon-reload
  2. sudo systemctl restart uwsgi

If you change the Nginx server block configuration, test the configuration and then Nginx by typing:

  1. sudo nginx -t && sudo systemctl restart nginx

These commands are helpful for picking up changes as you adjust your configuration.

Conclusion

In this guide, we’ve set up two Django projects, each in their own virtual environments. We’ve configured uWSGI to serve each project independently using the virtual environment configured for each. Afterwards, we set up Nginx to act as a reverse proxy to handle client connections and serve the correct project depending on the client request.

Django makes creating projects and applications simple by providing many of the common pieces, allowing you to focus on the unique elements. By leveraging the general tool chain described in this article, you can easily serve the applications you create from a single server.

Thanks for learning with the DigitalOcean Community. Check out our offerings for compute, storage, networking, and managed databases.

Learn more about us


About the authors

Still looking for an answer?

Ask a questionSearch for more help

Was this helpful?
 
10 Comments


This textbox defaults to using Markdown to format your answer.

You can type !ref in this text area to quickly search our full set of tutorials, documentation & marketplace offerings and insert the link!

I did all the steps but my domain is showing Welcome to nginx!

Could you add a comment on how i should enable www-data? i think this step isnt really talked about I also think i don’t have it enabled on a fresh server.

I spent a bunch of time chasing down this error so I wanted to leave the solution here in case anyone else runs into it (and it might be worth fixing this guide):

I kept getting an error when trying to run uWSGI: Fatal Python error: Py_Initialize: Unable to get the locale encoding ImportError: No module named ‘encodings’

Eventually I traced this to the concept that the Python versions were not matching up. And finally I discovered this is because I was following the Python 3 directions in this guide but there was no alternate option for installing Django with Python 3. So this line: “pip install django” should actually be “pip3 install django” if you are trying to run everything with Python 3.

Maybe I should have figured that out earlier, but since there were alternate directions for each version everywhere else but not here it fooled me and sent me on a long chase to figure out the answer. After deleting that environment and using pip3 to install Django the error disappeared.

Really great tutorial, I have a question that i’m developing APIs using django/django-rest-framework so do i need both nginx and uwsgi for production evironment or i can just use the UWSGI?

I have been dealing with this problem, has anyone submitted? Thank you

2020/06/10 01:43:31 [error] 9806#9806: *1 connect() to unix:/run/uwsgi/mysite.sock failed (111: Connection refused) while connecting to upstream, client: 192.168.1.46, server: 172.16.12.239, request: "GET / HTTP/1.1", upstream: "uwsgi://unix:/run/uwsgi/mysite.sock:", host: "172.16.12.239"

Can you please update this tutorial for Ubuntu 18.04? Or are the steps still the same for 18.04?

Quick note that installing uWsgi globally is a mistake, particularly if managing multiple django projects. Instead, uwsgi should be installed in the project’s virtual environment.

I used this guide a few years ago to set up some django environments in production and staging. When it came time to update python recently, I had to change the /etc/systemd/system/uwsgi.service file’s line ExecStart= to reflect the path to the uwsgi binary in the virtualenv.

thank you!!!, it worked!!!

best tutorial! especially the troubleshooting section at the bottom. it would be great if there were instructions on how to configure the django project with production environment variables, etc. thanks either way!

Everything is fine. I have make an API and I send a GET request. It works for me when I run the command:

uwsgi --http :8080 --home /home/carlos/Env/alfred --chdir /home/carlos/project/alfrednluapi -w alfredapi.wsgi

but at the moment to access in the browser I have this error:

Internal Server Error

I have no error in /var/log/nginx/error.log

Previously I had other application running in port 80 but now My API is running in porto 80, It can be accessed here

http://209.97.143.4/interpret/nlu?text=hello [this give an error]

[EDIT] Well I can run this on the web console… I can be teste here, this is what I want but I prefer to do it with uwsgi

http://209.97.143.4:8080/interpreter/nlu/?text=hey [this works fine]

● uwsgi.service - uWSGI Emperor service Loaded: loaded (/etc/systemd/system/uwsgi.service; enabled; vendor preset: enabled) Active: active (running) since Mon 2018-08-27 12:12:12 UTC; 49min ago Process: 4117 ExecStartPre=/bin/bash -c mkdir -p /run/uwsgi; chown ubuntu:www-data /run/uwsgi (code=exited, status=0/SUCCESS) Main PID: 4125 (uwsgi) Status: “The Emperor is governing 0 vassals” Tasks: 1 Memory: 3.5M CPU: 639ms CGroup: /system.slice/uwsgi.service └─4125 /usr/local/bin/uwsgi --emperor /etc/uwsgi/sites

Aug 27 13:01:07 ip-x-x-x- uwsgi[4125]: uwsgi socket 0 bound to UNIX address /run/uwsgi/lp.sock fd 3 Aug 27 13:01:07 ip-x-x-x- uwsgi[4125]: setuid() to 1000 Aug 27 13:01:07 ip-x-x-x- uwsgi[4125]: Python version: 3.6.5 (default, Aug 23 2018, 11:35:47) [GCC 5.4.0 20160609] Aug 27 13:01:07 ip-x-x-x- uwsgi[4125]: !!! Python Home is not a directory: /home/ubuntu/.virtualenv/lp !!! Aug 27 13:01:07 ip-x-x-x- uwsgi[4125]: Set PythonHome to /home/ubuntu/.virtualenv/lp Aug 27 13:01:07 ip-x-x-x- uwsgi[4125]: Fatal Python error: Py_Initialize: Unable to get the locale encoding Aug 27 13:01:07 ip-x-x-x- uwsgi[4125]: ModuleNotFoundError: No module named ‘encodings’ Aug 27 13:01:07 ip-x-x-x- uwsgi[4125]: Current thread 0x00007fdff8575700 (most recent call first): Aug 27 13:01:07 ip-x-x-x- uwsgi[4125]: Mon Aug 27 13:01:07 2018 - [emperor] curse the uwsgi instance lp.ini (pid: 4623) Aug 27 13:01:10 ip-x-x-x- uwsgi[4125]: Mon Aug 27 13:01:10 2018 - [emperor] removed uwsgi instance lp.ini

I am getting the above error

Try DigitalOcean for free

Click below to sign up and get $200 of credit to try our products over 60 days!

Sign up

Join the Tech Talk
Success! Thank you! Please check your email for further details.

Please complete your information!

Get our biweekly newsletter

Sign up for Infrastructure as a Newsletter.

Hollie's Hub for Good

Working on improving health and education, reducing inequality, and spurring economic growth? We'd like to help.

Become a contributor

Get paid to write technical tutorials and select a tech-focused charity to receive a matching donation.

Welcome to the developer cloud

DigitalOcean makes it simple to launch in the cloud and scale up as you grow — whether you're running one virtual machine or ten thousand.

Learn more
DigitalOcean Cloud Control Panel