How to set up django app + redis + celery

Question

I have the Redis server working perfectly locally on my machine. I couldn’t find any proper documentation on deploying it on a digital ocean droplet that is already working. Do I have to create a new droplet for Redis and Celery? And how do I keep my Redis server to an already existing droplet?

I couldn’t interpret what was given in the documentation, so please help code through this.

Bobby · Accepted Answer

Hi there! You don’t necessarily need to create a new Droplet for Redis and Celery; you can set them up on your existing Droplet as long as it has sufficient resources to handle the additional load, in some cases Redis could use quite a bit of resources like RAM. Alternatively, you can also use a Managed Redis cluster instead of running it on a Droplet: https://docs.digitalocean.com/products/databases/redis/ Here’s a step-by-step guide to get you started with a Redis installed on the same Droplet: 1. Installing Redis on Your Droplet SSH into Your Droplet :First, connect to your DigitalOcean droplet via SSH. Install Redis :Update your package lists and install Redis using the following commands: sudo apt-get update sudo apt-get install redis-server Configure Redis (Optional) :If needed, you can configure Redis by editing its configuration file: sudo nano /etc/redis/redis.conf After making changes, restart Redis to apply them: sudo systemctl restart redis.service For more details here is an in-depth guide for this as well: https://www.digitalocean.com/community/tutorials/how-to-install-and-secure-redis-on-ubuntu-20-04 2. Setting Up Celery in Your Django Project Install Celery :Add Celery to your Django project by installing it using pip: pip install celery[redis] Configure Celery :Create a new file celery.py in your Django project’s main module (the same directory as settings.py). from __future__ import absolute_import, unicode_literals import os from celery import Celery from django.conf import settings os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'your_project.settings') app = Celery('your_project') app.config_from_object('django.conf:settings', namespace='CELERY') app.autodiscover_tasks(lambda: settings.INSTALLED_APPS) In your __init__.py file in the same directory, add the following to make sure the app is loaded when Django starts: from __future__ import absolute_import, unicode_literals from .celery import app as celery_app __all__ = ('celery_app',) Update Django Settings :In your settings.py, add the Celery configuration: CELERY_BROKER_URL = 'redis://localhost:6379/0' CELERY_RESULT_BACKEND = 'redis://localhost:6379/0' Adjust the Redis URL if your Redis server is not running on the default port or if it’s running on a different machine. 3. Running Celery Run Celery Worker :In your Django project directory, run the Celery worker: celery -A your_project worker --loglevel=info Run Celery Beat (Optional) :If you have periodic tasks, run Celery Beat: celery -A your_project beat --loglevel=info On another note, to ensure that Redis and Celery run continuously and restart on failure or server reboot, you can set them up as system services using systemd. Create a systemd Service File for Celery :Create a new file, e.g., /etc/systemd/system/celery.service, and add the following configuration (adjust paths and names as needed): [Unit] Description=Celery Service After=network.target [Service] Type=forking User=your_user Group=your_group WorkingDirectory=/path/to/your/django/project ExecStart=/path/to/your/virtualenv/bin/celery -A your_project worker --loglevel=info Restart=always [Install] WantedBy=multi-user.target Enable and Start the Celery Service : sudo systemctl enable celery.service sudo systemctl start celery.service Let me know if you have any questions! Best, Bobby

d6aff7ade9484c73a7686a0eee84e8 · Answer

Can you give guidance on the setup if you have redis / caching on a separate database cluster?

Become a contributor for community

DigitalOcean Documentation

Resources for startups and AI-native businesses

The developer cloud

Start building today

Report this

How to set up django app + redis + celery

Related questions

How to Use Redis for Caching and Session Management in Laravel, Django, and Node.js on Ubuntu 24.04 (Self-Hosted and DigitalOcean Managed Re

Managed Redis and multiple app platform instances

How do I know Managed Database planned upgrade schedule?

How Do I Set Up a Queue in Laravel on DigitalOcean?

After adding SSL to my project, Celery is not functioning properly

Oversized databases considering the load?

I received an warning email from DO stating my redis instance isnt secure and is accessible by any outsider

Rails 7 Action Cable with Puma, Nginx, Docker Swarm

App Platform Flask rq worker

check Redis what commands have been used

Improve Server Settings or Hardware? Woocommerce with Redis & WP Rocket

Woocommerce CDN & cache advice? Spaces CDN for LON1 droplet UK only target audience? Or no CDN just cache?

Report this

How to set up django app + redis + celery

Related questions

How to Use Redis for Caching and Session Management in Laravel, Django, and Node.js on Ubuntu 24.04 (Self-Hosted and DigitalOcean Managed Re

Managed Redis and multiple app platform instances

How do I know Managed Database planned upgrade schedule?

How Do I Set Up a Queue in Laravel on DigitalOcean?

After adding SSL to my project, Celery is not functioning properly

Oversized databases considering the load?

I received an warning email from DO stating my redis instance isnt secure and is accessible by any outsider

Rails 7 Action Cable with Puma, Nginx, Docker Swarm

App Platform Flask rq worker

check Redis what commands have been used

Improve Server Settings or Hardware? Woocommerce with Redis & WP Rocket

Woocommerce CDN & cache advice? Spaces CDN for LON1 droplet UK only target audience? Or no CDN just cache?