Redis client: custom connections manager

Question

I am using spring’s JedisConnectionFactory to manage and connect to Redis from my Java application. JedisConnectionFactory internally uses JedisPool and GenericObjectPool.

Our ask is to create new Redis connections as the pool size exhausts or crosses a certain threshold.

The latest versions of GenericObjectPool does not have option of growing pool size dynamically. I also could not find a way to pass a custom object pool in Jedis.

Is there a way to do this at client side using Jedis ?

KFSys · Answer

Hello, In case someone else stumbles upon the question, unfortunately, there is no built-in way to dynamically grow the connection pool size in Jedis or JedisConnectionFactory. As you mentioned, the latest version of GenericObjectPool does not have this capability, and JedisConnectionFactory does not provide an option to pass a custom object pool. However, you can implement your own dynamic connection pool growth logic using a combination of Jedis and some custom code. Here’s an approach you can consider: Create a custom ConnectionPool class that extends JedisPool and adds dynamic pool growth logic. For example, you can override the getResource() method to check if the pool size has reached a certain threshold, and if so, create a new connection and return it instead of one from the pool. You can also implement a check-in method that releases a connection back to the pool and checks if the pool size can be reduced. In your application code, create an instance of your custom ConnectionPool and pass it to JedisConnectionFactory using the setPoolConfig() method. This will configure JedisConnectionFactory to use your custom connection pool. Here’s an example implementation of a custom ConnectionPool class: import redis.clients.jedis.Jedis; import redis.clients.jedis.JedisPool; import redis.clients.jedis.JedisPoolConfig; public class DynamicConnectionPool extends JedisPool { private static final int DEFAULT_POOL_SIZE = 10; private static final int MAX_POOL_SIZE = 100; public DynamicConnectionPool(String host, int port) { this(host, port, DEFAULT_POOL_SIZE); } public DynamicConnectionPool(String host, int port, int poolSize) { super(new JedisPoolConfig(), host, port); this.internalPool.setMaxTotal(poolSize); } @Override public Jedis getResource() { Jedis jedis = null; if (this.getNumIdle() == 0 && this.getNumActive() < MAX_POOL_SIZE) { jedis = new Jedis(this.getHost(), this.getPort()); } else { jedis = super.getResource(); } return jedis; } public void checkIn(Jedis jedis) { if (this.getNumActive() > this.internalPool.getMaxIdle()) { jedis.close(); } else { super.returnResource(jedis); } } } In this example, the DynamicConnectionPool class extends JedisPool and overrides the getResource() method to create a new Jedis instance if the pool size has reached a certain threshold (MAX_POOL_SIZE). The checkIn() method releases a connection back to the pool and checks if the pool size can be reduced. You can then use the DynamicConnectionPool class in your application code like this: DynamicConnectionPool pool = new DynamicConnectionPool("localhost", 6379, 20); JedisConnectionFactory jedisConnectionFactory = new JedisConnectionFactory(); jedisConnectionFactory.setPoolConfig(pool); This will configure JedisConnectionFactory to use your custom connection pool with a maximum size of 20. You can adjust the pool size and threshold values as needed for your specific use case. I hope this will help

Become a contributor for community

DigitalOcean Documentation

Resources for startups and AI-native businesses

The developer cloud

Start building today

Report this

Redis client: custom connections manager

Related questions

When should I use Kafka vs a simpler queue like Redis for background jobs?

How to Use Redis for Caching and Session Management in Laravel, Django, and Node.js on Ubuntu 24.04 (Self-Hosted and DigitalOcean Managed Re

Managed Redis and multiple app platform instances

How do I know Managed Database planned upgrade schedule?

How Do I Set Up a Queue in Laravel on DigitalOcean?

After adding SSL to my project, Celery is not functioning properly

How to set up django app + redis + celery

Oversized databases considering the load?

I received an warning email from DO stating my redis instance isnt secure and is accessible by any outsider

Rails 7 Action Cable with Puma, Nginx, Docker Swarm

App Platform Flask rq worker

check Redis what commands have been used

Report this

Redis client: custom connections manager

Related questions

When should I use Kafka vs a simpler queue like Redis for background jobs?

How to Use Redis for Caching and Session Management in Laravel, Django, and Node.js on Ubuntu 24.04 (Self-Hosted and DigitalOcean Managed Re

Managed Redis and multiple app platform instances

How do I know Managed Database planned upgrade schedule?

How Do I Set Up a Queue in Laravel on DigitalOcean?

After adding SSL to my project, Celery is not functioning properly

How to set up django app + redis + celery

Oversized databases considering the load?

I received an warning email from DO stating my redis instance isnt secure and is accessible by any outsider

Rails 7 Action Cable with Puma, Nginx, Docker Swarm

App Platform Flask rq worker

check Redis what commands have been used