I am currently working on running a deep learning model using Redis server, and for its optimisation, I was wondering if there is a way to run Redis server on multiple nodes, since redis is single threaded.
You can definitely run multiple instances of Redis on one node, just use:
redis-server --port 6380
You can then test with redis-cli -p 6380
. Avoid running more instances than cores.
You can split your workload by application scopes. Or you can use Redis Cluster. It is a common pattern to use one node to run both a master instance and a replica instance of another master.
Be sure to look at hash tags for cases where you need multi-key operations.