Implementation of docker redis5.0 cluster cluster construction

System environment: Ubuntu 16.04LTS

This article uses 6 Docker containers to build a single-machine cluster test. If the actual environment has multiple machines, you can modify the number of containers, port numbers, and cluster IP addresses accordingly. Each machine can follow the same steps as below.

Pull the official redis image

docker pull redis:5.0

Create configuration files and data directories

Create a Directory

mkdir ~/redis_cluster
cd ~/redis_cluster

Create a new template file sudo vim redis_cluster.tmpl and fill in the following content:

# redis port ${PORT}

# Disable protection mode protected-mode no

# Enable cluster cluster-enabled yes

# Cluster node configuration cluster-config-file nodes.conf

#Timeout cluster-node-timeout 5000

# Cluster node IP host mode is the host machine IP
cluster-announce-ip 10.10.100.197

# Cluster node ports 7000 - 7005
cluster-announce-port ${PORT}
cluster-announce-bus-port 1${PORT}

# Enable appendonly backup mode appendonly yes

# Backup every second appendfsync everysec

#Whether to perform synchronization when compressing aof files no-appendfsync-on-rewrite no

# When the current aof file size exceeds 100% of the last rewritten aof file size, it will be rewritten again auto-aof-rewrite-percentage 100

# The minimum size of the AOF file before rewriting is 64mb by default
auto-aof-rewrite-min-size 5120mb

# Disable snapshot backup save ""

To create configuration files and data directories in batches, run the following command in the terminal:

for port in `seq 7000 7005`; do \
 mkdir -p ./${port}/conf \
 && PORT=${port} envsubst < ./redis_cluster.tmpl > ./${port}/conf/redis.conf \
 && mkdir -p ./${port}/data; \
done

Start redis containers in batches

The container's IP address uses the host mode:

for port in `seq 7000 7005`; do \
 docker run -d -it --memory=1G \
 -v ~/redis_cluster/${port}/conf/redis.conf:/usr/local/etc/redis/redis.conf \
 -v ~/redis_cluster/${port}/data:/data \
 --restart always --name redis-${port} --net host \
 --sysctl net.core.somaxconn=1024 redis:5.0 redis-server /usr/local/etc/redis/redis.conf; \
done

Here, --memeory=1G limits the memory size of a single Docker container to 1G. If it exceeds this limit, the process will be killed. During runtime, a warning "Memory limited without swap..." may appear, which can be ignored. If you do not need to limit memory, you can remove the --memeory parameter.

Creating a cluster

Enter any of the containers:

docker exec -it redis-7000 bash

After entering, execute the following command to create a cluster:

redis-cli --cluster create 10.10.100.197:7000 10.10.100.197:7001 10.10.100.197:7002 10.10.100.197:7003 10.10.100.197:7004 10.10.100.197:7005 --cluster-replicas 1

Install the redis-cli command (skip this step if you already have it):

sudo apt install redis-tools

After entering yes, the cluster is created. Exit Docker and log in to one of the nodes to verify the cluster availability:

redis-cli -c -p 7000

Enter cluster nodes to view the cluster status

127.0.0.1:7000> cluster nodes
06851aa134d50096d82a434eced9194233b5204e 10.10.100.197:7003@17003 slave 8b33f273386c9504ef8bd10b005e24825b3b9596 0 1567671901000 4 connected
a42297b65f7101fc9e4941ef8a0e65080d1b6338 10.10.100.197:7005@17005 slave 0aa20378d14e3ef0859815196cbafa67e1001d0e 0 1567671901581 6 connected
e7b6a35b1e92f94c225c507ea19f7f0318f0d1c3 10.10.100.197:7002@17002 master - 0 1567671902582 3 connected 10923-16383
0aa20378d14e3ef0859815196cbafa67e1001d0e 10.10.100.197:7000@17000 myself,master - 0 1567671901000 1 connected 0-5460
8b33f273386c9504ef8bd10b005e24825b3b9596 10.10.100.197:7001@17001 master - 0 1567671902383 2 connected 5461-10922
fe355eed99100197f43d1216d1de82643dd496a5 10.10.100.197:7004@17004 slave e7b6a35b1e92f94c225c507ea19f7f0318f0d1c3 0 1567671901380 5 connected

Set the cluster password

Why don't you write the password in the above steps when you use the template file to batch create configuration files?

Whether in redis 5.x or previous redis versions that use ruby to create a cluster, there is no password parameter configuration in the redis-cli --cluster create process of creating a cluster, so we need to set the password after creating the cluster.

We use the config set method to set the same password for each node (no need to restart redis, and it is still valid after restart). Before that, add w permissions to all redis configuration files, otherwise the password cannot be saved to the file.

Note that the current path is still ~/redis_cluster/:

for port in `seq 7000 7005`; do \
 chmod a+w ./${port}/conf/redis.conf; \
done

Let's use one as an example:

redis-cli -c -p 7000

Set password:

127.0.0.1:7000> config set masterauth 123456
OK
127.0.0.1:7000> config set requirepass 123456
OK
127.0.0.1:7000>auth 123456
OK
127.0.0.1:7000> config rewrite
OK

Perform the same operation on the following devices.

Simple test of cluster writing data

redis-cli -c -p 7003 -a 123456

Write data:

127.0.0.1:7003> set va 1
-> Redirected to slot [7800] located at 10.10.100.197:7001
OK
10.10.100.197:7001> get va
"1"
10.10.100.197:7001> del va
(integer) 1

It can be seen that data written by any node in the cluster can be read by any other node.

At this point, the redis cluster is built.

Other considerations

To access redis from the external network, you may need to open the corresponding port in the firewall;
If you need to delete containers, you can do it in batches:

for port in `seq 7000 7005`; do \
 docker stop redis-${port};
 docker rm redis-${port};
done

The above is the full content of this article. I hope it will be helpful for everyone’s study. I also hope that everyone will support 123WORDPRESS.COM.

You may also be interested in:

How to build a redis cluster using docker
Implementation of Redis master-slave cluster based on Docker
Building a Redis cluster on Docker
How to deploy stand-alone Pulsar and clustered Redis using Docker (development artifact)
Use Docker to build a Redis master-slave replication cluster
Example of how to quickly build a Redis cluster with Docker
How to configure redis sentinel mode in Docker (on multiple servers)
Implementation of Redis one master, two slaves and three sentinels based on Docker
Teach you how to build Redis cluster mode and sentinel mode with docker in 5 minutes

<<: Eight common SQL usage examples in MySQL

>>: Ajax solves cross-domain problem by setting CORS response header to achieve cross-domain case study

Several methods to modify CSS style to achieve gray web pages (no color, only light black and white)

Implementation of docker redis5.0 cluster cluster construction

Several methods to modify CSS style to achieve gray web pages (no color, only light black and white)

5 Reasons Why Responsive Web Design Isn’t Worth It

Detailed explanation of the difference between run/cmd/entrypoint in docker

How to use IDEA to create a web project and publish it to tomcat

HTML Tutorial: Collection of commonly used HTML tags (5)

Detailed explanation of the properties and functions of Vuex

A brief discussion on where the token generated by node using jwt should be stored

Tutorial on how to use profile in MySQL

HTML table tag tutorial (8): background image attribute BACKGROUND

Problems and solutions of error 08001 when linking to MySQL in IDEA and no table display after successful connection

Recommend

Implement QR code scanning function through Vue

A brief discussion on the binary family of JS

Problems with installing mysql and mysql.sock under linux

Detailed explanation of COLLATION examples in MySQL that you may have overlooked

Detailed explanation of MySQL solution to USE DB congestion

How to convert a string into a number in JavaScript

In-depth explanation of modes and environment variables in Vue CLI

jQuery realizes the sliding effect of drop-down menu

A simple method to modify the size of Nginx uploaded files

How to upgrade https under Nginx

Detailed code for implementing 3D tag cloud in Vue

Vue implements a simple calculator

Mybatis fuzzy query implementation method

JS array loop method and efficiency analysis comparison

HTML uses the title attribute to display text when the mouse hovers