3.3 部署mysql集群

3.3.1 创建namespace

在本地windows机器所安装的kubectl工具所在的目录，创建名为”mariadb”的namespace，指令为：kubectl create namespace mariadb

3.3 部署mysql集群 - 图1

3.3.2 创建etcd-cluster

创建mysql集群中的集群网络环境，用于主从节点之间的通信。

在本地windows机器所安装的kubectl工具所在的目录，创建etcd-cluster.yml文件，然后执行如下指令：

kubectl create -f etcd-cluster.yml -n mariadb

  1. apiVersion: v1
  2. kind: Service
  3. metadata:
  4.   name: etcd-client
  5. spec:
  6.   ports:
  7.   - name: etcd-client-port
  8.     port: 2379
  9.     protocol: TCP
  10.     targetPort: 2379
  11.   selector:
  12.     app: etcd
  14. ---
  16. apiVersion: v1
  17. kind: Pod
  18. metadata:
  19.   labels:
  20.     app: etcd
  21.     etcd_node: etcd0
  22.   name: etcd0
  23. spec:
  24.   containers:
  25.   - command:
  26.     - /usr/local/bin/etcd
  27.     - --name
  28.     - etcd0
  29.     - --initial-advertise-peer-urls
  30.     - http://etcd0:2380
  31.     - --listen-peer-urls
  32.     - http://0.0.0.0:2380
  33.     - --listen-client-urls
  34.     - http://0.0.0.0:2379
  35.     - --advertise-client-urls
  36.     - http://etcd0:2379
  37.     - --initial-cluster
  38.     - etcd0=http://etcd0:2380,etcd1=http://etcd1:2380,etcd2=http://etcd2:2380
  39.     - --initial-cluster-state
  40.     - new
  41.     image: quay.io/coreos/etcd:latest
  42.     name: etcd0
  43.     ports:
  44.     - containerPort: 2379
  45.       name: client
  46.       protocol: TCP
  47.     - containerPort: 2380
  48.       name: server
  49.       protocol: TCP
  50.   restartPolicy: Never
  52. ---
  54. apiVersion: v1
  55. kind: Service
  56. metadata:
  57.   labels:
  58.     etcd_node: etcd0
  59.   name: etcd0
  60. spec:
  61.   ports:
  62.   - name: client
  63.     port: 2379
  64.     protocol: TCP
  65.     targetPort: 2379
  66.   - name: server
  67.     port: 2380
  68.     protocol: TCP
  69.     targetPort: 2380
  70.   selector:
  71.     etcd_node: etcd0
  73. ---
  75. apiVersion: v1
  76. kind: Pod
  77. metadata:
  78.   labels:
  79.     app: etcd
  80.     etcd_node: etcd1
  81.   name: etcd1
  82. spec:
  83.   containers:
  84.   - command:
  85.     - /usr/local/bin/etcd
  86.     - --name
  87.     - etcd1
  88.     - --initial-advertise-peer-urls
  89.     - http://etcd1:2380
  90.     - --listen-peer-urls
  91.     - http://0.0.0.0:2380
  92.     - --listen-client-urls
  93.     - http://0.0.0.0:2379
  94.     - --advertise-client-urls
  95.     - http://etcd1:2379
  96.     - --initial-cluster
  97.     - etcd0=http://etcd0:2380,etcd1=http://etcd1:2380,etcd2=http://etcd2:2380
  98.     - --initial-cluster-state
  99.     - new
  100.     image: quay.io/coreos/etcd:latest
  101.     name: etcd1
  102.     ports:
  103.     - containerPort: 2379
  104.       name: client
  105.       protocol: TCP
  106.     - containerPort: 2380
  107.       name: server
  108.       protocol: TCP
  109.   restartPolicy: Never
  111. ---
  113. apiVersion: v1
  114. kind: Service
  115. metadata:
  116.   labels:
  117.     etcd_node: etcd1
  118.   name: etcd1
  119. spec:
  120.   ports:
  121.   - name: client
  122.     port: 2379
  123.     protocol: TCP
  124.     targetPort: 2379
  125.   - name: server
  126.     port: 2380
  127.     protocol: TCP
  128.     targetPort: 2380
  129.   selector:
  130.     etcd_node: etcd1
  132. ---
  134. apiVersion: v1
  135. kind: Pod
  136. metadata:
  137.   labels:
  138.     app: etcd
  139.     etcd_node: etcd2
  140.   name: etcd2
  141. spec:
  142.   containers:
  143.   - command:
  144.     - /usr/local/bin/etcd
  145.     - --name
  146.     - etcd2
  147.     - --initial-advertise-peer-urls
  148.     - http://etcd2:2380
  149.     - --listen-peer-urls
  150.     - http://0.0.0.0:2380
  151.     - --listen-client-urls
  152.     - http://0.0.0.0:2379
  153.     - --advertise-client-urls
  154.     - http://etcd2:2379
  155.     - --initial-cluster
  156.     - etcd0=http://etcd0:2380,etcd1=http://etcd1:2380,etcd2=http://etcd2:2380
  157.     - --initial-cluster-state
  158.     - new
  159.     image: quay.io/coreos/etcd:latest
  160.     name: etcd2
  161.     ports:
  162.     - containerPort: 2379
  163.       name: client
  164.       protocol: TCP
  165.     - containerPort: 2380
  166.       name: server
  167.       protocol: TCP
  168.   restartPolicy: Never
  170. ---
  172. apiVersion: v1
  173. kind: Service
  174. metadata:
  175.   labels:
  176.     etcd_node: etcd2
  177.   name: etcd2
  178. spec:
  179.   ports:
  180.   - name: client
  181.     port: 2379
  182.     protocol: TCP
  183.     targetPort: 2379
  184.   - name: server
  185.     port: 2380
  186.     protocol: TCP
  187.     targetPort: 2380
  188.   selector:
  189.     etcd_node: etcd2

查看创建结果：

3.3 部署mysql集群 - 图2

3.3.3 创建pvc

用于存储mysql的数据文件，因为有三套主从节点，因此创建三个pvc。

在本地windows机器所安装的kubectl工具所在的目录，创建mariadb-pvc.yml文件，然后执行如下指令：

kubectl create -f mariadb-pvc.yml -n mariadb

  1. apiVersion: v1
  2. kind: PersistentVolumeClaim
  3. metadata:
  4.   name: mysql-datadir-galera-ss-0
  5. spec:
  6.   accessModes:
  7.   - ReadWriteOnce
  8.   storageClassName: managed-premium
  9.   resources:
  10.     requests:
  11.       storage: 5Gi
  13. ---
  15. apiVersion: v1
  16. kind: PersistentVolumeClaim
  17. metadata:
  18.   name: mysql-datadir-galera-ss-1
  19. spec:
  20.   accessModes:
  21.   - ReadWriteOnce
  22.   storageClassName: managed-premium
  23.   resources:
  24.     requests:
  25.       storage: 5Gi
  27. ---
  29. apiVersion: v1
  30. kind: PersistentVolumeClaim
  31. metadata:
  32.   name: mysql-datadir-galera-ss-2
  33. spec:
  34.   accessModes:
  35.   - ReadWriteOnce
  36.   storageClassName: managed-premium
  37.   resources:
  38.     requests:
  39.       storage: 5Gi

查看创建结果：

3.3 部署mysql集群 - 图3

3.3.4 创建rs

创建主节点，提供对外访问的endpoint。

在本地windows机器所安装的kubectl工具所在的目录，创建mariadb-rs.yml文件，然后执行如下指令：

kubectl create -f mariadb-rs.yml -n mariadb

  1. apiVersion: v1
  2. kind: Service
  3. metadata:
  4.   name: galera-rs
  5.   labels:
  6.     app: galera-rs
  7. spec:
  8.   type: NodePort
  9.   ports:
  10.     - nodePort: 30000
  11.       port: 3306
  12.   selector:
  13.     app: galera
  15. ---
  17. apiVersion: extensions/v1beta1
  18. kind: Deployment
  19. metadata:
  20.   name: galera
  21.   labels:
  22.     app: galera
  23. spec:
  24.   replicas: 3
  25.   strategy:
  26.     type: Recreate
  27.   template:
  28.     metadata:
  29.       labels:
  30.         app: galera
  31.     spec:
  32.       containers:
  33.       - name: galera
  34.         image: severalnines/mariadb:10.1
  35.         env:
  36.         # kubectl create secret generic mysql-pass --from-file=password.txt
  37.         - name: MYSQL_ROOT_PASSWORD
  38.           value: myrootpassword
  39.         - name: DISCOVERY_SERVICE
  40.           value: etcd-client:2379
  41.         - name: XTRABACKUP_PASSWORD
  42.           value: password
  43.         - name: CLUSTER_NAME
  44.           value: mariadb_galera
  45.         - name: MYSQL_DATABASE
  46.           value: mydatabase
  47.         - name: MYSQL_USER
  48.           value: myuser
  49.         - name: MYSQL_PASSWORD
  50.           value: myuserpassword
  51.         ports:
  52.         - name: mysql
  53.           containerPort: 3306
  54.         readinessProbe:
  55.           exec:
  56.             command:
  57.             - /healthcheck.sh
  58.             - --readiness
  59.           initialDelaySeconds: 120
  60.           periodSeconds: 1
  61.         livenessProbe:
  62.           exec:
  63.             command:
  64.             - /healthcheck.sh
  65.             - --liveness
  66.           initialDelaySeconds: 120
  67.           periodSeconds: 1

查看创建结果，会有三个pod：

3.3 部署mysql集群 - 图4

3.3.5 创建ss

创建从节点，从节点会去连接之前创建好的主节点。

在本地windows机器所安装的kubectl工具所在的目录，创建mariadb-ss.yml文件（文件内容请参考附件），然后执行如下指令：

kubectl create -f mariadb-ss.yml -n mariadb

  1. apiVersion: v1
  2. kind: Service
  3. metadata:
  4.   name: galera-ss
  5.   labels:
  6.     app: galera-ss
  7. spec:
  8.   ports:
  9.   - port: 3306
  10.     name: mysql
  11.   clusterIP: None
  12.   selector:
  13.     app: galera-ss
  15. ---
  17. apiVersion: apps/v1beta1
  18. kind: StatefulSet
  19. metadata:
  20.   name: galera-ss
  21. spec:
  22.   serviceName: "galera-ss"
  23.   replicas: 3
  24.   template:
  25.     metadata:
  26.       labels:
  27.         app: galera-ss
  28.     spec:
  29.       containers:
  30.       - name: galera
  31.         image: jijeesh/mariadb:10.1
  32.         ports:
  33.         - name: mysql
  34.           containerPort: 3306
  35.         env:
  36.         # kubectl create secret generic mysql-pass --from-file=password.txt
  37.         - name: MYSQL_ROOT_PASSWORD
  38.           value: myrootpassword
  39.         - name: DISCOVERY_SERVICE
  40.           value: etcd-client:2379
  41.         - name: XTRABACKUP_PASSWORD
  42.           value: password
  43.         - name: CLUSTER_NAME
  44.           value: mariadb_galera_ss
  45.         - name: MYSQL_DATABASE
  46.           value: mydatabase
  47.         - name: MYSQL_USER
  48.           value: myuser
  49.         - name: MYSQL_PASSWORD
  50.           value: myuserpassword
  51.         readinessProbe:
  52.           exec:
  53.             command:
  54.             - /healthcheck.sh
  55.             - --readiness
  56.           initialDelaySeconds: 120
  57.           periodSeconds: 1
  58.         livenessProbe:
  59.           exec:
  60.             command:
  61.             - /healthcheck.sh
  62.             - --liveness
  63.           initialDelaySeconds: 120
  64.           periodSeconds: 1
  65.         volumeMounts:
  66.         - name: mysql-datadir
  67.           mountPath: /var/lib/mysql
  68.   volumeClaimTemplates:
  69.   - metadata:
  70.       name: mysql-datadir
  71.     spec:
  72.       accessModes: [ "ReadWriteOnce" ]
  73.       resources:
  74.         requests:
  75.           storage: 5Gi

查看创建的pod，每个pod连接成功之后，才进行下一个pod的创建：

3.3 部署mysql集群 - 图5

3.3.6 查看pod

以上步骤都执行完成之后，查看pod的数量，如果有以下的pod，则表示部署成功：

3.3 部署mysql集群 - 图6