1 kubesphere对接华为云准备

1：网络规划
2：域名规划
3：资源规划
4：需申请公网IP

https://support.huaweicloud.com/cce
image.png

2 下载配置文件

image.png
image.png

image.png

  1. cat <<EOF > /etc/yum.repos.d/kubernetes.repo
  2. [kubernetes]
  3. name=Kubernetes
  4. baseurl=https://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-x86_64/
  5. enabled=1
  6. gpgcheck=1
  7. repo_gpgcheck=1
  8. gpgkey=https://mirrors.aliyun.com/kubernetes/yum/doc/yum-key.gpg https://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpg
  9. EOF

上传并配置work节点config文件，使用kubectl命令行管理集群

  1. cd /home
  2. chmod +x kubectl
  3. mv -f kubectl /usr/local/bin
  4. mkdir -p $HOME/.kube
  5. mv -f kubeconfig.json $HOME/.kube/config
  1. yum install kubectl-1.19.13-0 -y
  2. yum install bash-completion -y
  1. source <(kubectl completion bash)
  2. echo "source <(kubectl completion bash)" >> ~/.bashrc

集群联通验证、需要集群管理员分配命名空间管理权限

  1. kubectl config use-context internal
  2. kubectl cluster-info
  1. [root@uat-cce-40364 ~]# kubectl config use-context internal
  2. Switched to context "internal".
  3. You have new mail in /var/spool/mail/root
  4. [root@uat-cce-40364 ~]# kubectl cluster-info
  5. Kubernetes master is running at https://172.25.1.35:5443
  6. CoreDNS is running at https://172.25.1.35:5443/api/v1/namespaces/kube-system/services/coredns:dns/proxy
  8. To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.
  9. [root@uat-cce-40364 ~]#

3 新建存储配置文件

  1. [root@cce-uat-48749-owct8 ~]# kubectl get sc
  2. NAME                PROVISIONER                     RECLAIMPOLICY   VOLUMEBINDINGMODE      ALLOWVOLUMEEXPANSION   AGE
  3. csi-disk            everest-csi-provisioner         Delete          Immediate              true                   45h
  4. csi-disk-topology   everest-csi-provisioner         Delete          WaitForFirstConsumer   true                   45h
  5. csi-nas             everest-csi-provisioner         Delete          Immediate              true                   45h
  6. csi-obs             everest-csi-provisioner         Delete          Immediate              false                  45h
  7. csi-sfsturbo        everest-csi-provisioner         Delete          Immediate              true                   45h
  8. efs-performance     flexvolume-huawei.com/fuxiefs   Delete          Immediate              true                   45h
  9. efs-standard        flexvolume-huawei.com/fuxiefs   Delete          Immediate              true                   45h
  10. nfs-rw              flexvolume-huawei.com/fuxinfs   Delete          Immediate              true                   45h
  11. obs-standard        flexvolume-huawei.com/fuxiobs   Delete          Immediate              false                  45h
  12. obs-standard-ia     flexvolume-huawei.com/fuxiobs   Delete          Immediate              false                  45h
  13. sas                 flexvolume-huawei.com/fuxivol   Delete          Immediate              true                   45h
  14. sata                flexvolume-huawei.com/fuxivol   Delete          Immediate              true                   45h
  15. ssd                 flexvolume-huawei.com/fuxivol   Delete          Immediate              true                   45h
  16. [root@cce-uat-48749-owct8 ~]#

csi-disk-sas.yaml

  1. apiVersion: storage.k8s.io/v1
  2. kind: StorageClass
  3. metadata:
  4.   annotations:
  5.     storageclass.kubernetes.io/is-default-class: "true"
  6.     storageclass.kubesphere.io/support-snapshot: "false"
  7.   name: csi-disk-sas
  8. parameters:
  9.   csi.storage.k8s.io/csi-driver-name: disk.csi.everest.io
  10.   csi.storage.k8s.io/fstype: ext4
  11.   everest.io/disk-volume-type: SAS
  12.   everest.io/passthrough: "true"
  13. provisioner: everest-csi-provisioner
  14. allowVolumeExpansion: true
  15. reclaimPolicy: Delete
  16. volumeBindingMode: Immediate

创建新存储配置

  1. kubectl apply -f csi-disk-sas.yaml
  1. [root@cce-uat-48749-owct8 home]# kubectl get storageclass
  2. NAME                     PROVISIONER                     RECLAIMPOLICY   VOLUMEBINDINGMODE      ALLOWVOLUMEEXPANSION   AGE
  3. csi-disk                 everest-csi-provisioner         Delete          Immediate              true                   45h
  4. csi-disk-sas (default)   everest-csi-provisioner         Delete          Immediate              true                   97s
  5. csi-disk-topology        everest-csi-provisioner         Delete          WaitForFirstConsumer   true                   45h
  6. csi-nas                  everest-csi-provisioner         Delete          Immediate              true                   45h
  7. csi-obs                  everest-csi-provisioner         Delete          Immediate              false                  45h
  8. csi-sfsturbo             everest-csi-provisioner         Delete          Immediate              true                   45h
  9. efs-performance          flexvolume-huawei.com/fuxiefs   Delete          Immediate              true                   45h
  10. efs-standard             flexvolume-huawei.com/fuxiefs   Delete          Immediate              true                   45h
  11. nfs-rw                   flexvolume-huawei.com/fuxinfs   Delete          Immediate              true                   45h
  12. obs-standard             flexvolume-huawei.com/fuxiobs   Delete          Immediate              false                  45h
  13. obs-standard-ia          flexvolume-huawei.com/fuxiobs   Delete          Immediate              false                  45h
  14. sas                      flexvolume-huawei.com/fuxivol   Delete          Immediate              true                   45h
  15. sata                     flexvolume-huawei.com/fuxivol   Delete          Immediate              true                   45h
  16. ssd                      flexvolume-huawei.com/fuxivol   Delete          Immediate              true                   45h
  17. You have new mail in /var/spool/mail/root
  18. [root@cce-uat-48749-owct8 home]#

如果有取消需取消默认配置

  1. kubectl patch storageclass sas -p '{"metadata": {"annotations":{"storageclass.kubernetes.io/is-default-class":"true"}}}'

4 ks-installer 执行最小化部署

  1. kubectl apply -f https://github.com/kubesphere/ks-installer/releases/download/v3.1.1/kubesphere-installer.yaml
  2. kubectl apply -f https://github.com/kubesphere/ks-installer/releases/download/v3.1.1/cluster-configuration.yaml

image.png
image.png1624972071(1).png

查看安装日志

  1. kubectl logs -n kubesphere-system $(kubectl get pod -n kubesphere-system -l app=ks-install -o jsonpath='{.items[0].metadata.name}') -f
  1. kubectl get svc/ks-console -n kubesphere-system
  1. **************************************************
  2. Collecting installation results ...
  3. #####################################################
  4. ###              Welcome to KubeSphere!           ###
  5. #####################################################
  7. Console: http://172.25.1.46:30880
  8. Account: admin
  9. Password: P@88w0rd
  11. NOTES：
  12.   1. After you log into the console, please check the
  13.      monitoring status of service components in
  14.      "Cluster Management". If any service is not
  15.      ready, please wait patiently until all components 
  16.      are up and running.
  17.   2. Please change the default password after login.
  19. #####################################################
  20. https://kubesphere.io             2021-07-08 10:25:34
  21. #####################################################

image.png

5 启用其他组件

自定义资源CRD
clusterconfiguration
image.png

  1. kubectl -n kubesphere-system edit cc ks-installer

6 host集群接管

内网网络可到达前提下，使用直接对接模式
image.png

image.png

1628087924(1).png

harbor通过内网方式同步到华为云镜像swr
https://support.huaweicloud.com/bestpractice-swr/swr_bestpractice_0004.html#toTop

报错1 ：

  1. 校验失败
  2. Get "https://172.25.1.35:5443/version?timeout=10s": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

原因：网络不可达

7 参考链接

https://kubernetes.io/zh/docs/tasks/administer-cluster/change-default-storage-class
https://kubesphere.io/zh/docs/installing-on-kubernetes/hosted-kubernetes/install-kubesphere-on-huaweicloud-cce
https://v3-1.docs.kubesphere.io/zh/docs/multicluster-management/import-cloud-hosted-k8s/import-aliyun-ack