1.前置要求

1.1.升级系统内核

建议的最低内核版本为4.17
参考：离线升级Centos7内核

1.2.指定Harbor作为仓库

参考：containerd指定Harbor作为仓库

1.3.离线安装kubernetes

安装kube1.21.5版本
参考：https://www.sealyun.com/

1.4.修改api-server配置

在已经安装过kube1.21.5版本之后，任意一个master节点中修改
vi /etc/kubernetes/manifests/kube-apiserver.yaml，添加如下内如

  1. - --feature-gates=RemoveSelfLink=false

1.5.离线安装存储服务

如果k8s环境是1.20.x以上版本，需要使用Ceph存储，如果低于1.20.x版本使用Ceph、NFS存储都可以。

1.5.离线安装ROOK-Ceph分布式存储

参考：离线安装ROOK-Ceph分布式存储并作为默认存储

1.6.离线安装NFS存储

参考：离线安装NFS存储并作为默认存储

2.准安装镜像

当您在离线环境中安装 KubeSphere 时，需要事先准备一个包含所有必需镜像的镜像包。

  • 使用以下命令从能够访问互联网的机器上下载镜像清单文件 images-list.txt：

    curl -L -O https://github.com/kubesphere/ks-installer/releases/download/v3.2.0/images-list.txt

    该文件根据不同的模块列出了 ##+modulename 下的镜像。您可以按照相同的规则把自己的镜像添加到这个文件中。要查看完整文件，请参见附录。

  • 下载 offline-installation-tool.sh。

    curl -L -O https://github.com/kubesphere/ks-installer/releases/download/v3.2.0/offline-installation-tool.sh

  • 使 .sh 文件可执行。

    chmod +x offline-installation-tool.sh

  • 您可以执行命令 ./offline-installation-tool.sh -h 来查看如何使用脚本： ```shell root@master:/home/ubuntu# ./offline-installation-tool.sh -h Usage:

    ./offline-installation-tool.sh [-l IMAGES-LIST] [-d IMAGES-DIR] [-r PRIVATE-REGISTRY] [-v KUBERNETES-VERSION ]

Description: -b : save kubernetes’ binaries. -d IMAGES-DIR : the dir of files (tar.gz) which generated by docker save. default: ./kubesphere-images -l IMAGES-LIST : text file with list of images. -r PRIVATE-REGISTRY : target private registry:port. -s : save model will be applied. Pull the images in the IMAGES-LIST and save images as a tar.gz file. -v KUBERNETES-VERSION : download kubernetes’ binaries. default: v1.17.9 -h : usage message


- 在 `offline-installation-tool.sh` 中拉取镜像。
```shell
./offline-installation-tool.sh -s -l images-list.txt -d ./kubesphere-images

3.推送镜像至私有仓库

将打包的镜像文件传输至您的本地机器，并运行以下命令把它推送至仓库。

./offline-installation-tool.sh -l images-list.txt -d ./kubesphere-images -r 192.168.28.150:8001/kubesphere-install

命令中的域名是 192.168.28.150:8001/kubesphere-install。请确保使用您自己仓库的地址。

4.下载部署文件

与在现有 Kubernetes 集群上在线安装 KubeSphere 相似，您也需要事先下载 cluster-configuration.yaml 和 kubesphere-installer.yaml。

  • 执行以下命令下载这两个文件，并将它们传输至您充当任务机的机器，用于安装。

    curl -L -O https://github.com/kubesphere/ks-installer/releases/download/v3.2.0/cluster-configuration.yaml
curl -L -O https://github.com/kubesphere/ks-installer/releases/download/v3.2.0/kubesphere-installer.yaml

  • 编辑 cluster-configuration.yaml 添加您的私有镜像仓库。例如，本教程中的仓库地址是 192.168.28.150:8001/kubesphere-install，将它用作 .spec.local_registry 的值，如下所示：

    spec:
persistence:
  storageClass: "" # 上面步骤已经安装了nfs作为默认存储，这里就不需要指定了
authentication:
  jwtSecret: ""
local_registry: "192.168.28.150:8001/kubesphere-install" # Add this line manually; make sure you use your own registry address.

    您可以在该 YAML 文件中启用可插拔组件，体验 KubeSphere 的更多功能。有关详情，请参考启用可插拔组件。

  • 编辑完成后保存 cluster-configuration.yaml。使用以下命令将 ks-installer 替换为您自己仓库的地址。

    sed -i "s#^\s*image: kubesphere.*/ks-installer:.*#        image: 192.168.28.150:8001/kubesphere-install/kubesphere/ks-installer:v3.2.0#" kubesphere-installer.yaml

    命令中的仓库地址是 192.168.28.150:8001/kubesphere-install。请确保使用您自己仓库的地址。

    5.开始安装

    确定完成上面所有步骤后，您可以执行以下命令。

    kubectl apply -f kubesphere-installer.yaml
kubectl apply -f cluster-configuration.yaml

    查看安装日志：

    kubectl logs -n kubesphere-system $(kubectl get pod -n kubesphere-system -l app=ks-install -o jsonpath='{.items[0].metadata.name}') -f

    验证安装
    安装完成后，您会看到以下内容： ```

    #

    Welcome to KubeSphere!

    #

Console: http://192.168.28.140:30880 Account: admin Password: P@88w0rd

NOTES：

  1. After logging into the console, please check the monitoring status of service components in the “Cluster Management”. If any service is not ready, please wait patiently until all components are ready.
  2. Please modify the default password after login.
#

https://kubesphere.io 2021-02-09 13:50:43

#
现在，您可以通过 `http://{IP}:30880` 使用默认帐户和密码 `admin/P@88w0rd` 访问 KubeSphere 的 Web 控制台。<br />要访问控制台，请确保在您的安全组中打开端口 30880。

![](https://cdn.nlark.com/yuque/0/2021/png/314031/1612852200209-f10ee648-c94c-4590-8e42-031f86469db6.png#height=776&id=QEgIv&originHeight=776&originWidth=992&originalType=binary&ratio=1&size=0&status=done&style=none&width=992)
<a name="gLTGx"></a>
# 6.安装PorterLB（负载均衡器）
用于Kubernetes 在裸机、边缘和虚拟化中的负载均衡器实现<br />官网：[https://porterlb.io/](https://porterlb.io/)<br />参考：[离线在Kubernetes上安装 PorterLB负载均衡器](https://www.yuque.com/u167769/vdiros/uczciz)
<a name="sZKZj"></a>
# 附录
<a name="Qg2VI"></a>
## KubeSphere v3.1.0 镜像清单

kubesphere-images

kubesphere/ks-installer:v3.2.0 kubesphere/ks-apiserver:v3.2.0 kubesphere/ks-console:v3.2.0 kubesphere/ks-controller-manager:v3.2.0 kubesphere/kubectl:v1.20.0 kubesphere/kubefed:v0.8.1 kubesphere/tower:v0.2.0 kubesphere/kubectl:v1.19.1 minio/minio:RELEASE.2019-08-07T01-59-21Z minio/mc:RELEASE.2019-08-07T23-14-43Z csiplugin/snapshot-controller:v4.0.0 kubesphere/nginx-ingress-controller:v0.35.0 mirrorgooglecontainers/defaultbackend-amd64:1.4 kubesphere/metrics-server:v0.4.2 redis:5.0.12-alpine haproxy:2.0.22-alpine alpine:3.14 osixia/openldap:1.3.0 kubesphere/netshoot:v1.0

kubeedge-images

kubeedge/cloudcore:v1.7.2 kubesphere/edge-watcher:v0.1.1 kubesphere/edge-watcher-agent:v0.1.0

gatekeeper-images

openpolicyagent/gatekeeper:v3.5.2

openpitrix-images

kubesphere/openpitrix-jobs:v3.2.0

kubesphere-devops-images

kubesphere/devops-apiserver:v3.2.0 kubesphere/devops-controller:v3.2.0 kubesphere/devops-tools:v3.2.0 kubesphere/ks-jenkins:v3.2.0-2.249.1 jenkins/jnlp-slave:3.27-1 kubesphere/builder-base:v3.2.0 kubesphere/builder-nodejs:v3.2.0 kubesphere/builder-maven:v3.2.0 kubesphere/builder-go:v3.2.0 kubesphere/builder-go:v3.2.0 kubesphere/s2ioperator:v3.2.0 kubesphere/s2irun:v3.2.0 kubesphere/s2i-binary:v3.2.0 kubesphere/tomcat85-java11-centos7:v3.2.0 kubesphere/tomcat85-java11-runtime:v3.2.0 kubesphere/tomcat85-java8-centos7:v3.2.0 kubesphere/tomcat85-java8-runtime:v3.2.0 kubesphere/java-11-centos7:v3.2.0 kubesphere/java-8-centos7:v3.2.0 kubesphere/java-8-runtime:v3.2.0 kubesphere/java-11-runtime:v3.2.0 kubesphere/nodejs-8-centos7:v3.2.0 kubesphere/nodejs-6-centos7:v3.2.0 kubesphere/nodejs-4-centos7:v3.2.0 kubesphere/python-36-centos7:v3.2.0 kubesphere/python-35-centos7:v3.2.0 kubesphere/python-34-centos7:v3.2.0 kubesphere/python-27-centos7:v3.2.0

kubesphere-monitoring-images

jimmidyson/configmap-reload:v0.3.0 prom/prometheus:v2.26.0 kubesphere/prometheus-config-reloader:v0.43.2 kubesphere/prometheus-operator:v0.43.2 kubesphere/kube-rbac-proxy:v0.8.0 kubesphere/kube-state-metrics:v1.9.7 prom/node-exporter:v0.18.1 kubesphere/k8s-prometheus-adapter-amd64:v0.6.0 prom/alertmanager:v0.21.0 thanosio/thanos:v0.18.0 grafana/grafana:7.4.3 kubesphere/kube-rbac-proxy:v0.8.0 kubesphere/notification-manager-operator:v1.4.0 kubesphere/notification-manager:v1.4.0 kubesphere/notification-tenant-sidecar:v3.2.0

kubesphere-logging-images

kubesphere/elasticsearch-curator:v5.7.6 kubesphere/elasticsearch-oss:6.7.0-1 kubesphere/fluentbit-operator:v0.11.0 docker:19.03 kubesphere/fluent-bit:v1.8.3 kubesphere/log-sidecar-injector:1.1 elastic/filebeat:6.7.0 kubesphere/kube-events-operator:v0.3.0 kubesphere/kube-events-exporter:v0.3.0 kubesphere/kube-events-ruler:v0.3.0 kubesphere/kube-auditing-operator:v0.2.0 kubesphere/kube-auditing-webhook:v0.2.0

istio-images

istio/pilot:1.11.1 istio/proxyv2:1.11.1 jaegertracing/jaeger-operator:1.27 jaegertracing/jaeger-agent:1.27 jaegertracing/jaeger-collector:1.27 jaegertracing/jaeger-query:1.27 jaegertracing/jaeger-es-index-cleaner:1.27 kubesphere/kiali-operator:v1.38.1 kubesphere/kiali:v1.38

example-images

busybox:1.31.1 nginx:1.14-alpine joosthofman/wget:1.0 nginxdemos/hello:plain-text wordpress:4.8-apache mirrorgooglecontainers/hpa-example:latest java:openjdk-8-jre-alpine fluent/fluentd:v1.4.2-2.0 perl:latest kubesphere/examples-bookinfo-productpage-v1:1.16.2 kubesphere/examples-bookinfo-reviews-v1:1.16.2 kubesphere/examples-bookinfo-reviews-v2:1.16.2 kubesphere/examples-bookinfo-details-v1:1.16.2 kubesphere/examples-bookinfo-ratings-v1:1.16.3

weave-scope-images

weaveworks/scope:1.13.0 ```