• 安装部署

  • 参照v3.3.0版本Linux系统离线安装文档报错

镜像下载完成并导入到私有进行仓库。最后执行./kk create cluster -f config-sample.yaml -a kubesphere.tar.gz –with-packages报错

操作系统：

虚拟机，master：centos7.9 8c/8g node centos7.9 4c/4g

配置文件：config-sample.yaml

创建部署问题时，请参考下面模板，你提供的信息越多，越容易及时获得解答。
你只花一分钟创建的问题，不能指望别人花上半个小时给你解答。
发帖前请点击 发表主题 右边的 预览(👀) 按钮，确保帖子格式正确。

操作系统信息
例如：虚拟机/物理机，Centos7.5/Ubuntu18.04，4C/8G

Kubernetes版本信息
例如：v18.6。单节点还是多节点。

容器运行时
例如，使用 docker/containerd，版本多少

KubeSphere版本信息
例如：v2.1.1/v3.0.0。离线安装还是在线安装。已有K8s安装还是全套安装。

问题是什么
报错日志是什么，最好有截图。

    高手怎么清楚，需要我程序安装一台虚拟机试一试吗？还有就是我看了一下，它怎么还是要从找互联网找呀
    并且我已经使用./kk delete cluster -f config-sample.yaml 清理了，这样不行吗

    系统都是我重新安装的

    24sama

    系统都是重新安装的，这样够干净了吧，但是报这个错误。还请大师指点一下

        duduxiaolong
        ./kk delete cluster -f config-sample.yaml
        这样清理完成后，看看是不是把执行kk的目录下kubekey目录中有个kubeadm-config.yaml这个文件，把这个文件也删了再重新试试。也可以检查下/etc/kubernetes目录还有没有

            24sama

            我已经重新安装了操作系统还是报这个错误，它安装一些组件一直都在提示需要链接互联网，是不是官方文档里面关于config-sample.yaml配置文件哪里还需修改一下，麻烦你们看一下。只要一开通互联网，马上就可以安装好

                24sama

                离线包我是安装官网步骤一步一步做的，镜像都是下载完了，harbor仓库都安装好了

                manifest-sample.yaml文件内容如下：

                ---

                apiVersion: kubekey.kubesphere.io/v1alpha2

                kind: Manifest

                metadata:

                name: sample

                spec:

                arches:

                • amd64

                operatingSystems:

                • arch: amd64

                  type: linux

                  id: centos

                  version: “7”

                  repository:

                  iso:

                    localPath: /root/centos7-rpms-amd64.iso
  
  url:

                kubernetesDistributions:

                • type: kubernetes

                  version: v1.22.10

                components:

                helm:

  version: v3.6.3

cni:

  version: v0.9.1

etcd:

  version: v3.4.13

containerRuntimes:

- type: docker

  version: 20.10.8

crictl:
- version: v1.22.0

docker-registry:

  version: "2"

harbor:

  version: v2.4.1

docker-compose:

  version: v2.2.2

                images:

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.22.10

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-controller-manager:v1.22.10

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-proxy:v1.22.10

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-scheduler:v1.22.10

                • registry.cn-beijing.aliyuncs.com/kubesphereio/pause:3.5

                • registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.8.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/cni:v3.20.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-controllers:v3.20.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/node:v3.20.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/pod2daemon-flexvol:v3.20.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/typha:v3.20.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/flannel:v0.12.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/provisioner-localpv:2.10.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/linux-utils:2.10.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/haproxy:2.3

                • registry.cn-beijing.aliyuncs.com/kubesphereio/nfs-subdir-external-provisioner:v4.0.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/k8s-dns-node-cache:1.15.12

                • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-installer:v3.3.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-apiserver:v3.3.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-console:v3.3.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-controller-manager:v3.3.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kubectl:v1.20.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kubectl:v1.21.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kubectl:v1.22.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kubefed:v0.8.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/tower:v0.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/minio:RELEASE.2019-08-07T01-59-21Z

                • registry.cn-beijing.aliyuncs.com/kubesphereio/mc:RELEASE.2019-08-07T23-14-43Z

                • registry.cn-beijing.aliyuncs.com/kubesphereio/snapshot-controller:v4.0.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/nginx-ingress-controller:v1.1.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/defaultbackend-amd64:1.4

                • registry.cn-beijing.aliyuncs.com/kubesphereio/metrics-server:v0.4.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/redis:5.0.14-alpine

                • registry.cn-beijing.aliyuncs.com/kubesphereio/haproxy:2.0.25-alpine

                • registry.cn-beijing.aliyuncs.com/kubesphereio/alpine:3.14

                • registry.cn-beijing.aliyuncs.com/kubesphereio/openldap:1.3.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/netshoot:v1.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/cloudcore:v1.9.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/iptables-manager:v1.9.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/edgeservice:v0.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/openpitrix-jobs:v3.2.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/devops-apiserver:v3.3.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/devops-controller:v3.3.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/devops-tools:v3.3.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-jenkins:v3.3.0-2.319.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/inbound-agent:4.10-2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-base:v3.2.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-nodejs:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-maven:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-maven:v3.2.1-jdk11

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-python:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.16

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.17

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.18

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-base:v3.2.2-podman

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-nodejs:v3.2.0-podman

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-maven:v3.2.0-podman

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-maven:v3.2.1-jdk11-podman

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-python:v3.2.0-podman

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.0-podman

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.16-podman

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.17-podman

                • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.18-podman

                • registry.cn-beijing.aliyuncs.com/kubesphereio/s2ioperator:v3.2.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/s2irun:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/s2i-binary:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/tomcat85-java11-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/tomcat85-java11-runtime:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/tomcat85-java8-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/tomcat85-java8-runtime:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/java-11-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/java-8-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/java-8-runtime:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/java-11-runtime:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/nodejs-8-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/nodejs-6-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/nodejs-4-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/python-36-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/python-35-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/python-34-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/python-27-centos7:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/argocd:v2.3.3

                • registry.cn-beijing.aliyuncs.com/kubesphereio/argocd-applicationset:v0.4.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/dex:v2.30.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/redis:6.2.6-alpine

                • registry.cn-beijing.aliyuncs.com/kubesphereio/configmap-reload:v0.5.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/prometheus:v2.34.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/prometheus-config-reloader:v0.55.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/prometheus-operator:v0.55.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-rbac-proxy:v0.11.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-state-metrics:v2.3.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/node-exporter:v1.3.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/alertmanager:v0.23.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/thanos:v0.25.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/grafana:8.3.3

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-rbac-proxy:v0.8.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/notification-manager-operator:v1.4.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/notification-manager:v1.4.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/notification-tenant-sidecar:v3.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/elasticsearch-curator:v5.7.6

                • registry.cn-beijing.aliyuncs.com/kubesphereio/elasticsearch-oss:6.8.22

                • registry.cn-beijing.aliyuncs.com/kubesphereio/fluentbit-operator:v0.13.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/docker:19.03

                • registry.cn-beijing.aliyuncs.com/kubesphereio/fluent-bit:v1.8.11

                • registry.cn-beijing.aliyuncs.com/kubesphereio/log-sidecar-injector:1.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/filebeat:6.7.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-events-operator:v0.4.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-events-exporter:v0.4.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-events-ruler:v0.4.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-auditing-operator:v0.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-auditing-webhook:v0.2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/pilot:1.11.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/proxyv2:1.11.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-operator:1.27

                • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-agent:1.27

                • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-collector:1.27

                • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-query:1.27

                • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-es-index-cleaner:1.27

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kiali-operator:v1.38.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/kiali:v1.38

                • registry.cn-beijing.aliyuncs.com/kubesphereio/busybox:1.31.1

                • registry.cn-beijing.aliyuncs.com/kubesphereio/nginx:1.14-alpine

                • registry.cn-beijing.aliyuncs.com/kubesphereio/wget:1.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/hello:plain-text

                • registry.cn-beijing.aliyuncs.com/kubesphereio/wordpress:4.8-apache

                • registry.cn-beijing.aliyuncs.com/kubesphereio/hpa-example:latest

                • registry.cn-beijing.aliyuncs.com/kubesphereio/java:openjdk-8-jre-alpine

                • registry.cn-beijing.aliyuncs.com/kubesphereio/fluentd:v1.4.2-2.0

                • registry.cn-beijing.aliyuncs.com/kubesphereio/perl:latest

                • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-productpage-v1:1.16.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-reviews-v1:1.16.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-reviews-v2:1.16.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-details-v1:1.16.2

                • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-ratings-v1:1.16.3

                • registry.cn-beijing.aliyuncs.com/kubesphereio/scope:1.13.0

                    24sama

                    如何有问题，你可以发给链接给我，我下载一个你们做好了的离线包，我在试一试

                      24sama

                      内容如下：

                      [root@master ~]# cat /etc/kubernetes/kubeadm-config.yaml

                      ---

                      apiVersion: kubeadm.k8s.io/v1beta2

                      kind: ClusterConfiguration

                      etcd:

                      external:

                      endpoints:

- https://192.168.61.60:2379

caFile: /etc/ssl/etcd/ssl/ca.pem

certFile: /etc/ssl/etcd/ssl/node-master.pem

keyFile: /etc/ssl/etcd/ssl/node-master-key.pem

                      dns:

                      type: CoreDNS

                      imageRepository: dockerhub.kubekey.local/kubesphereio

                      imageTag: 1.8.0

                      imageRepository: dockerhub.kubekey.local/kubesphereio

                      kubernetesVersion: v1.22.10

                      certificatesDir: /etc/kubernetes/pki

                      clusterName: cluster.local

                      controlPlaneEndpoint: lb.kubesphere.local:6443

                      networking:

                      dnsDomain: cluster.local

                      podSubnet: 10.233.64.0/18

                      serviceSubnet: 10.233.0.0/18

                      apiServer:

                      extraArgs:

                      audit-log-maxage: "30"

audit-log-maxbackup: "10"

audit-log-maxsize: "100"

bind-address: 0.0.0.0

feature-gates: ExpandCSIVolumes=true,CSIStorageCapacity=true,RotateKubeletServerCertificate=true,TTLAfterFinished=true

                      certSANs:

                      - kubernetes

- kubernetes.default

- kubernetes.default.svc

- kubernetes.default.svc.cluster.local

- localhost

- 127.0.0.1

- lb.kubesphere.local

- 192.168.61.60

- master

- master.cluster.local

- node

- node.cluster.local

- 192.168.61.61

- 10.233.0.1

                      controllerManager:

                      extraArgs:

                      node-cidr-mask-size: "24"

bind-address: 0.0.0.0

experimental-cluster-signing-duration: 87600h

feature-gates: CSIStorageCapacity=true,RotateKubeletServerCertificate=true,TTLAfterFinished=true,ExpandCSIVolumes=true

                      extraVolumes:

                      • name: host-time

                        hostPath: /etc/localtime

                        mountPath: /etc/localtime

                        readOnly: true

                      scheduler:

                      extraArgs:

                      bind-address: 0.0.0.0

feature-gates: CSIStorageCapacity=true,RotateKubeletServerCertificate=true,TTLAfterFinished=true,ExpandCSIVolumes=true

                      ---

                      apiVersion: kubeadm.k8s.io/v1beta2

                      kind: InitConfiguration

                      localAPIEndpoint:

                      advertiseAddress: 192.168.61.60

                      bindPort: 6443

                      nodeRegistration:

                      kubeletExtraArgs:

                      cgroup-driver: systemd

                      ---

                      apiVersion: kubeproxy.config.k8s.io/v1alpha1

                      kind: KubeProxyConfiguration

                      clusterCIDR: 10.233.64.0/18

                      iptables:

                      masqueradeAll: false

                      masqueradeBit: 14

                      minSyncPeriod: 0s

                      syncPeriod: 30s

                      mode: ipvs

                      ---

                      apiVersion: kubelet.config.k8s.io/v1beta1

                      kind: KubeletConfiguration

                      cgroupDriver: systemd

                      clusterDNS:

                      - 169.254.25.10

                      clusterDomain: cluster.local

                      evictionHard:

                      memory.available: 5%

                      pid.available: 5%

                      evictionMaxPodGracePeriod: 120

                      evictionPressureTransitionPeriod: 30s

                      evictionSoft:

                      memory.available: 10%

                      evictionSoftGracePeriod:

                      memory.available: 2m

                      featureGates:

                      CSIStorageCapacity: true

                      ExpandCSIVolumes: true

                      RotateKubeletServerCertificate: true

                      TTLAfterFinished: true

                      kubeReserved:

                      cpu: 200m

                      memory: 250Mi

                      maxPods: 110

                      rotateCertificates: true

                      systemReserved:

                      cpu: 200m

                      memory: 250Mi

                      [root@master ~]#

                        24sama

                        请怎么生成的kubeadm-config.yaml文件里面的

                        clusterDNS:

                        - 169.254.25.10 是这个

                            24sama
                            应该是你虚拟机网络配置有点问题。主要报错日志是can not use “0.0.0.0 ”as the bind address for the API Server
                            机器设置默认网关了吗？

                                24sama

                                现在我设置了网关，并且把物理机的网卡路由关掉。把虚拟机的网关可以ping通

                                  24sama

                                  设置了网关就安装成功了，谢谢。

                                  个人建议，你们可以在官网上注明一下要，虚拟机要配置网关

                                      10 个月 后