创建部署问题时,请参考下面模板,你提供的信息越多,越容易及时获得解答。如果未按模板创建问题,管理员有权关闭问题。
确保帖子格式清晰易读,用 markdown code block 语法格式化代码块。
你只花一分钟创建的问题,不能指望别人花上半个小时给你解答。

操作系统信息
例如:虚拟机/物理机,Kylin Linux Advanced Server V10 (Halberd),8C/32G

Kubernetes版本信息
Kubernetes version: v1.23.15

容器运行时
docker Version: 24.0.7

KubeSphere版本信息
离线安装 3.4.1 KubeSphere版本

问题是什么
[root@node1 kubekey]# ./kk create cluster -f config-sample.yaml -a ksp-v3.4.1-artifact.tar.gz –skip-push-images


| | / / | | | | / /

| |/ / _ _| |__ ___| |/ / ___ _ _

| \| | | | '_ \ / _ \ \ / _ \ | | |

| |\ \ || | |) | __/ |\ \ __/ |_| |

\| \/\,|./ \\| \/\|\__, |

                                __/ |

                               |___/

12:50:10 CST [GreetingsModule] Greetings

12:50:10 CST message: [master1]

Greetings, KubeKey!

12:50:10 CST message: [master2]

Greetings, KubeKey!

12:50:11 CST message: [master3]

Greetings, KubeKey!

12:50:11 CST success: [master1]

12:50:11 CST success: [master2]

12:50:11 CST success: [master3]

12:50:11 CST [NodePreCheckModule] A pre-check on nodes

12:50:13 CST success: [master1]

12:50:13 CST success: [master3]

12:50:13 CST success: [master2]

12:50:13 CST [ConfirmModule] Display confirmation form

+———+——+——+———+———-+——-+——-+———+———–+——–+——–+————+————+————-+——————+————–+

| name | sudo | curl | openssl | ebtables | socat | ipset | ipvsadm | conntrack | chrony | docker | containerd | nfs client | ceph client | glusterfs client | time |

+———+——+——+———+———-+——-+——-+———+———–+——–+——–+————+————+————-+——————+————–+

| master1 | y | y | y | y | y | y | y | y | y | 24.0.7 | v1.7.6 | y | | | CST 12:50:13 |

| master2 | y | y | y | y | y | y | y | y | y | 24.0.7 | v1.7.6 | y | | | CST 12:50:13 |

| master3 | y | y | y | y | y | y | y | y | y | 24.0.7 | v1.7.6 | y | | | CST 12:50:13 |

+———+——+——+———+———-+——-+——-+———+———–+——–+——–+————+————+————-+——————+————–+

This is a simple check of your environment.

Before installation, ensure that your machines meet all requirements specified at

https://github.com/kubesphere/kubekey#requirements-and-recommendations

Install k8s with specify version: v1.23.15

Continue this installation? [yes/no]: yes

12:50:36 CST success: [LocalHost]

12:50:36 CST [UnArchiveArtifactModule] Check the KubeKey artifact md5 value

12:51:11 CST success: [LocalHost]

12:51:11 CST [UnArchiveArtifactModule] UnArchive the KubeKey artifact

12:51:11 CST skipped: [LocalHost]

12:51:11 CST [UnArchiveArtifactModule] Create the KubeKey artifact Md5 file

12:51:11 CST skipped: [LocalHost]

12:51:11 CST [NodeBinariesModule] Download installation binaries

12:51:11 CST message: [localhost]

downloading arm64 kubeadm v1.23.15 …

12:51:11 CST message: [localhost]

kubeadm exists

12:51:11 CST message: [localhost]

downloading arm64 kubelet v1.23.15 …

12:51:11 CST message: [localhost]

kubelet exists

12:51:11 CST message: [localhost]

downloading arm64 kubectl v1.23.15 …

12:51:11 CST message: [localhost]

kubectl exists

12:51:11 CST message: [localhost]

downloading arm64 helm v3.14.3 …

12:51:11 CST message: [localhost]

helm exists

12:51:11 CST message: [localhost]

downloading arm64 kubecni v1.2.0 …

12:51:11 CST message: [localhost]

kubecni exists

12:51:11 CST message: [localhost]

downloading arm64 crictl v1.29.0 …

12:51:11 CST message: [localhost]

crictl exists

12:51:11 CST message: [localhost]

downloading arm64 etcd v3.5.13 …

12:51:11 CST message: [localhost]

etcd exists

12:51:11 CST message: [localhost]

downloading arm64 docker 24.0.9 …

12:51:11 CST message: [localhost]

docker exists

12:51:11 CST message: [localhost]

downloading arm64 calicoctl v3.27.4 …

12:51:12 CST message: [localhost]

calicoctl exists

12:51:12 CST success: [LocalHost]

12:51:12 CST [ConfigureOSModule] Get OS release

12:51:12 CST success: [master3]

12:51:12 CST success: [master2]

12:51:12 CST success: [master1]

12:51:12 CST [ConfigureOSModule] Prepare to init OS

12:51:15 CST success: [master3]

12:51:15 CST success: [master1]

12:51:15 CST success: [master2]

12:51:15 CST [ConfigureOSModule] Generate init os script

12:51:16 CST success: [master3]

12:51:16 CST success: [master1]

12:51:16 CST success: [master2]

12:51:16 CST [ConfigureOSModule] Exec init os script

12:51:17 CST stdout: [master2]

setenforce: SELinux is disabled

Disabled

kernel.sysrq = 0

net.ipv4.ip_forward = 1

net.ipv4.conf.all.send_redirects = 0

net.ipv4.conf.default.send_redirects = 0

net.ipv4.conf.all.accept_source_route = 0

net.ipv4.conf.default.accept_source_route = 0

net.ipv4.conf.all.accept_redirects = 0

net.ipv4.conf.default.accept_redirects = 0

net.ipv4.conf.all.secure_redirects = 0

net.ipv4.conf.default.secure_redirects = 0

net.ipv4.icmp_echo_ignore_broadcasts = 1

net.ipv4.icmp_ignore_bogus_error_responses = 1

net.ipv4.conf.all.rp_filter = 0

net.ipv4.conf.default.rp_filter = 0

net.ipv4.tcp_syncookies = 1

kernel.dmesg_restrict = 1

net.ipv6.conf.all.accept_redirects = 0

net.ipv6.conf.default.accept_redirects = 0

net.bridge.bridge-nf-call-arptables = 1

net.bridge.bridge-nf-call-ip6tables = 1

net.bridge.bridge-nf-call-iptables = 1

net.ipv4.ip_local_reserved_ports = 30000-32767

vm.max_map_count = 262144

fs.inotify.max_user_instances = 524288

kernel.pid_max = 65535

net.core.netdev_max_backlog = 65535

net.core.rmem_max = 33554432

net.core.wmem_max = 33554432

net.core.somaxconn = 32768

net.ipv4.tcp_max_syn_backlog = 1048576

net.ipv4.neigh.default.gc_thresh1 = 512

net.ipv4.neigh.default.gc_thresh2 = 2048

net.ipv4.neigh.default.gc_thresh3 = 4096

net.ipv4.tcp_retries2 = 15

net.ipv4.tcp_max_tw_buckets = 1048576

net.ipv4.tcp_max_orphans = 65535

net.ipv4.tcp_keepalive_time = 600

net.ipv4.tcp_keepalive_intvl = 30

net.ipv4.tcp_keepalive_probes = 10

net.ipv4.udp_rmem_min = 131072

net.ipv4.udp_wmem_min = 131072

net.ipv4.conf.all.arp_accept = 1

net.ipv4.conf.default.arp_accept = 1

net.ipv4.conf.all.arp_ignore = 1

net.ipv4.conf.default.arp_ignore = 1

vm.swappiness = 0

vm.overcommit_memory = 0

fs.inotify.max_user_watches = 524288

fs.pipe-max-size = 4194304

fs.aio-max-nr = 262144

kernel.watchdog_thresh = 5

kernel.hung_task_timeout_secs = 5

12:51:18 CST stdout: [master3]

setenforce: SELinux is disabled

Disabled

kernel.sysrq = 0

net.ipv4.ip_forward = 1

net.ipv4.conf.all.send_redirects = 0

net.ipv4.conf.default.send_redirects = 0

net.ipv4.conf.all.accept_source_route = 0

net.ipv4.conf.default.accept_source_route = 0

net.ipv4.conf.all.accept_redirects = 0

net.ipv4.conf.default.accept_redirects = 0

net.ipv4.conf.all.secure_redirects = 0

net.ipv4.conf.default.secure_redirects = 0

net.ipv4.icmp_echo_ignore_broadcasts = 1

net.ipv4.icmp_ignore_bogus_error_responses = 1

net.ipv4.conf.all.rp_filter = 0

net.ipv4.conf.default.rp_filter = 0

net.ipv4.tcp_syncookies = 1

kernel.dmesg_restrict = 1

net.ipv6.conf.all.accept_redirects = 0

net.ipv6.conf.default.accept_redirects = 0

net.bridge.bridge-nf-call-arptables = 1

net.bridge.bridge-nf-call-ip6tables = 1

net.bridge.bridge-nf-call-iptables = 1

net.ipv4.ip_local_reserved_ports = 30000-32767

vm.max_map_count = 262144

vm.swappiness = 0

fs.inotify.max_user_instances = 524288

kernel.pid_max = 65535

net.core.netdev_max_backlog = 65535

net.core.rmem_max = 33554432

net.core.wmem_max = 33554432

net.core.somaxconn = 32768

net.ipv4.tcp_max_syn_backlog = 1048576

net.ipv4.neigh.default.gc_thresh1 = 512

net.ipv4.neigh.default.gc_thresh2 = 2048

net.ipv4.neigh.default.gc_thresh3 = 4096

net.ipv4.tcp_retries2 = 15

net.ipv4.tcp_max_tw_buckets = 1048576

net.ipv4.tcp_max_orphans = 65535

net.ipv4.tcp_keepalive_time = 600

net.ipv4.tcp_keepalive_intvl = 30

net.ipv4.tcp_keepalive_probes = 10

net.ipv4.udp_rmem_min = 131072

net.ipv4.udp_wmem_min = 131072

net.ipv4.conf.all.arp_accept = 1

net.ipv4.conf.default.arp_accept = 1

net.ipv4.conf.all.arp_ignore = 1

net.ipv4.conf.default.arp_ignore = 1

vm.overcommit_memory = 0

fs.inotify.max_user_watches = 524288

fs.pipe-max-size = 4194304

fs.aio-max-nr = 262144

kernel.watchdog_thresh = 5

kernel.hung_task_timeout_secs = 5

12:51:18 CST stdout: [master1]

setenforce: SELinux is disabled

Disabled

kernel.sysrq = 0

net.ipv4.ip_forward = 1

net.ipv4.conf.all.send_redirects = 0

net.ipv4.conf.default.send_redirects = 0

net.ipv4.conf.all.accept_source_route = 0

net.ipv4.conf.default.accept_source_route = 0

net.ipv4.conf.all.accept_redirects = 0

net.ipv4.conf.default.accept_redirects = 0

net.ipv4.conf.all.secure_redirects = 0

net.ipv4.conf.default.secure_redirects = 0

net.ipv4.icmp_echo_ignore_broadcasts = 1

net.ipv4.icmp_ignore_bogus_error_responses = 1

net.ipv4.conf.all.rp_filter = 0

net.ipv4.conf.default.rp_filter = 0

net.ipv4.tcp_syncookies = 1

kernel.dmesg_restrict = 1

net.ipv6.conf.all.accept_redirects = 0

net.ipv6.conf.default.accept_redirects = 0

net.bridge.bridge-nf-call-arptables = 1

net.bridge.bridge-nf-call-ip6tables = 1

net.bridge.bridge-nf-call-iptables = 1

net.ipv4.ip_local_reserved_ports = 30000-32767

vm.max_map_count = 262144

vm.swappiness = 0

fs.inotify.max_user_instances = 524288

kernel.pid_max = 65535

net.core.netdev_max_backlog = 65535

net.core.rmem_max = 33554432

net.core.wmem_max = 33554432

net.core.somaxconn = 32768

net.ipv4.tcp_max_syn_backlog = 1048576

net.ipv4.neigh.default.gc_thresh1 = 512

net.ipv4.neigh.default.gc_thresh2 = 2048

net.ipv4.neigh.default.gc_thresh3 = 4096

net.ipv4.tcp_retries2 = 15

net.ipv4.tcp_max_tw_buckets = 1048576

net.ipv4.tcp_max_orphans = 65535

net.ipv4.tcp_keepalive_time = 600

net.ipv4.tcp_keepalive_intvl = 30

net.ipv4.tcp_keepalive_probes = 10

net.ipv4.udp_rmem_min = 131072

net.ipv4.udp_wmem_min = 131072

net.ipv4.conf.all.arp_accept = 1

net.ipv4.conf.default.arp_accept = 1

net.ipv4.conf.all.arp_ignore = 1

net.ipv4.conf.default.arp_ignore = 1

vm.overcommit_memory = 0

fs.inotify.max_user_watches = 524288

fs.pipe-max-size = 4194304

fs.aio-max-nr = 262144

kernel.watchdog_thresh = 5

kernel.hung_task_timeout_secs = 5

12:51:18 CST success: [master2]

12:51:18 CST success: [master3]

12:51:18 CST success: [master1]

12:51:18 CST [ConfigureOSModule] configure the ntp server for each node

12:51:18 CST skipped: [master3]

12:51:18 CST skipped: [master1]

12:51:18 CST skipped: [master2]

12:51:18 CST [KubernetesStatusModule] Get kubernetes cluster status

12:51:18 CST success: [master1]

12:51:18 CST success: [master2]

12:51:18 CST success: [master3]

12:51:18 CST [InstallContainerModule] Sync docker binaries

12:51:18 CST skipped: [master3]

12:51:18 CST skipped: [master1]

12:51:18 CST skipped: [master2]

12:51:18 CST [InstallContainerModule] Generate containerd service

12:51:19 CST success: [master3]

12:51:19 CST success: [master1]

12:51:19 CST success: [master2]

12:51:19 CST [InstallContainerModule] Generate docker service

12:51:20 CST skipped: [master3]

12:51:20 CST skipped: [master2]

12:51:20 CST skipped: [master1]

12:51:20 CST [InstallContainerModule] Generate docker config

12:51:20 CST skipped: [master3]

12:51:20 CST skipped: [master2]

12:51:20 CST skipped: [master1]

12:51:20 CST [InstallContainerModule] Enable containerd

12:51:21 CST success: [master3]

12:51:21 CST success: [master1]

12:51:21 CST success: [master2]

12:51:21 CST [InstallContainerModule] Enable docker

12:51:21 CST skipped: [master3]

12:51:21 CST skipped: [master1]

12:51:21 CST skipped: [master2]

12:51:21 CST [InstallContainerModule] Add auths to container runtime

12:51:22 CST success: [master3]

12:51:22 CST success: [master1]

12:51:22 CST success: [master2]

12:51:22 CST [InstallContainerModule] Sync docker buildx binaries

12:51:22 CST skipped: [master3]

12:51:22 CST skipped: [master1]

12:51:22 CST skipped: [master2]

12:51:22 CST [InstallCriDockerdModule] Sync cri-dockerd binaries

12:51:22 CST skipped: [master3]

12:51:22 CST skipped: [master1]

12:51:22 CST skipped: [master2]

12:51:22 CST [InstallCriDockerdModule] Generate cri-dockerd service

12:51:22 CST skipped: [master3]

12:51:22 CST skipped: [master1]

12:51:22 CST skipped: [master2]

12:51:22 CST [InstallCriDockerdModule] Enable cri-dockerd

12:51:22 CST skipped: [master3]

12:51:22 CST skipped: [master1]

12:51:22 CST skipped: [master2]

12:51:22 CST [InstallCriDockerdModule] Sync crictl binaries

12:51:22 CST skipped: [master3]

12:51:22 CST skipped: [master1]

12:51:22 CST skipped: [master2]

12:51:22 CST [InstallCriDockerdModule] Generate crictl config

12:51:22 CST skipped: [master3]

12:51:22 CST skipped: [master1]

12:51:22 CST skipped: [master2]

12:51:22 CST [PullModule] Start to pull images on all nodes

12:51:22 CST message: [master3]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

12:51:22 CST message: [master2]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

12:51:22 CST message: [master1]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

12:51:23 CST message: [master3]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

12:51:23 CST retry: [master3]

12:51:23 CST message: [master1]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

12:51:23 CST retry: [master1]

12:51:23 CST message: [master2]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

12:51:23 CST retry: [master2]

12:51:28 CST message: [master3]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

12:51:28 CST message: [master1]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

12:51:28 CST message: [master2]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

12:51:28 CST message: [master1]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

12:51:28 CST retry: [master1]

12:51:28 CST message: [master3]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

12:51:28 CST retry: [master3]

12:51:28 CST message: [master2]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

12:51:28 CST retry: [master2]

12:51:33 CST message: [master3]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

12:51:33 CST message: [master1]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

12:51:33 CST message: [master2]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

12:51:33 CST message: [master3]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

12:51:33 CST message: [master1]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

12:51:33 CST message: [master2]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

12:51:33 CST failed: [master3]

12:51:33 CST failed: [master1]

12:51:33 CST failed: [master2]

error: Pipeline[CreateClusterPipeline] execute failed: Module[PullModule] exec failed:

failed: [master3] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

failed: [master1] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

failed: [master2] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/pause:3.6 –platform arm64”

Error response from daemon: unknown: artifact kubesphereio/pause:3.6 not found: Process exited with status 1

问题1:

我在manifest.yaml 指定的下载的离线镜像的版本好是没带 -arm64的, 但是push到harbor后的镜像tag会自动添加 -arm64 ,导致创建集群的时候,默认没有带-arm64的tag, 导致无法找到镜像, 这个在多个版本测试都一样,是否我缺少什么配置呢?

问题2:

我在制作离线包的时候下载各个离线二进制包都是按照我的manifest.yaml 里面的版本进行下载,为什么我使用 ./kk create cluster -f config-sample.yaml -a ksp-v3.4.1-artifact.tar.gz –skip-push-images 的时候, kk会默认去下载另外版的安装呢? 比如calicoctl 、etcd、 crictl 都默认去下载另外的版本安装包。导致安装的时候会报错

问题3:

我在制作离线包的时候下载镜像已经正常下载完成所有镜像,但是我使用 kk push images的时候, 发现会出现镜像名称错误的问题,但是我查看harbor实际已经有 相关镜像在里面了。

    TomJan-one 下面是我的manifest.yaml 的内容:

    [root@node1 kubekey]# cat manifest.yaml

    ---

    apiVersion: kubekey.kubesphere.io/v1alpha2

    kind: Manifest

    metadata:

    name: sample

    spec:

    arches:

    • arm64

      operatingSystems:

    • arch: arm64

      type: linux

      id: kylin

      version: “V10”

      osImage: Kylin Linux Advanced Server V10 (Halberd)

      repository:

      iso:

      localPath: /root/kubesphere/kylin-v10.iso
      
      url: 

    kubernetesDistributions:

    • type: kubernetes

      version: v1.23.15

      components:

      helm:

      version: v3.9.0

      cni:

      version: v1.2.0

      etcd:

      version: v3.4.13

      calicoctl:

      version: v3.23.2

      For now, if your cluster container runtime is containerd, KubeKey will add a docker 20.10.8 container runtime in the below list.

      The reason is KubeKey creates a cluster with containerd by installing a docker first and making kubelet connect the socket file of containerd which docker contained.

      containerRuntimes:

      • type: docker

        version: 24.0.9

      • type: containerd

        version: 1.6.4

        crictl:

        version: v1.24.0

        docker-registry:

        version: “2”

        harbor:

        version: v2.5.3

        docker-compose:

        version: v2.2.2

      images:

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.23.15

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-controller-manager:v1.23.15

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-proxy:v1.23.15

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-scheduler:v1.23.15

    • registry.cn-beijing.aliyuncs.com/kubesphereio/pause:3.6

    • registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.8.6

    • registry.cn-beijing.aliyuncs.com/kubesphereio/cni:v3.23.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-controllers:v3.23.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/node:v3.23.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/pod2daemon-flexvol:v3.23.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/typha:v3.23.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/flannel:v0.12.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/provisioner-localpv:3.3.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/linux-utils:3.3.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/haproxy:2.3

    • registry.cn-beijing.aliyuncs.com/kubesphereio/nfs-subdir-external-provisioner:v4.0.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/k8s-dns-node-cache:1.15.12

    • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-installer:v3.4.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-apiserver:v3.4.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-console:v3.4.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-controller-manager:v3.4.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kubectl:v1.22.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kubectl:v1.21.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kubectl:v1.20.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kubefed:v0.8.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/tower:v0.2.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/minio:RELEASE.2019-08-07T01-59-21Z

    • registry.cn-beijing.aliyuncs.com/kubesphereio/mc:RELEASE.2019-08-07T23-14-43Z

    • registry.cn-beijing.aliyuncs.com/kubesphereio/snapshot-controller:v4.0.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/nginx-ingress-controller:v1.1.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/defaultbackend-amd64:1.4

    • registry.cn-beijing.aliyuncs.com/kubesphereio/metrics-server:v0.4.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/redis:5.0.14-alpine

    • registry.cn-beijing.aliyuncs.com/kubesphereio/haproxy:2.0.25-alpine

    • registry.cn-beijing.aliyuncs.com/kubesphereio/alpine:3.14

    • registry.cn-beijing.aliyuncs.com/kubesphereio/openldap:1.3.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/netshoot:v1.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/cloudcore:v1.13.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/iptables-manager:v1.13.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/edgeservice:v0.3.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/gatekeeper:v3.5.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/openpitrix-jobs:v3.3.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/devops-apiserver:ks-v3.4.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/devops-controller:ks-v3.4.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/devops-tools:ks-v3.4.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/ks-jenkins:v3.4.0-2.319.3-1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/inbound-agent:4.10-2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-base:v3.2.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-nodejs:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-maven:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-maven:v3.2.1-jdk11

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-python:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.16

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.17

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.18

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-base:v3.2.2-podman

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-nodejs:v3.2.0-podman

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-maven:v3.2.0-podman

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-maven:v3.2.1-jdk11-podman

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-python:v3.2.0-podman

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.0-podman

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.16-podman

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.17-podman

    • registry.cn-beijing.aliyuncs.com/kubesphereio/builder-go:v3.2.2-1.18-podman

    • registry.cn-beijing.aliyuncs.com/kubesphereio/s2ioperator:v3.2.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/s2irun:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/s2i-binary:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/tomcat85-java11-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/tomcat85-java11-runtime:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/tomcat85-java8-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/tomcat85-java8-runtime:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/java-11-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/java-8-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/java-8-runtime:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/java-11-runtime:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/nodejs-8-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/nodejs-6-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/nodejs-4-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/python-36-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/python-35-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/python-34-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/python-27-centos7:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/argocd:v2.3.3

    • registry.cn-beijing.aliyuncs.com/kubesphereio/argocd-applicationset:v0.4.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/dex:v2.30.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/redis:6.2.6-alpine

    • registry.cn-beijing.aliyuncs.com/kubesphereio/configmap-reload:v0.7.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/prometheus:v2.39.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/prometheus-config-reloader:v0.55.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/prometheus-operator:v0.55.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-rbac-proxy:v0.11.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-state-metrics:v2.6.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/node-exporter:v1.3.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/alertmanager:v0.23.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/thanos:v0.31.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/grafana:8.3.3

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-rbac-proxy:v0.11.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/notification-manager-operator:v2.3.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/notification-manager:v2.3.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/notification-tenant-sidecar:v3.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/elasticsearch-curator:v5.7.6

    • registry.cn-beijing.aliyuncs.com/kubesphereio/elasticsearch-oss:6.8.22

    • registry.cn-beijing.aliyuncs.com/kubesphereio/opensearch:2.6.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/opensearch-dashboards:2.6.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/opensearch-curator:v0.0.5

    • registry.cn-beijing.aliyuncs.com/kubesphereio/fluentbit-operator:v0.14.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/docker:19.03

    • registry.cn-beijing.aliyuncs.com/kubesphereio/fluent-bit:v1.9.4

    • registry.cn-beijing.aliyuncs.com/kubesphereio/log-sidecar-injector:v1.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/filebeat:6.7.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-events-operator:v0.6.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-events-exporter:v0.6.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-events-ruler:v0.6.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-auditing-operator:v0.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kube-auditing-webhook:v0.2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/pilot:1.14.6

    • registry.cn-beijing.aliyuncs.com/kubesphereio/proxyv2:1.14.6

    • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-operator:1.29

    • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-agent:1.29

    • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-collector:1.29

    • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-query:1.29

    • registry.cn-beijing.aliyuncs.com/kubesphereio/jaeger-es-index-cleaner:1.29

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kiali-operator:v1.50.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/kiali:v1.50

    • registry.cn-beijing.aliyuncs.com/kubesphereio/busybox:1.31.1

    • registry.cn-beijing.aliyuncs.com/kubesphereio/nginx:1.14-alpine

    • registry.cn-beijing.aliyuncs.com/kubesphereio/wget:1.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/hello:plain-text

    • registry.cn-beijing.aliyuncs.com/kubesphereio/wordpress:4.8-apache

    • registry.cn-beijing.aliyuncs.com/kubesphereio/hpa-example:latest

    • registry.cn-beijing.aliyuncs.com/kubesphereio/fluentd:v1.4.2-2.0

    • registry.cn-beijing.aliyuncs.com/kubesphereio/perl:latest

    • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-productpage-v1:1.16.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-reviews-v1:1.16.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-reviews-v2:1.16.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-details-v1:1.16.2

    • registry.cn-beijing.aliyuncs.com/kubesphereio/examples-bookinfo-ratings-v1:1.16.3

    • registry.cn-beijing.aliyuncs.com/kubesphereio/scope:1.13.0