创建部署问题时,请参考下面模板,你提供的信息越多,越容易及时获得解答。如果未按模板创建问题,管理员有权关闭问题。
确保帖子格式清晰易读,用 markdown code block 语法格式化代码块。
你只花一分钟创建的问题,不能指望别人花上半个小时给你解答。

操作系统信息
Ubuntu 22.04 双cpu,512G内存 240T固态

Kubernetes版本信息
安装3.4版本,最新版本,参考官方的文档

问题是什么
使用离线安装,多节点,使用docker register的本地镜像仓库,因为网络问题,所以没有使用harbor

./kk init registry 。。。 成功运行

./kk create 时遇到问题,

部分日志

Storing signatures

07:09:15 UTC Source: oci:/home/kubekey/kubekey/images:kubesphereio:kube-controllers:v3.23.2-amd64

07:09:15 UTC Destination: docker://dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2-amd64

Getting image source signatures

Copying blob 5c02ef17f43f skipped: already exists

Copying blob 082e383ecef6 skipped: already exists

Copying blob 3433589275af skipped: already exists

Copying blob ccf528eae802 skipped: already exists

Copying blob 4c483058dc37 skipped: already exists

Copying blob b86b3270aeb9 skipped: already exists

Copying blob 494561ed2721 skipped: already exists

Copying blob 87913b0b2954 skipped: already exists

Copying config 93205e23ae done

Writing manifest to image destination

部分日志

INFO[0072] Retrieving digests of member images

07:09:30 UTC Digest: sha256:5b5654e7e6e7482f0cac731c86160ca7d7177cef041387425efffb27a96155ce Length: 392

07:09:30 UTC Push multi-arch manifest list: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2

。。。

07:09:31 UTC success: [LocalHost]

07:09:31 UTC [PullModule] Start to pull images on all nodes

错误的日志

07:09:31 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:31 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:31 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:31 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:32 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-apiserver:v1.23.15

07:09:32 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:32 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:32 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:32 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controller-manager:v1.23.15

07:09:35 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-scheduler:v1.23.15

07:09:36 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:36 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:37 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:37 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:38 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:38 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:39 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:41 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:42 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:42 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:42 UTC message: [5052-2]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:42 UTC retry: [5052-2]

07:09:43 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:43 UTC message: [5052-3]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:43 UTC retry: [5052-3]

07:09:43 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:43 UTC message: [5052-4]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:43 UTC retry: [5052-4]

07:09:46 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:46 UTC message: [5052-1]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:46 UTC retry: [5052-1]

07:09:47 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:47 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:47 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:47 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:47 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:47 UTC message: [5052-2]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:47 UTC retry: [5052-2]

07:09:48 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:48 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:48 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:48 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:48 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:48 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:49 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:49 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:49 UTC message: [5052-3]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:49 UTC retry: [5052-3]

07:09:49 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:49 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:49 UTC message: [5052-4]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:49 UTC retry: [5052-4]

07:09:51 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:51 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-apiserver:v1.23.15

07:09:51 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controller-manager:v1.23.15

07:09:51 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-scheduler:v1.23.15

07:09:51 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:51 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:51 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:51 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:51 UTC message: [5052-1]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:51 UTC retry: [5052-1]

07:09:52 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:53 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:53 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:53 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:53 UTC message: [5052-2]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:53 UTC message: [5052-2]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:54 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:54 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:54 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:54 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:54 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:54 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:54 UTC message: [5052-3]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:54 UTC message: [5052-3]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:54 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:54 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:54 UTC message: [5052-4]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:54 UTC message: [5052-4]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:56 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6

07:09:56 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-apiserver:v1.23.15

07:09:56 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controller-manager:v1.23.15

07:09:57 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-scheduler:v1.23.15

07:09:57 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15

07:09:57 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6

07:09:57 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12

07:09:57 UTC message: [5052-1]

downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

07:09:57 UTC message: [5052-1]

pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

07:09:57 UTC failed: [5052-2]

07:09:57 UTC failed: [5052-3]

07:09:57 UTC failed: [5052-4]

07:09:57 UTC failed: [5052-1]

error: Pipeline[CreateClusterPipeline] execute failed: Module[PullModule] exec failed:

failed: [5052-2] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

failed: [5052-3] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

failed: [5052-4] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

failed: [5052-1] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1

测试了一下,本地镜像仓库是有的

root@5052-1:/home/kubekey# docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1

Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown

root@5052-1:/home/kubekey# docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2

v3.23.2: Pulling from kubesphereio/kube-controllers

5c02ef17f43f: Pull complete

082e383ecef6: Pull complete

3433589275af: Pull complete

ccf528eae802: Pull complete

4c483058dc37: Pull complete

b86b3270aeb9: Pull complete

494561ed2721: Pull complete

87913b0b2954: Pull complete

Digest: sha256:b9e04182c66f6ead6b469ec642611858cec7df8c6803c8e56bf54dfd903dce34

Status: Downloaded newer image for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2

dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2

但是kube-controllers需要的是3.26.1版本,然后根据提供的maniest制作的离线包的版本是3.23.2,造成无法安装