创建部署问题时,请参考下面模板,你提供的信息越多,越容易及时获得解答。如果未按模板创建问题,管理员有权关闭问题。
确保帖子格式清晰易读,用 markdown code block 语法格式化代码块。
你只花一分钟创建的问题,不能指望别人花上半个小时给你解答。
操作系统信息
Ubuntu 22.04 双cpu,512G内存 240T固态
Kubernetes版本信息
安装3.4版本,最新版本,参考官方的文档
问题是什么
使用离线安装,多节点,使用docker register的本地镜像仓库,因为网络问题,所以没有使用harbor
./kk init registry 。。。 成功运行
./kk create 时遇到问题,
—
部分日志
Storing signatures
07:09:15 UTC Source: oci:/home/kubekey/kubekey/images:kubesphereio:kube-controllers:v3.23.2-amd64
07:09:15 UTC Destination: docker://dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2-amd64
Getting image source signatures
Copying blob 5c02ef17f43f skipped: already exists
Copying blob 082e383ecef6 skipped: already exists
Copying blob 3433589275af skipped: already exists
Copying blob ccf528eae802 skipped: already exists
Copying blob 4c483058dc37 skipped: already exists
Copying blob b86b3270aeb9 skipped: already exists
Copying blob 494561ed2721 skipped: already exists
Copying blob 87913b0b2954 skipped: already exists
Copying config 93205e23ae done
Writing manifest to image destination
—
部分日志
INFO[0072] Retrieving digests of member images
07:09:30 UTC Digest: sha256:5b5654e7e6e7482f0cac731c86160ca7d7177cef041387425efffb27a96155ce Length: 392
07:09:30 UTC Push multi-arch manifest list: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2
。。。
07:09:31 UTC success: [LocalHost]
07:09:31 UTC [PullModule] Start to pull images on all nodes
—
错误的日志
07:09:31 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:31 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:31 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:31 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:32 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-apiserver:v1.23.15
07:09:32 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:32 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:32 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:32 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controller-manager:v1.23.15
07:09:35 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-scheduler:v1.23.15
07:09:36 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:36 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:37 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:37 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:38 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:38 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:39 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:41 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:42 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:42 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:42 UTC message: [5052-2]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:42 UTC retry: [5052-2]
07:09:43 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:43 UTC message: [5052-3]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:43 UTC retry: [5052-3]
07:09:43 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:43 UTC message: [5052-4]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:43 UTC retry: [5052-4]
07:09:46 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:46 UTC message: [5052-1]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:46 UTC retry: [5052-1]
07:09:47 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:47 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:47 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:47 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:47 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:47 UTC message: [5052-2]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:47 UTC retry: [5052-2]
07:09:48 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:48 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:48 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:48 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:48 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:48 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:49 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:49 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:49 UTC message: [5052-3]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:49 UTC retry: [5052-3]
07:09:49 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:49 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:49 UTC message: [5052-4]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:49 UTC retry: [5052-4]
07:09:51 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:51 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-apiserver:v1.23.15
07:09:51 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controller-manager:v1.23.15
07:09:51 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-scheduler:v1.23.15
07:09:51 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:51 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:51 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:51 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:51 UTC message: [5052-1]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:51 UTC retry: [5052-1]
07:09:52 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:53 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:53 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:53 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:53 UTC message: [5052-2]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:53 UTC message: [5052-2]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:54 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:54 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:54 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:54 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:54 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:54 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:54 UTC message: [5052-3]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:54 UTC message: [5052-3]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:54 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:54 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:54 UTC message: [5052-4]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:54 UTC message: [5052-4]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:56 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.6
07:09:56 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-apiserver:v1.23.15
07:09:56 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controller-manager:v1.23.15
07:09:57 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-scheduler:v1.23.15
07:09:57 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.23.15
07:09:57 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.6
07:09:57 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
07:09:57 UTC message: [5052-1]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
07:09:57 UTC message: [5052-1]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
07:09:57 UTC failed: [5052-2]
07:09:57 UTC failed: [5052-3]
07:09:57 UTC failed: [5052-4]
07:09:57 UTC failed: [5052-1]
error: Pipeline[CreateClusterPipeline] execute failed: Module[PullModule] exec failed:
failed: [5052-2] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
failed: [5052-3] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
failed: [5052-4] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
failed: [5052-1] [PullImages] exec failed after 3 retries: pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 –platform amd64”
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown: Process exited with status 1
—
测试了一下,本地镜像仓库是有的
root@5052-1:/home/kubekey# docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1
Error response from daemon: manifest for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.26.1 not found: manifest unknown: manifest unknown
root@5052-1:/home/kubekey# docker pull dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2
v3.23.2: Pulling from kubesphereio/kube-controllers
5c02ef17f43f: Pull complete
082e383ecef6: Pull complete
3433589275af: Pull complete
ccf528eae802: Pull complete
4c483058dc37: Pull complete
b86b3270aeb9: Pull complete
494561ed2721: Pull complete
87913b0b2954: Pull complete
Digest: sha256:b9e04182c66f6ead6b469ec642611858cec7df8c6803c8e56bf54dfd903dce34
Status: Downloaded newer image for dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2
dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.23.2
但是kube-controllers需要的是3.26.1版本,然后根据提供的maniest制作的离线包的版本是3.23.2,造成无法安装