创建部署问题时,请参考下面模板,你提供的信息越多,越容易及时获得解答。
你只花一分钟创建的问题,不能指望别人花上半个小时给你解答。
发帖前请点击 发表主题 右边的 预览(👀) 按钮,确保帖子格式正确。
操作系统信息
例如:虚拟机,/Ubuntu22,2C/16G
Kubernetes版本信息
例如:v18.6。单节点还是多节点。
容器运行时
例如,使用 docker/containerd,版本多少
KubeSphere版本信息
例如:v2.1.1/v3.0.0。离线安装还是在线安装。已有K8s安装。
问题是什么
我这个kubesphere之前是离线安装的, 离线安装的时候也遇到这个问题。 但通过分两步部署,先部署kubernetes,再部署kubepshere的相关组件的pod,这个问题就没有出现。如今想添加节点,2个master,此问题又出现,折腾了很久也没解决:
就是在kk配置完系统和docker之后,始终要去连外网dockerhub去下载 kubesphere/puase:3.5这个镜像,而不使用本地的harbor registry,通过debug信息看到harbor是登录成功了的, 手工检查 dockerhub.kubekey.local/kubersphereio/pause:3.5是存在的,
yb01原有master, yb04/05 准备新添加的master, yb02/03 work nodes
日志如下:
08:13:10 CST [InstallContainerModule] Add auths to container runtime
08:13:10 CST command: [yb05]
sudo -E /bin/bash -c “if [ -z $(which docker) ] || [ ! -e /var/run/docker.sock ]; then echo ‘not exist’; fi”
08:13:10 CST command: [yb04]
sudo -E /bin/bash -c “if [ -z $(which docker) ] || [ ! -e /var/run/docker.sock ]; then echo ‘not exist’; fi”
08:13:10 CST command: [yb04]
sudo -E /bin/bash -c "docker login –username “admin” –password “Harbor12345” dockerhub.kubekey.local"
08:13:10 CST stdout: [yb04]
WARNING! Using –password via the CLI is insecure. Use –password-stdin.
WARNING! Your password will be stored unencrypted in /root/.docker/config.json.
Configure a credential helper to remove this warning. See
https://docs.docker.com/engine/reference/commandline/login/#credentials-store
Login Succeeded
08:13:10 CST command: [yb04]
sudo -E /bin/bash -c “if [ -e $HOME/.docker/config.json ]; then echo ‘exist’; fi”
08:13:10 CST stdout: [yb04]
exist
08:13:10 CST command: [yb04]
sudo -E /bin/bash -c “mkdir -p /.docker && cp -f $HOME/.docker/config.json /.docker/ && chmod 0644 /.docker/config.json ”
08:13:10 CST command: [yb05]
sudo -E /bin/bash -c "docker login –username “admin” –password “Harbor12345” dockerhub.kubekey.local"
08:13:10 CST stdout: [yb05]
WARNING! Using –password via the CLI is insecure. Use –password-stdin.
WARNING! Your password will be stored unencrypted in /root/.docker/config.json.
Configure a credential helper to remove this warning. See
https://docs.docker.com/engine/reference/commandline/login/#credentials-store
Login Succeeded
08:13:10 CST command: [yb05]
sudo -E /bin/bash -c “if [ -e $HOME/.docker/config.json ]; then echo ‘exist’; fi”
08:13:10 CST stdout: [yb05]
exist
08:13:10 CST command: [yb05]
sudo -E /bin/bash -c “mkdir -p /.docker && cp -f $HOME/.docker/config.json /.docker/ && chmod 0644 /.docker/config.json ”
08:13:10 CST skipped: [yb03]
08:13:10 CST skipped: [yb01]
08:13:10 CST skipped: [yb02]
08:13:10 CST success: [yb04]
08:13:10 CST success: [yb05]
08:13:10 CST [PullModule] Start to pull images on all nodes
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST message: [yb03]
downloading image: kubesphere/pause:3.5
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST message: [yb04]
downloading image: kubesphere/pause:3.5
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST message: [yb01]
downloading image: kubesphere/pause:3.5
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST message: [yb05]
downloading image: kubesphere/pause:3.5
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST pauseTag: 3.5, corednsTag: 1.8.0
08:13:10 CST message: [yb02]
downloading image: kubesphere/pause:3.5
08:13:25 CST command: [yb05]
sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
08:13:25 CST stdout: [yb05]
Error response from daemon: Get “https://registry-1.docker.io/v2/”: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
08:13:25 CST stderr: [yb05]
Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers): Process exited with status 1
08:13:25 CST message: [yb05]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers): Process exited with status 1
08:13:25 CST retry: [yb05]
08:13:25 CST command: [yb04]
sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
08:13:25 CST stdout: [yb04]
Error response from daemon: Get “https://registry-1.docker.io/v2/”: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
08:13:25 CST stderr: [yb04]
Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers): Process exited with status 1
08:13:25 CST message: [yb04]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers): Process exited with status 1
08:13:25 CST retry: [yb04]
08:13:26 CST command: [yb03]
sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
08:13:26 CST stdout: [yb03]
Error response from daemon: Get “https://registry-1.docker.io/v2/”: context deadline exceeded (Client.Timeout exceeded while awaiting headers)
08:13:26 CST stderr: [yb03]
Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: context deadline exceeded (Client.Timeout exceeded while awaiting headers): Process exited with status 1
08:13:26 CST message: [yb03]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: context deadline exceeded (Client.Timeout exceeded while awaiting headers): Process exited with status 1
08:13:26 CST retry: [yb03]
08:13:26 CST command: [yb02]
sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
08:13:26 CST stdout: [yb02]
Error response from daemon: Get “https://registry-1.docker.io/v2/”: dial tcp 3.216.34.172:443: i/o timeout
08:13:26 CST stderr: [yb02]
Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: dial tcp 3.216.34.172:443: i/o timeout: Process exited with status 1
08:13:26 CST message: [yb02]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: dial tcp 3.216.34.172:443: i/o timeout: Process exited with status 1
08:13:26 CST retry: [yb02]
08:13:26 CST command: [yb01]
sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
08:13:26 CST stdout: [yb01]
Error response from daemon: Get “https://registry-1.docker.io/v2/”: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
08:13:26 CST stderr: [yb01]
Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers): Process exited with status 1
08:13:26 CST message: [yb01]
pull image failed: Failed to exec command: sudo -E /bin/bash -c “env PATH=$PATH docker pull kubesphere/pause:3.5”
Error response from daemon: Get “https://registry-1.docker.io/v2/”: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers): Process exited with status 1
08:13:26 CST retry: [yb01]