离线安装执行到登录harbor总是报错

anytron

操作系统信息
例如：虚拟机 Centos7 4C/4G

Kubernetes版本信息
v1.21.5

容器运行时
docker 19.03.15

KubeSphere版本信息
v3.2.1 离线安装全套安装

问题是什么
离线安装执行到登录harbor总是报错,单独去登录harbor没问题是可以成功的为什么这里一直报错呢

13:06:34 CST success: [master]
13:06:34 CST success: [node2]
13:06:34 CST success: [node1]
13:06:34 CST [ConfigureOSModule] configure the ntp server for each node
13:06:34 CST skipped: [node1]
13:06:34 CST skipped: [master]
13:06:34 CST skipped: [node2]
13:06:34 CST [KubernetesStatusModule] Get kubernetes cluster status
13:06:35 CST success: [master]
13:06:35 CST [InstallContainerModule] Sync docker binaries
13:06:42 CST skipped: [master]
13:06:42 CST skipped: [node1]
13:06:42 CST [InstallContainerModule] Generate docker service
13:06:43 CST skipped: [master]
13:06:43 CST skipped: [node1]
13:06:43 CST [InstallContainerModule] Generate docker config
13:06:43 CST skipped: [node1]
13:06:43 CST skipped: [master]
13:06:43 CST [InstallContainerModule] Enable docker
13:06:43 CST skipped: [node1]
13:06:43 CST skipped: [master]
13:06:43 CST [InstallContainerModule] Add auths to container runtime
13:07:02 CST message: [node2]
login registry failed, cmd: docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local, err:Failed to exec command: sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local" 
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
Error response from daemon: Get https://dockerhub.kubekey.local/v2/: x509: certificate signed by unknown authority: Process exited with status 1: Failed to exec command: sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local" 
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
Error response from daemon: Get https://dockerhub.kubekey.local/v2/: x509: certificate signed by unknown authority: Process exited with status 1
13:07:02 CST retry: [node2]
13:07:07 CST message: [node2]
login registry failed, cmd: docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local, err:Failed to exec command: sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local" 
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
Error response from daemon: Get https://dockerhub.kubekey.local/v2/: x509: certificate signed by unknown authority: Process exited with status 1: Failed to exec command: sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local" 
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
Error response from daemon: Get https://dockerhub.kubekey.local/v2/: x509: certificate signed by unknown authority: Process exited with status 1
13:07:07 CST retry: [node2]
13:07:12 CST message: [node2]
login registry failed, cmd: docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local, err:Failed to exec command: sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local" 
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
Error response from daemon: Get https://dockerhub.kubekey.local/v2/: x509: certificate signed by unknown authority: Process exited with status 1: Failed to exec command: sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local" 
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
Error response from daemon: Get https://dockerhub.kubekey.local/v2/: x509: certificate signed by unknown authority: Process exited with status 1
13:07:12 CST success: [master]
13:07:12 CST success: [node1]
13:07:12 CST failed: [node2]
error: Pipeline[CreateClusterPipeline] execute failed: Module[InstallContainerModule] exec failed: 
failed: [node2] [Login PrivateRegistry] exec failed after 3 retires: login registry failed, cmd: docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local, err:Failed to exec command: sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local" 
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
Error response from daemon: Get https://dockerhub.kubekey.local/v2/: x509: certificate signed by unknown authority: Process exited with status 1: Failed to exec command: sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local" 
WARNING! Using --password via the CLI is insecure. Use --password-stdin.
Error response from daemon: Get https://dockerhub.kubekey.local/v2/: x509: certificate signed by unknown authority: Process exited with status 1
[root@master kubesphere]#

erdong

遇到了一样的问题，楼主解决了吗？

kube-dzr

我也碰到了一样的问题，请问解决了吗 🤣

erdong

kube-dzr 解决了，仓库节点里面修改这个文件：/etc/docker/daemon.json

[root@re1 harbor]# cat /etc/docker/daemon.json

{

“log-opts”: {

"max-size": "5m",

"max-file":"3"

“exec-opts”: [“native.cgroupdriver=systemd”],

“insecure-registries”: [“dockerhub.kubekey.local”]

}

kube-dzr

erdong 我添加了这个，也没用。。

24sama

看这个日志里面是node2节点报错，可以检测一下是不是node2节点缺少了这个registry的证书（/etc/docker/certs.d）。
可以从其他节点上copy过去。

kube-dzr

24sama login registry failed, cmd: docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local, err:Failed to exec command: sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" dockerhub.kubekey.local" /bin/bash:docker:command not found : Process exited with status 127: Failed to exec command : sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" docker.kubekey.local" /bin/bash:docker:command not found : Process exited with status 127:
您好，我的master，node1,node2,node3都是这个错误，麻烦您看一下，因为我的代码是在内网环境下安装的，不能复制，这是手敲的 🤣

24sama

kube-dzr
报错是：

/bin/bash:docker:command not found

你可以用which docker查一下位置，正常情况应该是会返回/usr/bin/docker

kube-dzr

24sama 我的返回/usr/local/bin/docker

24sama

kube-dzr
可能这个路径不在kk config里面hosts指定的用户的$PATH里？

配置完成后，可以手动执行这个命令进行check

sudo -E /bin/bash -c "docker login --username "admin" --password "Harbor12345" docker.kubekey.local"

kube-dzr

24sama 请问kk config设置是修改哪个文件？是config-sample.yaml文件吗？

24sama

kube-dzr
是的，现在的问题就是在kk config中指定的ssh 用户找不到docker命令。你可以尝试给那些用户添加$PATH，也可以把docker二进制文件copy到用户的$PATH包含的目录中。

kube-dzr

24sama 谢谢，这个问题解决了