创建部署问题时，请参考下面模板，你提供的信息越多，越容易及时获得解答。如果未按模板创建问题，管理员有权关闭问题。
确保帖子格式清晰易读，用 markdown code block 语法格式化代码块。
你只花一分钟创建的问题，不能指望别人花上半个小时给你解答。
操作系统信息
虚拟机 Centos 7.9
Kubernetes版本信息
v1.23.15
容器运行时
docker:20.10.8 contanerd:v1.4.9
KubeSphere版本信息
v3.0.10。离线安装 使用kk安装。
问题是什么
[root@master cloud]# ./kk create cluster -f config-sample.yaml -a kubesphere.tar.gz –with-packages
| | / / | | | | / /
| |/ / _ _| |__ ___| |/ / ___ _ _
| \| | | | '_ \ / _ \ \ / _ \ | | |
| |\ \ || | |) | __/ |\ \ __/ |_| |
\| \/\,|./ \\| \/\|\__, |
__/ |
|___/
21:05:43 CST [GreetingsModule] Greetings
21:05:43 CST message: [master]
Greetings, KubeKey!
21:05:43 CST message: [node1]
Greetings, KubeKey!
21:05:43 CST message: [node2]
Greetings, KubeKey!
21:05:43 CST success: [master]
21:05:43 CST success: [node1]
21:05:43 CST success: [node2]
21:05:43 CST [NodePreCheckModule] A pre-check on nodes
21:05:44 CST success: [node1]
21:05:44 CST success: [master]
21:05:44 CST success: [node2]
21:05:44 CST [ConfirmModule] Display confirmation form
+——–+——+——+———+———-+——-+——-+———+———–+——–+———+————+————+————-+——————+————–+
| name | sudo | curl | openssl | ebtables | socat | ipset | ipvsadm | conntrack | chrony | docker | containerd | nfs client | ceph client | glusterfs client | time |
+——–+——+——+———+———-+——-+——-+———+———–+——–+———+————+————+————-+——————+————–+
| node1 | y | y | y | y | y | y | y | y | y | 20.10.8 | v1.4.9 | y | | | CST 21:05:44 |
| node2 | y | y | y | y | y | y | y | y | y | 20.10.8 | v1.4.9 | y | | | CST 21:05:44 |
| master | y | y | y | y | y | y | y | y | y | 20.10.8 | v1.4.9 | y | | | CST 21:05:44 |
+——–+——+——+———+———-+——-+——-+———+———–+——–+———+————+————+————-+——————+————–+
This is a simple check of your environment.
Before installation, ensure that your machines meet all requirements specified at
https://github.com/kubesphere/kubekey#requirements-and-recommendations
Continue this installation? [yes/no]: yes
21:05:50 CST success: [LocalHost]
21:05:50 CST [UnArchiveArtifactModule] Check the KubeKey artifact md5 value
21:07:31 CST success: [LocalHost]
21:07:31 CST [UnArchiveArtifactModule] UnArchive the KubeKey artifact
21:07:31 CST skipped: [LocalHost]
21:07:31 CST [UnArchiveArtifactModule] Create the KubeKey artifact Md5 file
21:07:31 CST skipped: [LocalHost]
21:07:31 CST [RepositoryModule] Get OS release
21:07:31 CST success: [node2]
21:07:31 CST success: [master]
21:07:31 CST success: [node1]
21:07:31 CST [RepositoryModule] Sync repository iso file to all nodes
21:07:38 CST success: [master]
21:07:38 CST success: [node2]
21:07:38 CST success: [node1]
21:07:38 CST [RepositoryModule] Mount iso file
21:07:38 CST success: [node1]
21:07:38 CST success: [master]
21:07:38 CST success: [node2]
21:07:38 CST [RepositoryModule] New repository client
21:07:38 CST success: [master]
21:07:38 CST success: [node1]
21:07:38 CST success: [node2]
21:07:38 CST [RepositoryModule] Backup original repository
21:07:38 CST success: [master]
21:07:38 CST success: [node2]
21:07:38 CST success: [node1]
21:07:38 CST [RepositoryModule] Add local repository
21:07:38 CST stdout: [node2]
Loaded plugins: fastestmirror
Cleaning repos: base-local
Cleaning up list of fastest mirrors
Other repos take up 906 M of disk space (use –verbose for details)
Loaded plugins: fastestmirror
Determining fastest mirrors
base-local | 2.9 kB 00:00
(⅓): base-local/filelists_ | 240 kB 00:00
(⅔): base-local/primary_db | 403 kB 00:00
(3/3): base-local/other_db | 176 kB 00:00
Metadata Cache Created
21:07:38 CST stdout: [node1]
Loaded plugins: fastestmirror
Cleaning repos: base-local
Cleaning up list of fastest mirrors
Other repos take up 906 M of disk space (use –verbose for details)
Loaded plugins: fastestmirror
Determining fastest mirrors
base-local | 2.9 kB 00:00
(⅓): base-local/filelists_ | 240 kB 00:00
(⅔): base-local/primary_db | 403 kB 00:00
(3/3): base-local/other_db | 176 kB 00:00
Metadata Cache Created
21:07:39 CST stdout: [master]
Loaded plugins: fastestmirror
Cleaning repos: base-local
Cleaning up list of fastest mirrors
Other repos take up 906 M of disk space (use –verbose for details)
Loaded plugins: fastestmirror
Determining fastest mirrors
base-local | 2.9 kB 00:00
(⅓): base-local/filelists_ | 240 kB 00:00
(⅔): base-local/primary_db | 403 kB 00:00
(3/3): base-local/other_db | 176 kB 00:00
Metadata Cache Created
21:07:39 CST success: [node2]
21:07:39 CST success: [node1]
21:07:39 CST success: [master]
21:07:39 CST [RepositoryModule] Install packages
21:07:39 CST stdout: [node2]
Loaded plugins: fastestmirror
Cleaning repos: base-local
Cleaning up list of fastest mirrors
Other repos take up 906 M of disk space (use –verbose for details)
Loaded plugins: fastestmirror
Determining fastest mirrors
base-local | 2.9 kB 00:00
(⅓): base-local/primary_db | 403 kB 00:00
(⅔): base-local/filelists_ | 240 kB 00:00
(3/3): base-local/other_db | 176 kB 00:00
Metadata Cache Created
21:07:39 CST stdout: [node1]
Loaded plugins: fastestmirror
Cleaning repos: base-local
Cleaning up list of fastest mirrors
Other repos take up 906 M of disk space (use –verbose for details)
Loaded plugins: fastestmirror
Determining fastest mirrors
base-local | 2.9 kB 00:00
(⅓): base-local/filelists_ | 240 kB 00:00
(⅔): base-local/primary_db | 403 kB 00:00
(3/3): base-local/other_db | 176 kB 00:00
Metadata Cache Created
21:07:39 CST stdout: [master]
Loaded plugins: fastestmirror
Cleaning repos: base-local
Cleaning up list of fastest mirrors
Other repos take up 906 M of disk space (use –verbose for details)
Loaded plugins: fastestmirror
Determining fastest mirrors
base-local | 2.9 kB 00:00
(⅓): base-local/filelists_ | 240 kB 00:00
(⅔): base-local/primary_db | 403 kB 00:00
(3/3): base-local/other_db | 176 kB 00:00
Metadata Cache Created
21:07:40 CST stdout: [master]
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
Package matching 1:openssl-1.0.2k-25.el7_9.x86_64 already installed. Checking for update.
Package socat-1.7.3.2-2.el7.x86_64 already installed and latest version
Package conntrack-tools-1.4.4-7.el7.x86_64 already installed and latest version
Package ipset-7.1-1.el7.x86_64 already installed and latest version
Package ebtables-2.0.10-16.el7.x86_64 already installed and latest version
Package chrony-3.4-1.el7.x86_64 already installed and latest version
Package ipvsadm-1.27-8.el7.x86_64 already installed and latest version
Nothing to do
21:07:40 CST stdout: [node1]
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
Package matching 1:openssl-1.0.2k-25.el7_9.x86_64 already installed. Checking for update.
Package socat-1.7.3.2-2.el7.x86_64 already installed and latest version
Package conntrack-tools-1.4.4-7.el7.x86_64 already installed and latest version
Package ipset-7.1-1.el7.x86_64 already installed and latest version
Package ebtables-2.0.10-16.el7.x86_64 already installed and latest version
Package chrony-3.4-1.el7.x86_64 already installed and latest version
Package ipvsadm-1.27-8.el7.x86_64 already installed and latest version
Nothing to do
21:07:40 CST stdout: [node2]
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
Package matching 1:openssl-1.0.2k-25.el7_9.x86_64 already installed. Checking for update.
Package socat-1.7.3.2-2.el7.x86_64 already installed and latest version
Package conntrack-tools-1.4.4-7.el7.x86_64 already installed and latest version
Package ipset-7.1-1.el7.x86_64 already installed and latest version
Package ebtables-2.0.10-16.el7.x86_64 already installed and latest version
Package chrony-3.4-1.el7.x86_64 already installed and latest version
Package ipvsadm-1.27-8.el7.x86_64 already installed and latest version
Nothing to do
21:07:40 CST success: [master]
21:07:40 CST success: [node1]
21:07:40 CST success: [node2]
21:07:40 CST [RepositoryModule] Reset repository to the original repository
21:07:40 CST success: [node1]
21:07:40 CST success: [node2]
21:07:40 CST success: [master]
21:07:40 CST [RepositoryModule] Umount ISO file
21:07:40 CST success: [node1]
21:07:40 CST success: [node2]
21:07:40 CST success: [master]
21:07:40 CST [NodeBinariesModule] Download installation binaries
21:07:40 CST message: [localhost]
downloading amd64 kubeadm v1.23.15 …
21:07:41 CST message: [localhost]
kubeadm is existed
21:07:41 CST message: [localhost]
downloading amd64 kubelet v1.23.15 …
21:07:43 CST message: [localhost]
kubelet is existed
21:07:43 CST message: [localhost]
downloading amd64 kubectl v1.23.15 …
21:07:43 CST message: [localhost]
kubectl is existed
21:07:43 CST message: [localhost]
downloading amd64 helm v3.9.0 …
21:07:43 CST message: [localhost]
helm is existed
21:07:43 CST message: [localhost]
downloading amd64 kubecni v1.2.0 …
21:07:44 CST message: [localhost]
kubecni is existed
21:07:44 CST message: [localhost]
downloading amd64 crictl v1.24.0 …
21:07:44 CST message: [localhost]
crictl is existed
21:07:44 CST message: [localhost]
downloading amd64 etcd v3.4.13 …
21:07:45 CST message: [localhost]
etcd is existed
21:07:45 CST message: [localhost]
downloading amd64 docker 20.10.8 …
21:07:45 CST message: [localhost]
docker is existed
21:07:45 CST message: [localhost]
downloading amd64 calicoctl v3.23.2 …
21:07:46 CST message: [localhost]
calicoctl is existed
21:07:46 CST success: [LocalHost]
21:07:46 CST [ConfigureOSModule] Get OS release
21:07:46 CST success: [node2]
21:07:46 CST success: [node1]
21:07:46 CST success: [master]
21:07:46 CST [ConfigureOSModule] Prepare to init OS
21:07:47 CST success: [node1]
21:07:47 CST success: [master]
21:07:47 CST success: [node2]
21:07:47 CST [ConfigureOSModule] Generate init os script
21:07:48 CST success: [node1]
21:07:48 CST success: [master]
21:07:48 CST success: [node2]
21:07:48 CST [ConfigureOSModule] Exec init os script
21:07:49 CST stdout: [node1]
setenforce: SELinux is disabled
Disabled
net.ipv4.ip_forward = 1
net.bridge.bridge-nf-call-arptables = 1
net.bridge.bridge-nf-call-ip6tables = 1
net.bridge.bridge-nf-call-iptables = 1
net.ipv4.ip_local_reserved_ports = 30000-32767
net.core.netdev_max_backlog = 65535
net.core.rmem_max = 33554432
net.core.wmem_max = 33554432
net.core.somaxconn = 32768
net.ipv4.tcp_max_syn_backlog = 1048576
net.ipv4.neigh.default.gc_thresh1 = 512
net.ipv4.neigh.default.gc_thresh2 = 2048
net.ipv4.neigh.default.gc_thresh3 = 4096
net.ipv4.tcp_retries2 = 15
net.ipv4.tcp_max_tw_buckets = 1048576
net.ipv4.tcp_max_orphans = 65535
net.ipv4.udp_rmem_min = 131072
net.ipv4.udp_wmem_min = 131072
net.ipv4.conf.all.rp_filter = 1
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.all.arp_accept = 1
net.ipv4.conf.default.arp_accept = 1
net.ipv4.conf.all.arp_ignore = 1
net.ipv4.conf.default.arp_ignore = 1
vm.max_map_count = 262144
vm.swappiness = 0
vm.overcommit_memory = 0
fs.inotify.max_user_instances = 524288
fs.inotify.max_user_watches = 524288
fs.pipe-max-size = 4194304
fs.aio-max-nr = 262144
kernel.pid_max = 65535
kernel.watchdog_thresh = 5
kernel.hung_task_timeout_secs = 5
21:07:50 CST stdout: [node2]
setenforce: SELinux is disabled
Disabled
net.ipv4.ip_forward = 1
net.bridge.bridge-nf-call-arptables = 1
net.bridge.bridge-nf-call-ip6tables = 1
net.bridge.bridge-nf-call-iptables = 1
net.ipv4.ip_local_reserved_ports = 30000-32767
net.core.netdev_max_backlog = 65535
net.core.rmem_max = 33554432
net.core.wmem_max = 33554432
net.core.somaxconn = 32768
net.ipv4.tcp_max_syn_backlog = 1048576
net.ipv4.neigh.default.gc_thresh1 = 512
net.ipv4.neigh.default.gc_thresh2 = 2048
net.ipv4.neigh.default.gc_thresh3 = 4096
net.ipv4.tcp_retries2 = 15
net.ipv4.tcp_max_tw_buckets = 1048576
net.ipv4.tcp_max_orphans = 65535
net.ipv4.udp_rmem_min = 131072
net.ipv4.udp_wmem_min = 131072
net.ipv4.conf.all.rp_filter = 1
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.all.arp_accept = 1
net.ipv4.conf.default.arp_accept = 1
net.ipv4.conf.all.arp_ignore = 1
net.ipv4.conf.default.arp_ignore = 1
vm.max_map_count = 262144
vm.swappiness = 0
vm.overcommit_memory = 0
fs.inotify.max_user_instances = 524288
fs.inotify.max_user_watches = 524288
fs.pipe-max-size = 4194304
fs.aio-max-nr = 262144
kernel.pid_max = 65535
kernel.watchdog_thresh = 5
kernel.hung_task_timeout_secs = 5
21:07:51 CST stdout: [master]
setenforce: SELinux is disabled
Disabled
net.ipv4.ip_forward = 1
net.bridge.bridge-nf-call-arptables = 1
net.bridge.bridge-nf-call-ip6tables = 1
net.bridge.bridge-nf-call-iptables = 1
net.ipv4.ip_local_reserved_ports = 30000-32767
net.core.netdev_max_backlog = 65535
net.core.rmem_max = 33554432
net.core.wmem_max = 33554432
net.core.somaxconn = 32768
net.ipv4.tcp_max_syn_backlog = 1048576
net.ipv4.neigh.default.gc_thresh1 = 512
net.ipv4.neigh.default.gc_thresh2 = 2048
net.ipv4.neigh.default.gc_thresh3 = 4096
net.ipv4.tcp_retries2 = 15
net.ipv4.tcp_max_tw_buckets = 1048576
net.ipv4.tcp_max_orphans = 65535
net.ipv4.udp_rmem_min = 131072
net.ipv4.udp_wmem_min = 131072
net.ipv4.conf.all.rp_filter = 1
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.all.arp_accept = 1
net.ipv4.conf.default.arp_accept = 1
net.ipv4.conf.all.arp_ignore = 1
net.ipv4.conf.default.arp_ignore = 1
vm.max_map_count = 262144
vm.swappiness = 0
vm.overcommit_memory = 0
fs.inotify.max_user_instances = 524288
fs.inotify.max_user_watches = 524288
fs.pipe-max-size = 4194304
fs.aio-max-nr = 262144
kernel.pid_max = 65535
kernel.watchdog_thresh = 5
kernel.hung_task_timeout_secs = 5
21:07:51 CST success: [node1]
21:07:51 CST success: [node2]
21:07:51 CST success: [master]
21:07:51 CST [ConfigureOSModule] configure the ntp server for each node
21:07:51 CST skipped: [master]
21:07:51 CST skipped: [node2]
21:07:51 CST skipped: [node1]
21:07:51 CST [KubernetesStatusModule] Get kubernetes cluster status
21:07:52 CST success: [master]
21:07:52 CST [InstallContainerModule] Sync docker binaries
21:07:53 CST skipped: [master]
21:07:53 CST skipped: [node2]
21:07:53 CST skipped: [node1]
21:07:53 CST [InstallContainerModule] Generate docker service
21:07:53 CST skipped: [node2]
21:07:53 CST skipped: [master]
21:07:53 CST skipped: [node1]
21:07:53 CST [InstallContainerModule] Generate docker config
21:07:53 CST skipped: [node2]
21:07:53 CST skipped: [master]
21:07:53 CST skipped: [node1]
21:07:53 CST [InstallContainerModule] Enable docker
21:07:53 CST skipped: [node2]
21:07:53 CST skipped: [master]
21:07:53 CST skipped: [node1]
21:07:53 CST [InstallContainerModule] Add auths to container runtime
21:07:54 CST success: [node2]
21:07:54 CST success: [node1]
21:07:54 CST success: [master]
21:07:54 CST [CopyImagesToRegistryModule] Copy images to a private registry from an artifact OCI Path
21:07:54 CST Source: oci:/home/cloud/kubekey/images:kubesphereio:kube-apiserver:v1.23.15-amd64
21:07:54 CST Destination: docker://dockerhub.kubekey.local/kubesphereio/kube-apiserver:v1.23.15-amd64
Getting image source signatures
Getting image source signatures
Getting image source signatures
Getting image source signatures
Getting image source signatures
21:07:55 CST success: [LocalHost]
21:07:55 CST [CopyImagesToRegistryModule] Push multi-arch manifest to private registry
21:07:55 CST message: [LocalHost]
get manifest list failed by module cache
21:07:55 CST failed: [LocalHost]
error: Pipeline[CreateClusterPipeline] execute failed: Module[CopyImagesToRegistryModule] exec failed:
failed: [LocalHost] [PushManifest] exec failed after 1 retries: get manifest list failed by module cache
上面是运行日志，提示get manifest list failed by module cache
我尝试了github和论坛里能找到的所有办法，也重装了好多回，并重置过我的虚机好多次 都没法成功。
