root@wmsnode:~# ./kk create cluster -f config-sample.yaml
| | / / | | | | / /
| |/ / _ _| |__ ___| |/ / ___ _ _
| \| | | | '_ \ / _ \ \ / _ \ | | |
| |\ \ || | |) | __/ |\ \ __/ |_| |
\| \/\,|./ \\| \/\|\__, |
__/ |
|___/
14:44:13 CST [GreetingsModule] Greetings
14:44:13 CST message: [node1]
Greetings, KubeKey!
14:44:13 CST success: [node1]
14:44:13 CST [NodePreCheckModule] A pre-check on nodes
14:44:13 CST success: [node1]
14:44:13 CST [ConfirmModule] Display confirmation form
+——-+——+——+———+———-+——-+——-+———+———–+——–+——–+————+————+————-+——————+————–+
| name | sudo | curl | openssl | ebtables | socat | ipset | ipvsadm | conntrack | chrony | docker | containerd | nfs client | ceph client | glusterfs client | time |
+——-+——+——+———+———-+——-+——-+———+———–+——–+——–+————+————+————-+——————+————–+
| node1 | y | y | y | y | y | y | y | y | y | | v1.7.6 | | | | CST 14:44:13 |
+——-+——+——+———+———-+——-+——-+———+———–+——–+——–+————+————+————-+——————+————–+
This is a simple check of your environment.
Before installation, ensure that your machines meet all requirements specified at
https://github.com/kubesphere/kubekey#requirements-and-recommendations
Install k8s with specify version: v1.27.4
Continue this installation? [yes/no]: yes
14:44:15 CST success: [LocalHost]
14:44:15 CST [NodeBinariesModule] Download installation binaries
14:44:15 CST message: [localhost]
downloading amd64 kubeadm v1.27.4 …
14:44:16 CST message: [localhost]
kubeadm exists
14:44:16 CST message: [localhost]
downloading amd64 kubelet v1.27.4 …
14:44:16 CST message: [localhost]
kubelet exists
14:44:16 CST message: [localhost]
downloading amd64 kubectl v1.27.4 …
14:44:17 CST message: [localhost]
kubectl exists
14:44:17 CST message: [localhost]
downloading amd64 helm v3.18.5 …
14:44:17 CST message: [localhost]
helm exists
14:44:17 CST message: [localhost]
downloading amd64 kubecni v1.2.0 …
14:44:17 CST message: [localhost]
kubecni exists
14:44:17 CST message: [localhost]
downloading amd64 crictl v1.29.0 …
14:44:17 CST message: [localhost]
crictl exists
14:44:17 CST message: [localhost]
downloading amd64 etcd v3.5.13 …
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 19.1M 100 19.1M 0 0 17.3M 0 0:00:01 0:00:01 –:–:– 17.4M
14:44:19 CST message: [localhost]
downloading amd64 containerd 1.7.13 …
14:44:19 CST message: [localhost]
containerd exists
14:44:19 CST message: [localhost]
downloading amd64 runc v1.1.12 …
14:44:19 CST message: [localhost]
runc exists
14:44:19 CST message: [localhost]
downloading amd64 calicoctl v3.27.4 …
14:44:19 CST message: [localhost]
calicoctl exists
14:44:19 CST success: [LocalHost]
14:44:19 CST [ConfigureOSModule] Get OS release
14:44:19 CST success: [node1]
14:44:19 CST [ConfigureOSModule] Prepare to init OS
14:44:20 CST success: [node1]
14:44:20 CST [ConfigureOSModule] Generate init os script
14:44:20 CST success: [node1]
14:44:20 CST [ConfigureOSModule] Exec init os script
14:44:25 CST stdout: [node1]
net.ipv4.conf.default.rp_filter = 0
net.ipv4.conf.all.rp_filter = 0
net.ipv4.ip_forward = 1
net.ipv6.conf.all.forwarding = 1
net.core.netdev_max_backlog = 65535
net.core.rmem_max = 33554432
net.core.wmem_max = 33554432
net.core.somaxconn = 32768
net.bridge.bridge-nf-call-arptables = 1
vm.max_map_count = 262144
vm.swappiness = 0
vm.overcommit_memory = 0
fs.inotify.max_user_instances = 524288
fs.inotify.max_user_watches = 524288
fs.pipe-max-size = 4194304
fs.aio-max-nr = 262144
kernel.pid_max = 65535
kernel.watchdog_thresh = 5
kernel.hung_task_timeout_secs = 5
net.bridge.bridge-nf-call-ip6tables = 1
net.ipv4.ip_local_reserved_ports = 30000-32767
net.ipv4.tcp_max_syn_backlog = 1048576
net.ipv4.neigh.default.gc_thresh1 = 512
net.ipv4.neigh.default.gc_thresh2 = 2048
net.ipv4.neigh.default.gc_thresh3 = 4096
net.ipv4.tcp_retries2 = 15
net.ipv4.tcp_max_tw_buckets = 1048576
net.ipv4.tcp_max_orphans = 65535
net.ipv4.udp_rmem_min = 131072
net.ipv4.udp_wmem_min = 131072
net.ipv4.conf.all.arp_accept = 1
net.ipv4.conf.default.arp_accept = 1
net.ipv4.conf.all.arp_ignore = 1
net.ipv4.conf.default.arp_ignore = 1
net.bridge.bridge-nf-call-iptables = 1
net.ipv6.conf.all.disable_ipv6 = 0
net.ipv6.conf.default.disable_ipv6 = 0
net.ipv6.conf.lo.disable_ipv6 = 0
net.ipv6.conf.default.accept_dad = 0
net.ipv6.route.max_size = 65536
net.ipv6.neigh.default.retrans_time_ms = 1000
net.ipv4.tcp_keepalive_time = 600
net.ipv4.tcp_keepalive_intvl = 30
net.ipv4.tcp_keepalive_probes = 10
14:44:25 CST success: [node1]
14:44:25 CST [ConfigureOSModule] configure the ntp server for each node
14:44:25 CST skipped: [node1]
14:44:25 CST [KubernetesStatusModule] Get kubernetes cluster status
14:44:25 CST success: [node1]
14:44:25 CST [InstallContainerModule] Sync containerd binaries
14:44:25 CST skipped: [node1]
14:44:25 CST [InstallContainerModule] Generate containerd service
14:44:25 CST skipped: [node1]
14:44:25 CST [InstallContainerModule] Generate containerd config
14:44:25 CST skipped: [node1]
14:44:25 CST [InstallContainerModule] Enable containerd
14:44:25 CST skipped: [node1]
14:44:25 CST [InstallContainerModule] Sync crictl binaries
14:44:25 CST skipped: [node1]
14:44:25 CST [InstallContainerModule] Generate crictl config
14:44:25 CST success: [node1]
14:44:25 CST [PullModule] Start to pull images on all nodes
14:44:25 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/pause:3.9
14:44:25 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.27.4
14:44:26 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-controller-manager:v1.27.4
14:44:26 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-scheduler:v1.27.4
14:44:27 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-proxy:v1.27.4
14:44:27 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/coredns:1.9.3
14:44:28 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/k8s-dns-node-cache:1.22.20
14:44:28 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-controllers:v3.27.4
14:44:28 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/cni:v3.27.4
14:44:29 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/node:v3.27.4
14:44:29 CST message: [node1]
downloading image: registry.cn-beijing.aliyuncs.com/kubesphereio/pod2daemon-flexvol:v3.27.4
14:44:30 CST success: [node1]
14:44:30 CST [ETCDPreCheckModule] Get etcd status
14:44:31 CST stdout: [node1]
ETCD_NAME=wmsnode
14:44:31 CST success: [node1]
14:44:31 CST [CertsModule] Fetch etcd certs
14:44:31 CST message: [node1]
failed to find certificate files: Failed to exec command: sudo -E /bin/bash -c “ls /etc/ssl/etcd/ssl/ | grep .pem”
ls: cannot access ‘/etc/ssl/etcd/ssl/’: No such file or directory: Process exited with status 1
14:44:31 CST retry: [node1]
14:44:36 CST message: [node1]
failed to find certificate files: Failed to exec command: sudo -E /bin/bash -c “ls /etc/ssl/etcd/ssl/ | grep .pem”
ls: cannot access ‘/etc/ssl/etcd/ssl/’: No such file or directory: Process exited with status 1
14:44:36 CST retry: [node1]
14:44:41 CST message: [node1]
failed to find certificate files: Failed to exec command: sudo -E /bin/bash -c “ls /etc/ssl/etcd/ssl/ | grep .pem”
ls: cannot access ‘/etc/ssl/etcd/ssl/’: No such file or directory: Process exited with status 1
14:44:41 CST failed: [node1]
error: Pipeline[CreateClusterPipeline] execute failed: Module[CertsModule] exec failed:
failed: [node1] [FetchETCDCerts] exec failed after 3 retries: failed to find certificate files: Failed to exec command: sudo -E /bin/bash -c “ls /etc/ssl/etcd/ssl/ | grep .pem”
ls: cannot access ‘/etc/ssl/etcd/ssl/’: No such file or directory: Process exited with status 1
