09:14:10 UTC success: [LocalHost]
09:14:10 UTC [PullModule] Start to pull images on all nodes
09:14:10 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/pause:3.4.1
09:14:11 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-apiserver:v1.21.5
09:14:11 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controller-manager:v1.21.5
09:14:11 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-scheduler:v1.21.5
09:14:11 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-proxy:v1.21.5
09:14:11 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/coredns:1.8.0
09:14:11 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/k8s-dns-node-cache:1.15.12
09:14:11 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/kube-controllers:v3.20.0
09:14:11 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/cni:v3.20.0
09:14:11 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/node:v3.20.0
09:14:12 UTC message: [master]
downloading image: dockerhub.kubekey.local/kubesphereio/pod2daemon-flexvol:v3.20.0
09:14:12 UTC success: [master]
09:14:12 UTC [ETCDPreCheckModule] Get etcd status
09:14:12 UTC success: [master]
09:14:12 UTC [CertsModule] Fetch etcd certs
09:14:12 UTC success: [master]
09:14:12 UTC [CertsModule] Generate etcd Certs
[certs] Using existing ca certificate authority
[certs] Using existing admin-master certificate and key on disk
[certs] Using existing member-master certificate and key on disk
[certs] Using existing node-master certificate and key on disk
09:14:12 UTC success: [LocalHost]
09:14:12 UTC [CertsModule] Synchronize certs file
09:14:12 UTC success: [master]
09:14:12 UTC [CertsModule] Synchronize certs file to master
09:14:12 UTC skipped: [master]
09:14:12 UTC [InstallETCDBinaryModule] Install etcd using binary
09:14:13 UTC success: [master]
09:14:13 UTC [InstallETCDBinaryModule] Generate etcd service
09:14:13 UTC success: [master]
09:14:13 UTC [InstallETCDBinaryModule] Generate access address
09:14:13 UTC success: [master]
09:14:13 UTC [ETCDConfigureModule] Health check on exist etcd
09:14:13 UTC skipped: [master]
09:14:13 UTC [ETCDConfigureModule] Generate etcd.env config on new etcd
09:14:13 UTC success: [master]
09:14:13 UTC [ETCDConfigureModule] Refresh etcd.env config on all etcd
09:14:13 UTC success: [master]
09:14:13 UTC [ETCDConfigureModule] Restart etcd
09:14:19 UTC success: [master]
09:14:19 UTC [ETCDConfigureModule] Health check on all etcd
09:14:19 UTC success: [master]
09:14:19 UTC [ETCDConfigureModule] Refresh etcd.env config to exist mode on all etcd
09:14:19 UTC success: [master]
09:14:19 UTC [ETCDConfigureModule] Health check on all etcd
09:14:19 UTC success: [master]
09:14:19 UTC [ETCDBackupModule] Backup etcd data regularly
09:14:26 UTC message: [master]
Failed to run the etcd-backup.sh: Failed to exec command: sudo -E /bin/bash -c “sh /usr/local/bin/kube-scripts/etcd-backup.sh”
2024-09-14 09:14:19.933696 I | ignoring EntryConfChange raft entry
2024-09-14 09:14:19.933771 I | ignoring member attribute update on /0/members/df4b6ccbdf7d32ec/attributes
{“level”:“info”,“ts”:1726305262.962413,“caller”:“snapshot/v3_snapshot.go:119”,“msg”:“created temporary db file”,“path”:“/var/backups/kube_etcd/etcd-2024-09-14-09-14-19/snapshot.db.part”}
{“level”:“info”,“ts”:“2024-09-14T09:14:22.972Z”,“caller”:“clientv3/maintenance.go:200”,“msg”:“opened snapshot stream; downloading”}
{“level”:“info”,“ts”:1726305262.972352,“caller”:“snapshot/v3_snapshot.go:127”,“msg”:“fetching snapshot”,“endpoint”:“https://172.20.1.60:2379”}
{“level”:“info”,“ts”:“2024-09-14T09:14:22.974Z”,“caller”:“clientv3/maintenance.go:208”,“msg”:“completed snapshot read; closing”}
{“level”:“info”,“ts”:1726305262.9765968,“caller”:“snapshot/v3_snapshot.go:142”,“msg”:“fetched snapshot”,“endpoint”:“https://172.20.1.60:2379”,“size”:“20 kB”,“took”:0.01408823}
{“level”:“info”,“ts”:1726305262.976689,“caller”:“snapshot/v3_snapshot.go:152”,“msg”:“saved”,“path”:“/var/backups/kube_etcd/etcd-2024-09-14-09-14-19/snapshot.db”}: Process exited with status 1
09:14:26 UTC retry: [master]
09:14:37 UTC message: [master]
Failed to run the etcd-backup.sh: Failed to exec command: sudo -E /bin/bash -c “sh /usr/local/bin/kube-scripts/etcd-backup.sh”
2024-09-14 09:14:31.135700 I | ignoring EntryConfChange raft entry
2024-09-14 09:14:31.135751 I | ignoring member attribute update on /0/members/df4b6ccbdf7d32ec/attributes
{“level”:“info”,“ts”:1726305274.167426,“caller”:“snapshot/v3_snapshot.go:119”,“msg”:“created temporary db file”,“path”:“/var/backups/kube_etcd/etcd-2024-09-14-09-14-31/snapshot.db.part”}
{“level”:“info”,“ts”:“2024-09-14T09:14:34.176Z”,“caller”:“clientv3/maintenance.go:200”,“msg”:“opened snapshot stream; downloading”}
{“level”:“info”,“ts”:1726305274.1764362,“caller”:“snapshot/v3_snapshot.go:127”,“msg”:“fetching snapshot”,“endpoint”:“https://172.20.1.60:2379”}
{“level”:“info”,“ts”:“2024-09-14T09:14:34.177Z”,“caller”:“clientv3/maintenance.go:208”,“msg”:“completed snapshot read; closing”}
{“level”:“info”,“ts”:1726305274.1801789,“caller”:“snapshot/v3_snapshot.go:142”,“msg”:“fetched snapshot”,“endpoint”:“https://172.20.1.60:2379”,“size”:“20 kB”,“took”:0.012641654}
{“level”:“info”,“ts”:1726305274.1802633,“caller”:“snapshot/v3_snapshot.go:152”,“msg”:“saved”,“path”:“/var/backups/kube_etcd/etcd-2024-09-14-09-14-31/snapshot.db”}: Process exited with status 1
09:14:37 UTC retry: [master]
09:14:48 UTC message: [master]
Failed to run the etcd-backup.sh: Failed to exec command: sudo -E /bin/bash -c “sh /usr/local/bin/kube-scripts/etcd-backup.sh”
2024-09-14 09:14:42.324631 I | ignoring EntryConfChange raft entry
2024-09-14 09:14:42.324773 I | ignoring member attribute update on /0/members/df4b6ccbdf7d32ec/attributes
{“level”:“info”,“ts”:1726305285.3681257,“caller”:“snapshot/v3_snapshot.go:119”,“msg”:“created temporary db file”,“path”:“/var/backups/kube_etcd/etcd-2024-09-14-09-14-42/snapshot.db.part”}
{“level”:“info”,“ts”:“2024-09-14T09:14:45.377Z”,“caller”:“clientv3/maintenance.go:200”,“msg”:“opened snapshot stream; downloading”}
{“level”:“info”,“ts”:1726305285.3775904,“caller”:“snapshot/v3_snapshot.go:127”,“msg”:“fetching snapshot”,“endpoint”:“https://172.20.1.60:2379”}
{“level”:“info”,“ts”:“2024-09-14T09:14:45.379Z”,“caller”:“clientv3/maintenance.go:208”,“msg”:“completed snapshot read; closing”}
{“level”:“info”,“ts”:1726305285.3817863,“caller”:“snapshot/v3_snapshot.go:142”,“msg”:“fetched snapshot”,“endpoint”:“https://172.20.1.60:2379”,“size”:“20 kB”,“took”:0.013545488}
{“level”:“info”,“ts”:1726305285.3819797,“caller”:“snapshot/v3_snapshot.go:152”,“msg”:“saved”,“path”:“/var/backups/kube_etcd/etcd-2024-09-14-09-14-42/snapshot.db”}: Process exited with status 1
09:14:48 UTC failed: [master]
error: Pipeline[CreateClusterPipeline] execute failed: Module[ETCDBackupModule] exec failed:
failed: [master] [BackupETCD] exec failed after 3 retires: Failed to run the etcd-backup.sh: Failed to exec command: sudo -E /bin/bash -c “sh /usr/local/bin/kube-scripts/etcd-backup.sh”
2024-09-14 09:14:42.324631 I | ignoring EntryConfChange raft entry
2024-09-14 09:14:42.324773 I | ignoring member attribute update on /0/members/df4b6ccbdf7d32ec/attributes
{“level”:“info”,“ts”:1726305285.3681257,“caller”:“snapshot/v3_snapshot.go:119”,“msg”:“created temporary db file”,“path”:“/var/backups/kube_etcd/etcd-2024-09-14-09-14-42/snapshot.db.part”}
{“level”:“info”,“ts”:“2024-09-14T09:14:45.377Z”,“caller”:“clientv3/maintenance.go:200”,“msg”:“opened snapshot stream; downloading”}
{“level”:“info”,“ts”:1726305285.3775904,“caller”:“snapshot/v3_snapshot.go:127”,“msg”:“fetching snapshot”,“endpoint”:“https://172.20.1.60:2379”}
{“level”:“info”,“ts”:“2024-09-14T09:14:45.379Z”,“caller”:“clientv3/maintenance.go:208”,“msg”:“completed snapshot read; closing”}
{“level”:“info”,“ts”:1726305285.3817863,“caller”:“snapshot/v3_snapshot.go:142”,“msg”:“fetched snapshot”,“endpoint”:“https://172.20.1.60:2379”,“size”:“20 kB”,“took”:0.013545488}
{“level”:“info”,“ts”:1726305285.3819797,“caller”:“snapshot/v3_snapshot.go:152”,“msg”:“saved”,“path”:“/var/backups/kube_etcd/etcd-2024-09-14-09-14-42/snapshot.db”}: Process exited with status 1
root@master:~#
