操作系统信息
例如：虚拟机，Centos7.6
Kubernetes版本信息
将 kubectl version 命令执行结果贴在下方
Client Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.10", GitCommit:"eae22ba6238096f5dec1ceb62766e97783f0ba2f", GitTreeState:"clean", BuildDate:"2022-05-24T12:56:35Z", GoVersion:"go1.16.15", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.10", GitCommit:"eae22ba6238096f5dec1ceb62766e97783f0ba2f", GitTreeState:"clean", BuildDate:"2022-05-24T12:50:52Z", GoVersion:"go1.16.15", Compiler:"gc", Platform:"linux/amd64"}
KubeSphere版本信息
v3.3.0。在线安装。使用kk安装。
配置文件
apiVersion: kubekey.kubesphere.io/v1alpha2
kind: Cluster
metadata:
name: sample
spec:
hosts:
- {name: master1, address: 10.11.231.31, internalAddress: 10.11.231.31, user: xx, password: "xxxx"}
- {name: master2, address: 10.11.231.32, internalAddress: 10.11.231.32, user: xx, password: "xxxx"}
- {name: master3, address: 10.11.231.33, internalAddress: 10.11.231.33, user: xx, password: "xxxx"}
- {name: worker1, address: 10.11.231.34, internalAddress: 10.11.231.34, user: xx, password: "xxxx"}
- {name: worker2, address: 10.11.231.35, internalAddress: 10.11.231.35, user: xx, password: "xxxx"}
- {name: worker3, address: 10.11.231.36, internalAddress: 10.11.231.36, user: xx, password: "xxxx"}
- {name: worker4, address: 10.11.231.37, internalAddress: 10.11.231.37, user: xx, password: "xxxx"}
roleGroups:
etcd:
- master1
- master2
- master3
control-plane:
- master1
- master2
- master3
worker:
- worker1
- worker2
- worker3
- worker4
controlPlaneEndpoint:
## Internal loadbalancer for apiservers
internalLoadbalancer: haproxy
domain: lb.kubesphere.local
address: ""
port: 6443
kubernetes:
version: v1.22.10
clusterName: cluster.local
autoRenewCerts: true
containerManager: docker
etcd:
type: kubekey
network:
plugin: calico
kubePodsCIDR: 10.233.64.0/18
kubeServiceCIDR: 10.233.0.0/18
## multus support. https://github.com/k8snetworkplumbingwg/multus-cni
multusCNI:
enabled: false
问题是什么
服务器重启后工作节点注册不上，kubelet_node_status.go:93] "Unable to register node with API server
详细日志如下：
Jan 27 11:13:50 worker4 kubelet[5787]: E0127 11:13:50.991358 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.092417 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.193423 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.202210 5787 event.go:273] Unable to write event: '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"worker4.173e09537d05b7a3", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"worker4", UID:"worker4", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node worker4 status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"worker4"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc0eceb6f648795a3, ext:9117645256, loc:(*time.Location)(0x77bb7c0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc0eceb702cf1bc2b, ext:12258819685, loc:(*time.Location)(0x77bb7c0)}}, Count:8, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'Patch "https://127.0.0.1:6443/api/v1/namespaces/default/events/worker4.173e09537d05b7a3": dial tcp 127.0.0.1:6443: connect: connection refused'(may retry after sleeping)
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.294347 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.395152 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.496313 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.597394 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.698135 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.799272 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:51 worker4 kubelet[5787]: I0127 11:13:51.896970 5787 kubelet_node_status.go:71] "Attempting to register node" node="worker4"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.897632 5787 kubelet_node_status.go:93] "Unable to register node with API server" err="Post \"https://127.0.0.1:6443/api/v1/nodes\": dial tcp 127.0.0.1:6443: connect: connection refused" node="worker4"
Jan 27 11:13:51 worker4 kubelet[5787]: E0127 11:13:51.899770 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.000735 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.100915 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.201801 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.302889 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.403742 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.504145 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.604932 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.705567 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.805729 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:52 worker4 kubelet[5787]: E0127 11:13:52.906342 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:53 worker4 kubelet[5787]: E0127 11:13:53.007452 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:53 worker4 kubelet[5787]: E0127 11:13:53.108634 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:53 worker4 kubelet[5787]: E0127 11:13:53.209759 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:53 worker4 kubelet[5787]: E0127 11:13:53.310889 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"
Jan 27 11:13:53 worker4 kubelet[5787]: E0127 11:13:53.411257 5787 kubelet.go:2451] "Error getting node" err="node \"worker4\" not found"