Kubesphere V2.0升级到v2.1 运行一天后master1节点NotReady

zhangyan

V2.0升级V2.1一天后， master1 节点状态为NotReady

# kubelet describe nodes master1 ，  部分错误信息如下，请帮忙分析一下是什么原因导致的呢？

Conditions:
  Type                 Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message
  ----                 ------    -----------------                 ------------------                ------              -------
  NetworkUnavailable   False     Tue, 20 Oct 2020 00:35:19 +0800   Tue, 20 Oct 2020 00:35:19 +0800   CalicoIsUp          Calico is running on this node
  MemoryPressure       Unknown   Thu, 22 Oct 2020 09:37:37 +0800   Thu, 22 Oct 2020 09:38:59 +0800   NodeStatusUnknown   Kubelet stopped posting node status.
  DiskPressure         Unknown   Thu, 22 Oct 2020 09:37:37 +0800   Thu, 22 Oct 2020 09:38:59 +0800   NodeStatusUnknown   Kubelet stopped posting node status.
  PIDPressure          Unknown   Thu, 22 Oct 2020 09:37:37 +0800   Thu, 22 Oct 2020 09:38:59 +0800   NodeStatusUnknown   Kubelet stopped posting node status.
  Ready                Unknown   Thu, 22 Oct 2020 09:37:37 +0800   Thu, 22 Oct 2020 09:38:59 +0800   NodeStatusUnknown   Kubelet stopped posting node status.

@hongming @Feynman
有时间帮忙分析一下，多谢！

yuswift

看看你这个节点的kubelet日志看描述主要是它的问题

zhangyan

yuswift 你这个节点的kubelet日志看描述主要是它的问题

系统的日志信息一直在疯狂的报以下错误：
Oct 22 10:14:03 master1 kubelet[6332]: E1022 10:14:03.819001 6332 reflector.go:123] object-“kubesphere-system”/“default-token-ddpsb”: Failed to list *v1.Secret: Get https://${IP}:6443/api/v1/namespaces/kubesphere-system/secrets?fieldSelector=metadata.name%3Ddefault-token-ddpsb&limit=500&resourceVersion=0: write tcp {服务器IP}:48138->{服务器IP}:6443: use of closed network connection

yuswift

zhangyan 这是k8s 目前已知的一个issue 建议重启kubelet
https://github.com/kubernetes/kubernetes/issues/87615