calico-node 守护进程，挂的非常频繁，几乎没法用

freemankevin

创建部署问题时，请参考下面模板，你提供的信息越多，越容易及时获得解答。如果未按模板创建问题，管理员有权关闭问题。
确保帖子格式清晰易读，用 markdown code block 语法格式化代码块。
你只花一分钟创建的问题，不能指望别人花上半个小时给你解答。

操作系统信息
虚拟机，Centos7.9，资源充足

Kubernetes版本信息

[root@master1 ~]# kubectl version
Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.6", GitCommit:"8a62859e515889f07e3e3be6a1080413f17cf2c3", GitTreeState:"clean", BuildDate:"2021-04-15T03:28:42Z", GoVersion:"go1.15.10", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.6", GitCommit:"8a62859e515889f07e3e3be6a1080413f17cf2c3", GitTreeState:"clean", BuildDate:"2021-04-15T03:19:55Z", GoVersion:"go1.15.10", Compiler:"gc", Platform:"linux/amd64"}

容器运行时

[root@master1 ~]# docker version
Client: Docker Engine - Community
 Version:           20.10.9
 API version:       1.41
 Go version:        go1.16.8
 Git commit:        c2ea9bc
 Built:             Mon Oct  4 16:08:14 2021
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true

Server: Docker Engine - Community
 Engine:
  Version:          20.10.9
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.16.8
  Git commit:       79ea9d3
  Built:            Mon Oct  4 16:06:37 2021
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.4.11
  GitCommit:        5b46e404f6b9f661a205e28d59c982d3634148f8
 runc:
  Version:          1.0.2
  GitCommit:        v1.0.2-0-g52b36a2
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

KubeSphere版本信息
v3.1.1。离线安装，使用kk安装。

问题是什么
calico 频繁重启，没法用

[root@master1 ~]# kubectl describe -n kube-system  calico-node-nvbpc
error: the server doesn't have a resource type "calico-node-nvbpc"
[root@master1 ~]# kubectl describe -n kube-system  pod calico-node-nvbpc
Name:                 calico-node-nvbpc
Namespace:            kube-system
Priority:             2000001000
Priority Class Name:  system-node-critical
Node:                 node3/10.0.1.217
Start Time:           Fri, 29 Oct 2021 17:26:38 +0800
Labels:               controller-revision-hash=666788ffb7
                      k8s-app=calico-node
                      pod-template-generation=1
Annotations:          <none>
Status:               Running
IP:                   10.0.1.217
IPs:
  IP:           10.0.1.217
Controlled By:  DaemonSet/calico-node
Init Containers:
  upgrade-ipam:
    Container ID:  docker://ef90ce54ca9cdebe4efd8260cf9b9a7e1b6a2b400db575a841acaaf12a6fddb9
    Image:         harbor.dockerregistry.com/calico/cni:v3.16.3
    Image ID:      docker-pullable://harbor.dockerregistry.com/calico/cni@sha256:cce57941d31fa7782e9b1e8b10b706a7f32c8b3a0264f3da14bca6f182d88d91
    Port:          <none>
    Host Port:     <none>
    Command:
      /opt/cni/bin/calico-ipam
      -upgrade
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Fri, 29 Oct 2021 17:26:39 +0800
      Finished:     Fri, 29 Oct 2021 17:26:39 +0800
    Ready:          True
    Restart Count:  0
    Environment Variables from:
      kubernetes-services-endpoint  ConfigMap  Optional: true
    Environment:
      KUBERNETES_NODE_NAME:        (v1:spec.nodeName)
      CALICO_NETWORKING_BACKEND:  <set to the key 'calico_backend' of config map 'calico-config'>  Optional: false
    Mounts:
      /host/opt/cni/bin from cni-bin-dir (rw)
      /var/lib/cni/networks from host-local-net-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from calico-node-token-ht2tw (ro)
  install-cni:
    Container ID:  docker://42d861aec3c0cb23b39ced963b44b8a3a8cce9114428834cb43888c95d681e26
    Image:         harbor.dockerregistry.com/calico/cni:v3.16.3
    Image ID:      docker-pullable://harbor.dockerregistry.com/calico/cni@sha256:cce57941d31fa7782e9b1e8b10b706a7f32c8b3a0264f3da14bca6f182d88d91
    Port:          <none>
    Host Port:     <none>
    Command:
      /opt/cni/bin/install
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Fri, 29 Oct 2021 17:26:40 +0800
      Finished:     Fri, 29 Oct 2021 17:26:40 +0800
    Ready:          True
    Restart Count:  0
    Environment Variables from:
      kubernetes-services-endpoint  ConfigMap  Optional: true
    Environment:
      CNI_CONF_NAME:         10-calico.conflist
      CNI_NETWORK_CONFIG:    <set to the key 'cni_network_config' of config map 'calico-config'>  Optional: false
      KUBERNETES_NODE_NAME:   (v1:spec.nodeName)
      CNI_MTU:               <set to the key 'veth_mtu' of config map 'calico-config'>  Optional: false
      SLEEP:                 false
    Mounts:
      /host/etc/cni/net.d from cni-net-dir (rw)
      /host/opt/cni/bin from cni-bin-dir (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from calico-node-token-ht2tw (ro)
  flexvol-driver:
    Container ID:   docker://203123d0de03dadc2ade2754c855aea6290ba35e929840c9a39add317ff2b39d
    Image:          harbor.dockerregistry.com/calico/pod2daemon-flexvol:v3.16.3
    Image ID:       docker-pullable://harbor.dockerregistry.com/calico/pod2daemon-flexvol@sha256:0a8bbc9c2ab2850cc8d53c2db261ea683bd05797dc09f5078ddde7be7e9c07a7
    Port:           <none>
    Host Port:      <none>
    State:          Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Fri, 29 Oct 2021 17:26:41 +0800
      Finished:     Fri, 29 Oct 2021 17:26:41 +0800
    Ready:          True
    Restart Count:  0
    Environment:    <none>
    Mounts:
      /host/driver from flexvol-driver-host (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from calico-node-token-ht2tw (ro)
Containers:
  calico-node:
    Container ID:   docker://7a2831fb4fbcd9acdfd3a871c491d3906db84fb18a499f96faa4ee4126107809
    Image:          harbor.dockerregistry.com/calico/node:v3.16.3
    Image ID:       docker-pullable://harbor.dockerregistry.com/calico/node@sha256:c587ca7c768ee2007d0405f883e02cd5c13915eec06936d40e6bd91e1c9e39a2
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Tue, 16 Nov 2021 16:57:46 +0800
    Last State:     Terminated
      Reason:       Completed
      Exit Code:    0
      Started:      Tue, 16 Nov 2021 16:56:34 +0800
      Finished:     Tue, 16 Nov 2021 16:57:44 +0800
    Ready:          False
    Restart Count:  3135
    Requests:
      cpu:      250m
    Liveness:   exec [/bin/calico-node -felix-live -bird-live] delay=10s timeout=1s period=10s #success=1 #failure=6
    Readiness:  exec [/bin/calico-node -felix-ready -bird-ready] delay=0s timeout=1s period=10s #success=1 #failure=3
    Environment Variables from:
      kubernetes-services-endpoint  ConfigMap  Optional: true
    Environment:
      DATASTORE_TYPE:                     kubernetes
      WAIT_FOR_DATASTORE:                 true
      NODENAME:                            (v1:spec.nodeName)
      CALICO_NETWORKING_BACKEND:          <set to the key 'calico_backend' of config map 'calico-config'>  Optional: false
      CLUSTER_TYPE:                       k8s,bgp
      NODEIP:                              (v1:status.hostIP)
      IP_AUTODETECTION_METHOD:            can-reach=$(NODEIP)
      IP:                                 autodetect
      CALICO_IPV4POOL_IPIP:               Always
      CALICO_IPV4POOL_VXLAN:              Never
      FELIX_IPINIPMTU:                    <set to the key 'veth_mtu' of config map 'calico-config'>  Optional: false
      FELIX_VXLANMTU:                     <set to the key 'veth_mtu' of config map 'calico-config'>  Optional: false
      FELIX_WIREGUARDMTU:                 <set to the key 'veth_mtu' of config map 'calico-config'>  Optional: false
      CALICO_IPV4POOL_CIDR:               10.233.64.0/18
      CALICO_IPV4POOL_BLOCK_SIZE:         24
      CALICO_DISABLE_FILE_LOGGING:        true
      FELIX_DEFAULTENDPOINTTOHOSTACTION:  ACCEPT
      FELIX_IPV6SUPPORT:                  false
      FELIX_LOGSEVERITYSCREEN:            info
      FELIX_HEALTHENABLED:                true
    Mounts:
      /lib/modules from lib-modules (ro)
      /run/xtables.lock from xtables-lock (rw)
      /sys/fs/ from sysfs (rw)
      /var/lib/calico from var-lib-calico (rw)
      /var/run/calico from var-run-calico (rw)
      /var/run/nodeagent from policysync (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from calico-node-token-ht2tw (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             False
  ContainersReady   False
  PodScheduled      True
Volumes:
  lib-modules:
    Type:          HostPath (bare host directory volume)
    Path:          /lib/modules
    HostPathType:
  var-run-calico:
    Type:          HostPath (bare host directory volume)
    Path:          /var/run/calico
    HostPathType:
  var-lib-calico:
    Type:          HostPath (bare host directory volume)
    Path:          /var/lib/calico
    HostPathType:
  xtables-lock:
    Type:          HostPath (bare host directory volume)
    Path:          /run/xtables.lock
    HostPathType:  FileOrCreate
  sysfs:
    Type:          HostPath (bare host directory volume)
    Path:          /sys/fs/
    HostPathType:  DirectoryOrCreate
  cni-bin-dir:
    Type:          HostPath (bare host directory volume)
    Path:          /opt/cni/bin
    HostPathType:
  cni-net-dir:
    Type:          HostPath (bare host directory volume)
    Path:          /etc/cni/net.d
    HostPathType:
  host-local-net-dir:
    Type:          HostPath (bare host directory volume)
    Path:          /var/lib/cni/networks
    HostPathType:
  policysync:
    Type:          HostPath (bare host directory volume)
    Path:          /var/run/nodeagent
    HostPathType:  DirectoryOrCreate
  flexvol-driver-host:
    Type:          HostPath (bare host directory volume)
    Path:          /usr/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds
    HostPathType:  DirectoryOrCreate
  calico-node-token-ht2tw:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  calico-node-token-ht2tw
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  kubernetes.io/os=linux
Tolerations:     :NoSchedule op=Exists
                 :NoExecute op=Exists
                 CriticalAddonsOnly op=Exists
                 node.kubernetes.io/disk-pressure:NoSchedule op=Exists
                 node.kubernetes.io/memory-pressure:NoSchedule op=Exists
                 node.kubernetes.io/network-unavailable:NoSchedule op=Exists
                 node.kubernetes.io/not-ready:NoExecute op=Exists
                 node.kubernetes.io/pid-pressure:NoSchedule op=Exists
                 node.kubernetes.io/unreachable:NoExecute op=Exists
                 node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
  Type     Reason     Age                      From     Message
  ----     ------     ----                     ----     -------
  Warning  BackOff    12m (x27061 over 14d)    kubelet  Back-off restarting failed container
  Warning  Unhealthy  2m14s (x46027 over 17d)  kubelet  Readiness probe failed:

freemankevin

解决办法：直接删除对应的Deployment，目前来看什么影响都没有。

然后，我还给集群的内核升级到5版本的了。

24sama

用`kubectl logs`命令看下crash的那个pod的日志，你这样把deployment删了，机器重启后calico的pod就都会没了

kevendeng

你这个解决方法是错误的，把已解决的标志删了吧，不要误导后来人

你需要把calico的daemonset重新创建

以及用kubectl logs 查看出问题的pod的错误日志进一步排查原因才行

freemankevin

kevendeng 呃，确实没解决，又又又不停重启了 😅

还有个比较奇怪的情况就是，调度到node3节点，就总是重启，其他节点就完全不会

24sama

node3节点是不是有多网卡？
具体得用kubectl logs calico-xxx命令看看日志

freemankevin

24sama 这个应该是单网卡吧

[root@node3 ~]# ifconfig
cali0850449ee37: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali0d56f425ff4: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali1a54c8bb3d5: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 6567752  bytes 27118970018 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615211  bytes 4386461318 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali276ef68e9f8: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali37cb5abdba9: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali3ad9c099baa: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali3ccacb8e256: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 6567752  bytes 27118970018 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615211  bytes 4386461318 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali4aae9bb3b7b: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 6567752  bytes 27118970018 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615211  bytes 4386461318 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali4d239ec8772: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 6567752  bytes 27118970018 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615211  bytes 4386461318 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali52c4c742403: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali56dd9f56194: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 6567752  bytes 27118970018 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615211  bytes 4386461318 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali5e7348d9727: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali7f1fc57aff6: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali8644b9f106d: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

cali8d93573621f: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

calib02aa70eb3c: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

caliba24239120b: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 6567752  bytes 27118970018 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615212  bytes 4386461393 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

calibc0ab61fd84: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

calie46e79cea0b: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 6567753  bytes 27118970070 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615212  bytes 4386461393 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

caliefe0f118f92: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

calif36113bd1a6: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 6567753  bytes 27118970070 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615212  bytes 4386461393 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

califfc1f4c1065: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1440
        inet6 fe80::ecee:eeff:feee:eeee  prefixlen 64  scopeid 0x20<link>
        ether ee:ee:ee:ee:ee:ee  txqueuelen 0  (Ethernet)
        RX packets 6567753  bytes 27118970070 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615212  bytes 4386461393 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

docker0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        inet 172.17.0.1  netmask 255.255.0.0  broadcast 172.17.255.255
        ether 02:42:23:e3:dd:1d  txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

ens192: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.0.1.217  netmask 255.255.255.0  broadcast 10.0.1.255
        inet6 fe80::250:56ff:fe98:7cd2  prefixlen 64  scopeid 0x20<link>
        ether 00:50:56:98:7c:d2  txqueuelen 1000  (Ethernet)
        RX packets 31109998  bytes 33665286805 (31.3 GiB)
        RX errors 0  dropped 50  overruns 0  frame 0
        TX packets 12377877  bytes 5811412075 (5.4 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 1859376  bytes 258907663 (246.9 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 1859376  bytes 258907663 (246.9 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

tunl0: flags=193<UP,RUNNING,NOARP>  mtu 1440
        inet 10.233.92.0  netmask 255.255.255.255
        tunnel   txqueuelen 1000  (IPIP Tunnel)
        RX packets 6567753  bytes 27118970070 (25.2 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 5615212  bytes 4386461393 (4.0 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

freemankevin

24sama 日志一大堆，也没见啥警告和报错，我给初始时间延长了

freemankevin

24sama 这个是日志，https://www.yuque.com/docs/share/04bbb186-f64f-41b5-8553-7dbd9151e70b?# 《calico-node 挂了》

刚刚起来，

kevendeng

freemankevin

因为你的calico-node这次已经成功初始化并运行了，自然所得到的日志也都是正常的日志。

你提到你增加了初始探活的时间，或许这确实只是一次偶发的初始化超时问题。

freemankevin

kevendeng 好像又开始了 🤣

这次的日志：

https://www.yuque.com/docs/share/a5ab8553-adce-4a48-9aa4-cfcdcaa4e9df?# 《calico-node 又挂了？》

我给他延时加倍试下，晚点再看下

freemankevin

kevendeng 呃，到现在都没再重启了呢，上面那个是昨晚改的延时

kevendeng

freemankevin

用kubectl logs -n kube-system calico-node-xxx -p -c calico-node 看看之前退出的容器有什么报错

freemankevin

kevendeng 木有了

到目前为止确实没在重启了，

freemankevin

kevendeng 明天再看下若不再重启是不是就意味解决了 😅

kevendeng

freemankevin

是的，先观察看看吧，如果再次报错退出，记得保留现场，不要删pod

然后用kubectl logs -p 查看已退出容器的日志

freemankevin

kevendeng 好的，当时改完延时他就自动删除重建了 😃

freemankevin

kevendeng 可能和系统过载有点关系，刚刚cpu飙到6他又又重启了

日志查询还是无结果，可能要等他重启完才能看了

…

现在重启完也什么都没有，官方对这个做了什么特别的封装吗？常规命令好像都不好使