calico/node is not ready: BIRD and BGP

zhubao315 · 2022年11月29日

2个节点的calico-node均等待中，报错信息如下：

Name: calico-node-lstdz

Namespace: kube-system

Priority: 2000001000

Priority Class Name: system-node-critical

Node: ecs-f6f0/192.168.55.15

Start Time: Wed, 23 Nov 2022 10:45:56 +0800

Labels: controller-revision-hash=78fbbfbbc8

                  k8s-app=calico-node

                  pod-template-generation=1

Annotations: <none>

Status: Running

IP: 192.168.55.15

IPs:

IP: 192.168.55.15

Controlled By: DaemonSet/calico-node

Init Containers:

upgrade-ipam:

Container ID:  docker://949a97321d25779090f726db4582d48ef82c6821dbcb221fdada460a4700a5cb

Image:         calico/cni:v3.23.2

Image ID:      docker-pullable://calico/cni@sha256:a5c1e5eba59b0b59b6767fbcfb6d4b2cef355a83cfc0627b31e7f4dddfec09d0

Port:          <none>

Host Port:     <none>

Command:

  /opt/cni/bin/calico-ipam

  -upgrade

State:          Terminated

  Reason:       Completed

  Exit Code:    0

  Started:      Wed, 23 Nov 2022 10:45:57 +0800

  Finished:     Wed, 23 Nov 2022 10:45:57 +0800

Ready:          True

Restart Count:  0

Environment Variables from:

  kubernetes-services-endpoint  ConfigMap  Optional: true

Environment:

  KUBERNETES_NODE_NAME:        (v1:spec.nodeName)

  CALICO_NETWORKING_BACKEND:  <set to the key 'calico_backend' of config map 'calico-config'>  Optional: false

Mounts:

  /host/opt/cni/bin from cni-bin-dir (rw)

  /var/lib/cni/networks from host-local-net-dir (rw)

  /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l8bj5 (ro)

install-cni:

Container ID:  docker://fc651e6b709a3c609057748290ef2ed0f993eaab0b44d33055c1f4d0e0800476

Image:         calico/cni:v3.23.2

Image ID:      docker-pullable://calico/cni@sha256:a5c1e5eba59b0b59b6767fbcfb6d4b2cef355a83cfc0627b31e7f4dddfec09d0

Port:          <none>

Host Port:     <none>

Command:

  /opt/cni/bin/install

State:          Terminated

  Reason:       Completed

  Exit Code:    0

  Started:      Wed, 23 Nov 2022 10:45:58 +0800

  Finished:     Wed, 23 Nov 2022 10:46:00 +0800

Ready:          True

Restart Count:  0

Environment Variables from:

  kubernetes-services-endpoint  ConfigMap  Optional: true

Environment:

  CNI_CONF_NAME:         10-calico.conflist

  CNI_NETWORK_CONFIG:    <set to the key 'cni_network_config' of config map 'calico-config'>  Optional: false

  KUBERNETES_NODE_NAME:   (v1:spec.nodeName)

  CNI_MTU:               <set to the key 'veth_mtu' of config map 'calico-config'>  Optional: false

  SLEEP:                 false

Mounts:

  /host/etc/cni/net.d from cni-net-dir (rw)

  /host/opt/cni/bin from cni-bin-dir (rw)

  /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l8bj5 (ro)

Containers:

calico-node:

Container ID:   docker://c57f331d6a56df75b198476b304ea9fc6712e5c071addc5d281d6cf5684a8be8

Image:          calico/node:v3.23.2

Image ID:       docker-pullable://calico/node@sha256:b4ac0660c297b3a582ef2f4a0d7ef86f954ad5497b704b41d82fa99418e7a51e

Port:           <none>

Host Port:      <none>

State:          Running

  Started:      Wed, 23 Nov 2022 10:46:00 +0800

Ready:          False

Restart Count:  0

Requests:

  cpu:      250m

Liveness:   exec [/bin/calico-node -felix-live -bird-live] delay=10s timeout=10s period=10s #success=1 #failure=6

Readiness:  exec [/bin/calico-node -felix-ready -bird-ready] delay=0s timeout=10s period=10s #success=1 #failure=3

Environment Variables from:

  kubernetes-services-endpoint  ConfigMap  Optional: true

Environment:

  DATASTORE_TYPE:                     kubernetes

  WAIT_FOR_DATASTORE:                 true

  NODENAME:                            (v1:spec.nodeName)

  CALICO_NETWORKING_BACKEND:          <set to the key 'calico_backend' of config map 'calico-config'>  Optional: false

  CLUSTER_TYPE:                       k8s,bgp

  NODEIP:                              (v1:status.hostIP)

  IP_AUTODETECTION_METHOD:            can-reach=$(NODEIP)

  IP:                                 autodetect

  CALICO_IPV4POOL_IPIP:               Always

  CALICO_IPV4POOL_VXLAN:              Never

  CALICO_IPV6POOL_VXLAN:              Never

  FELIX_IPINIPMTU:                    <set to the key 'veth_mtu' of config map 'calico-config'>  Optional: false

  FELIX_VXLANMTU:                     <set to the key 'veth_mtu' of config map 'calico-config'>  Optional: false

  FELIX_WIREGUARDMTU:                 <set to the key 'veth_mtu' of config map 'calico-config'>  Optional: false

  CALICO_IPV4POOL_CIDR:               10.233.64.0/18

  CALICO_IPV4POOL_BLOCK_SIZE:         24

  CALICO_DISABLE_FILE_LOGGING:        true

  FELIX_DEFAULTENDPOINTTOHOSTACTION:  ACCEPT

  FELIX_IPV6SUPPORT:                  false

  FELIX_HEALTHENABLED:                true

Mounts:

  /host/etc/cni/net.d from cni-net-dir (rw)

  /lib/modules from lib-modules (ro)

  /run/xtables.lock from xtables-lock (rw)

  /sys/fs/ from sysfs (rw)

  /var/lib/calico from var-lib-calico (rw)

  /var/log/calico/cni from cni-log-dir (ro)

  /var/run/calico from var-run-calico (rw)

  /var/run/nodeagent from policysync (rw)

  /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l8bj5 (ro)

Conditions:

Type Status

Initialized True

Ready False

ContainersReady False

PodScheduled True

Volumes:

lib-modules:

Type:          HostPath (bare host directory volume)

Path:          /lib/modules

HostPathType:

var-run-calico:

Type:          HostPath (bare host directory volume)

Path:          /var/run/calico

HostPathType:

var-lib-calico:

Type:          HostPath (bare host directory volume)

Path:          /var/lib/calico

HostPathType:

xtables-lock:

Type:          HostPath (bare host directory volume)

Path:          /run/xtables.lock

HostPathType:  FileOrCreate

sysfs:

Type:          HostPath (bare host directory volume)

Path:          /sys/fs/

HostPathType:  DirectoryOrCreate

cni-bin-dir:

Type:          HostPath (bare host directory volume)

Path:          /opt/cni/bin

HostPathType:

cni-net-dir:

Type:          HostPath (bare host directory volume)

Path:          /etc/cni/net.d

HostPathType:

cni-log-dir:

Type:          HostPath (bare host directory volume)

Path:          /var/log/calico/cni

HostPathType:

host-local-net-dir:

Type:          HostPath (bare host directory volume)

Path:          /var/lib/cni/networks

HostPathType:

policysync:

Type:          HostPath (bare host directory volume)

Path:          /var/run/nodeagent

HostPathType:  DirectoryOrCreate

kube-api-access-l8bj5:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class: Burstable

Node-Selectors: kubernetes.io/os=linux

Tolerations: :NoSchedule op=Exists

                         :NoExecute op=Exists

                         CriticalAddonsOnly op=Exists

                         node.kubernetes.io/disk-pressure:NoSchedule op=Exists

                         node.kubernetes.io/memory-pressure:NoSchedule op=Exists

                         node.kubernetes.io/network-unavailable:NoSchedule op=Exists

                         node.kubernetes.io/not-ready:NoExecute op=Exists

                         node.kubernetes.io/pid-pressure:NoSchedule op=Exists

                         node.kubernetes.io/unreachable:NoExecute op=Exists

                         node.kubernetes.io/unschedulable:NoSchedule op=Exists

Events:

Type Reason Age From Message

Warning Unhealthy 37s (x38382 over 3d22h) kubelet (combined from similar events): Readiness probe failed: 2022-11-29 01:09:07.507 [INFO][10350] confd/health.go 180: Number of node(s) with BGP peering established = 0

calico/node is not ready: BIRD is not ready: BGP not established with 192.168.55.242

Rrenyunkang · 2023年1月12日

bgp 无法建立连接，检查一下你的网络 192.168.55.15 和 192.168.55.242 是否可以连通呢