KubeKey安装修改默认sc，能使用，但是一直重启并有warning

sxilef

操作系统信息 Ubuntu20.04，8C/16G 3台：101（master），102，103

Kubernetes版本信息 v1.21.5

容器运行时 docker: 20.10.8

KubeSphere版本信息 v3.2.1。在线全套安装。

问题使用了addons去使用nfs来替换默认的sc local

config-sample.yaml如下：

...
  addons: 
  - name: nfs-client
    namespace: default
    sources: 
      yaml: 
        path: 
        - /my/default-nfs-sc.yaml

default-nfs-sc.yaml


apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: nfs-storage
  annotations:
    storageclass.kubernetes.io/is-default-class: "true"
provisioner: k8s-sigs.io/nfs-subdir-external-provisioner
parameters:
  archiveOnDelete: "true"

---
apiVersion: apps/v1
kind: Deployment
metadata:
  name: nfs-client-provisioner
  labels:
    app: nfs-client-provisioner
  namespace: default
spec:
  replicas: 1
  strategy:
    type: Recreate
  selector:
    matchLabels:
      app: nfs-client-provisioner
  template:
    metadata:
      labels:
        app: nfs-client-provisioner
    spec:
      serviceAccountName: nfs-client-provisioner
      containers:
        - name: nfs-client-provisioner
          image: registry.cn-beijing.aliyuncs.com/kubesphereio/nfs-subdir-external-provisioner:v4.0.2
          # resources:
          #    limits:
          #      cpu: 10m
          #    requests:
          #      cpu: 10m
          volumeMounts:
            - name: nfs-client-root
              mountPath: /persistentvolumes
          env:
            - name: PROVISIONER_NAME
              value: k8s-sigs.io/nfs-subdir-external-provisioner
            - name: NFS_SERVER
              value: 192.168.0.101
            - name: NFS_PATH  
              value: /opt/nfs/data
      volumes:
        - name: nfs-client-root
          nfs:
            server: 192.168.0.101
            path: /opt/nfs/data
---
apiVersion: v1
kind: ServiceAccount
metadata:
  name: nfs-client-provisioner
  namespace: default
---
kind: ClusterRole
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: nfs-client-provisioner-runner
rules:
  - apiGroups: [""]
    resources: ["nodes"]
    verbs: ["get", "list", "watch"]
  - apiGroups: [""]
    resources: ["persistentvolumes"]
    verbs: ["get", "list", "watch", "create", "delete"]
  - apiGroups: [""]
    resources: ["persistentvolumeclaims"]
    verbs: ["get", "list", "watch", "update"]
  - apiGroups: ["storage.k8s.io"]
    resources: ["storageclasses"]
    verbs: ["get", "list", "watch"]
  - apiGroups: [""]
    resources: ["events"]
    verbs: ["create", "update", "patch"]
---
kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: run-nfs-client-provisioner
subjects:
  - kind: ServiceAccount
    name: nfs-client-provisioner
    namespace: default
roleRef:
  kind: ClusterRole
  name: nfs-client-provisioner-runner
  apiGroup: rbac.authorization.k8s.io
---
kind: Role
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: leader-locking-nfs-client-provisioner
  namespace: default
rules:
  - apiGroups: [""]
    resources: ["endpoints"]
    verbs: ["get", "list", "watch", "create", "update", "patch"]
---
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: leader-locking-nfs-client-provisioner
  namespace: default
subjects:
  - kind: ServiceAccount
    name: nfs-client-provisioner
    namespace: default
roleRef:
  kind: Role
  name: leader-locking-nfs-client-provisioner
  apiGroup: rbac.authorization.k8s.io

在使用KubeKey安装完成后，有出现提示Default storageClass in cluster is not unique!，但是查看sc时，发现只有一个，且能使用

NAME                    PROVISIONER                                   RECLAIMPOLICY   VOLUMEBINDINGMODE   ALLOWVOLUMEEXPANSION   AGE
nfs-storage (default)   k8s-sigs.io/nfs-subdir-external-provisioner   Delete          Immediate           false                  36m

pods如下

NAMESPACE                      NAME                                               READY   STATUS      RESTARTS   AGE
default                        nfs-client-provisioner-568fb5cf6f-8k7tw            1/1     Running     2          36m
kube-system                    calico-kube-controllers-75ddb95444-46wtc           1/1     Running     4          36m
kube-system                    calico-node-m9rps                                  1/1     Running     0          36m
kube-system                    calico-node-mjqkx                                  1/1     Running     0          36m
kube-system                    calico-node-p7l6t                                  1/1     Running     0          36m
kube-system                    coredns-5495dd7c88-fv9rk                           1/1     Running     0          37m
kube-system                    coredns-5495dd7c88-vh6wx                           1/1     Running     0          37m
kube-system                    kube-apiserver-ks-master-1                         1/1     Running     0          37m
kube-system                    kube-controller-manager-ks-master-1                1/1     Running     0          37m
kube-system                    kube-proxy-j44q5                                   1/1     Running     0          37m
kube-system                    kube-proxy-mmzd2                                   1/1     Running     0          36m
kube-system                    kube-proxy-v9phl                                   1/1     Running     0          36m
kube-system                    kube-scheduler-ks-master-1                         1/1     Running     0          37m
kube-system                    nodelocaldns-9sbc4                                 1/1     Running     0          36m
kube-system                    nodelocaldns-d76fs                                 1/1     Running     0          36m
kube-system                    nodelocaldns-mzbnm                                 1/1     Running     0          37m
kube-system                    snapshot-controller-0                              1/1     Running     0          33m
kubesphere-controls-system     default-http-backend-5bf68ff9b8-h2h4d              1/1     Running     0          30m
kubesphere-controls-system     kubectl-admin-6667774bb-mpp94                      1/1     Running     0          4m45s
kubesphere-devops-system       devops-27508740-c6697                              0/1     Completed   0          9m15s
kubesphere-devops-system       devops-apiserver-7c6774fff5-fz5xv                  1/1     Running     0          28m
kubesphere-devops-system       devops-controller-98975d478-4hhq5                  1/1     Running     0          28m
kubesphere-devops-system       devops-jenkins-5d744f66b9-s9khp                    1/1     Running     4          28m
kubesphere-devops-system       s2ioperator-0                                      1/1     Running     0          28m
kubesphere-monitoring-system   alertmanager-main-0                                2/2     Running     0          26m
kubesphere-monitoring-system   alertmanager-main-1                                2/2     Running     0          26m
kubesphere-monitoring-system   alertmanager-main-2                                2/2     Running     0          26m
kubesphere-monitoring-system   kube-state-metrics-5547ddd4cc-p6xqk                3/3     Running     0          27m
kubesphere-monitoring-system   node-exporter-lnklg                                2/2     Running     0          28m
kubesphere-monitoring-system   node-exporter-mmlqc                                2/2     Running     0          28m
kubesphere-monitoring-system   node-exporter-sbzj6                                2/2     Running     0          28m
kubesphere-monitoring-system   notification-manager-deployment-78664576cb-9qg8f   2/2     Running     0          21m
kubesphere-monitoring-system   notification-manager-deployment-78664576cb-g7krc   2/2     Running     0          21m
kubesphere-monitoring-system   notification-manager-operator-7d44854f54-nh4fj     2/2     Running     6          27m
kubesphere-monitoring-system   prometheus-k8s-0                                   2/2     Running     1          26m
kubesphere-monitoring-system   prometheus-k8s-1                                   2/2     Running     1          26m
kubesphere-monitoring-system   prometheus-operator-5c5db79546-rcvrk               2/2     Running     0          28m
kubesphere-system              ks-apiserver-6cb49f4764-dn5jt                      1/1     Running     0          26m
kubesphere-system              ks-console-65f4d44d88-qqd27                        1/1     Running     0          30m
kubesphere-system              ks-controller-manager-85f5f5c67c-hw645             1/1     Running     0          26m
kubesphere-system              ks-installer-69df988b79-djt6x                      1/1     Running     0          36m
kubesphere-system              minio-859cb4d777-gz9vc                             1/1     Running     1          32m
kubesphere-system              openldap-0                                         1/1     Running     1          33m
kubesphere-system              openpitrix-import-job-qwczq                        0/1     Completed   0          29m

但是nfs-client-provisioner-568fb5cf6f-8k7tw这个pod一直在重启，describe后提示为Back-off restarting failed container，且一直在不断重启

不仅如此，在不预先创建数据卷的情况下创建工作负载，往往都会有一个警告，但是pod又能成功运行

Events:
Type     Reason            Age   From               Message
----     ------            ----  ----               -------
Warning  FailedScheduling  100s  default-scheduler  0/3 nodes are available: 3 pod has unbound immediate PersistentVolumeClaims.
Normal   Scheduled         98s   default-scheduler  Successfully assigned test/test-redis-0 to ks-node-2
Normal   Pulling           95s   kubelet            Pulling image "redis:6.2.6"
Normal   Pulled            8s    kubelet            Successfully pulled image "redis:6.2.6" in 1m27.400839421s
Normal   Created           7s    kubelet            Created container container-xoed1z
Normal   Started           6s    kubelet            Started container container-xoed1z

这是属于正常的吗？

24sama

用kubectl logs命令查看一下一直在重启的pod nfs-client-provisioner-568fb5cf6f-8k7tw日志：

sxilef

24sama

I0422 03:22:37.305885       1 leaderelection.go:242] attempting to acquire leader lease  default/k8s-sigs.io-nfs-subdir-external-provisioner...
I0422 03:22:53.266398       1 leaderelection.go:252] successfully acquired lease default/k8s-sigs.io-nfs-subdir-external-provisioner
I0422 03:22:53.267186       1 controller.go:820] Starting provisioner controller k8s-sigs.io/nfs-subdir-external-provisioner_nfs-client-provisioner-568fb5cf6f-xcs2p_03475afc-f9ea-4419-800e-41352db281d4!
I0422 03:22:53.267062       1 event.go:278] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"default", Name:"k8s-sigs.io-nfs-subdir-external-provisioner", UID:"c9235d5e-8d83-41db-a89a-23faa9373194", APIVersion:"v1", ResourceVersion:"215177", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' nfs-client-provisioner-568fb5cf6f-xcs2p_03475afc-f9ea-4419-800e-41352db281d4 became leader
I0422 03:22:53.568074       1 controller.go:869] Started provisioner controller k8s-sigs.io/nfs-subdir-external-provisioner_nfs-client-provisioner-568fb5cf6f-xcs2p_03475afc-f9ea-4419-800e-41352db281d4!

24sama

sxilef
在编辑框里点那个插入代码，然后把配置文件内容放在里面

24sama

sxilef
这个日志看着没什么问题，如果发生重启了可以用kubectl logs -p查看上一个容器的日志

sxilef

24sama
有两种日志结果

I0422 03:17:38.737279       1 leaderelection.go:242] attempting to acquire leader lease  default/k8s-sigs.io-nfs-subdir-external-provisioner...
I0422 03:17:57.982669       1 leaderelection.go:252] successfully acquired lease default/k8s-sigs.io-nfs-subdir-external-provisioner
I0422 03:17:57.983572       1 controller.go:820] Starting provisioner controller k8s-sigs.io/nfs-subdir-external-provisioner_nfs-client-provisioner-568fb5cf6f-xcs2p_b1755c63-bfff-40af-a79a-784ceb591352!
I0422 03:17:57.983758       1 event.go:278] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"default", Name:"k8s-sigs.io-nfs-subdir-external-provisioner", UID:"c9235d5e-8d83-41db-a89a-23faa9373194", APIVersion:"v1", ResourceVersion:"214252", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' nfs-client-provisioner-568fb5cf6f-xcs2p_b1755c63-bfff-40af-a79a-784ceb591352 became leader
I0422 03:17:58.484137       1 controller.go:869] Started provisioner controller k8s-sigs.io/nfs-subdir-external-provisioner_nfs-client-provisioner-568fb5cf6f-xcs2p_b1755c63-bfff-40af-a79a-784ceb591352!
E0422 03:22:16.453254       1 leaderelection.go:320] error retrieving resource lock default/k8s-sigs.io-nfs-subdir-external-provisioner: Get "https://10.233.0.1:443/api/v1/namespaces/default/endpoints/k8s-sigs.io-nfs-subdir-external-provisioner": context deadline exceeded
I0422 03:22:16.463053       1 leaderelection.go:277] failed to renew lease default/k8s-sigs.io-nfs-subdir-external-provisioner: timed out waiting for the condition
F0422 03:22:16.463334       1 controller.go:898] leaderelection lost
I0422 03:22:16.463356       1 event.go:278] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"", Name:"", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' nfs-client-provisioner-568fb5cf6f-xcs2p_b1755c63-bfff-40af-a79a-784ceb591352 stopped leading
root@ks-master-1:~# kubectl logs -p nfs-client-provisioner-568fb5cf6f-xcs2p
I0422 03:17:38.737279       1 leaderelection.go:242] attempting to acquire leader lease  default/k8s-sigs.io-nfs-subdir-external-provisioner...
I0422 03:17:57.982669       1 leaderelection.go:252] successfully acquired lease default/k8s-sigs.io-nfs-subdir-external-provisioner
I0422 03:17:57.983572       1 controller.go:820] Starting provisioner controller k8s-sigs.io/nfs-subdir-external-provisioner_nfs-client-provisioner-568fb5cf6f-xcs2p_b1755c63-bfff-40af-a79a-784ceb591352!
I0422 03:17:57.983758       1 event.go:278] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"default", Name:"k8s-sigs.io-nfs-subdir-external-provisioner", UID:"c9235d5e-8d83-41db-a89a-23faa9373194", APIVersion:"v1", ResourceVersion:"214252", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' nfs-client-provisioner-568fb5cf6f-xcs2p_b1755c63-bfff-40af-a79a-784ceb591352 became leader
I0422 03:17:58.484137       1 controller.go:869] Started provisioner controller k8s-sigs.io/nfs-subdir-external-provisioner_nfs-client-provisioner-568fb5cf6f-xcs2p_b1755c63-bfff-40af-a79a-784ceb591352!
E0422 03:22:16.453254       1 leaderelection.go:320] error retrieving resource lock default/k8s-sigs.io-nfs-subdir-external-provisioner: Get "https://10.233.0.1:443/api/v1/namespaces/default/endpoints/k8s-sigs.io-nfs-subdir-external-provisioner": context deadline exceeded
I0422 03:22:16.463053       1 leaderelection.go:277] failed to renew lease default/k8s-sigs.io-nfs-subdir-external-provisioner: timed out waiting for the condition
F0422 03:22:16.463334       1 controller.go:898] leaderelection lost
I0422 03:22:16.463356       1 event.go:278] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"", Name:"", UID:"", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' nfs-client-provisioner-568fb5cf6f-xcs2p_b1755c63-bfff-40af-a79a-784ceb591352 stopped leading

F0422 06:03:57.478537       1 provisioner.go:247] Error getting server version: Get "https://10.233.0.1:443/version?timeout=32s": net/http: TLS handshake timeout

24sama

sxilef
看起来像是网络问题，nfs的pod访问apiserver不通。
可以粘贴一下nfs pod所在节点上kube-proxy的日志和configmap的配置吗，然后还有calico-node的日志。

sxilef

24sama

kube-proxy:

F0422 06:03:57.478537       1 provisioner.go:247] Error getting server version: Get "https://10.233.0.1:443/version?timeout=32s": net/http: TLS handshake timeout
root@ks-master-1:~# kubectl logs -n kube-system                    kube-proxy-j44q5
I0422 03:18:23.015304       1 node.go:172] Successfully retrieved node IP: 192.168.0.101
I0422 03:18:23.015625       1 server_others.go:140] Detected node IP 192.168.0.101
I0422 03:18:28.920264       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary
I0422 03:18:28.920554       1 server_others.go:274] Using ipvs Proxier.
I0422 03:18:28.920586       1 server_others.go:276] creating dualStackProxier for ipvs.
W0422 03:18:28.920744       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
W0422 03:18:28.921846       1 proxier.go:445] IPVS scheduler not specified, use rr by default
W0422 03:18:28.987279       1 proxier.go:445] IPVS scheduler not specified, use rr by default
W0422 03:18:28.987337       1 ipset.go:113] ipset name truncated; [KUBE-6-LOAD-BALANCER-SOURCE-CIDR] -> [KUBE-6-LOAD-BALANCER-SOURCE-CID]
W0422 03:18:28.987365       1 ipset.go:113] ipset name truncated; [KUBE-6-NODE-PORT-LOCAL-SCTP-HASH] -> [KUBE-6-NODE-PORT-LOCAL-SCTP-HAS]
I0422 03:18:28.988756       1 server.go:643] Version: v1.21.5
I0422 03:18:28.999614       1 conntrack.go:52] Setting nf_conntrack_max to 262144
I0422 03:18:29.000253       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
I0422 03:18:29.000395       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
I0422 03:18:29.229696       1 config.go:315] Starting service config controller
I0422 03:18:29.229814       1 config.go:224] Starting endpoint slice config controller
I0422 03:18:29.314801       1 shared_informer.go:240] Waiting for caches to sync for service config
I0422 03:18:29.315248       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
W0422 03:18:29.428991       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:18:29.435290       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:18:29.516416       1 shared_informer.go:247] Caches are synced for endpoint slice config 
I0422 03:18:29.516631       1 shared_informer.go:247] Caches are synced for service config 
W0422 03:24:42.445317       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:26:29.124379       1 graceful_termination.go:92] lw: remote out of the list: 10.233.62.29:443/TCP/10.233.103.13:8443
I0422 03:26:29.124669       1 graceful_termination.go:92] lw: remote out of the list: 10.233.62.29:443/TCP/10.233.82.140:8443
W0422 03:29:59.452087       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:38:44.461002       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:45:54.471648       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:54:04.483101       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 04:00:29.176846       1 graceful_termination.go:92] lw: remote out of the list: 10.233.62.29:443/TCP/10.233.103.16:8443
I0422 04:02:29.182337       1 graceful_termination.go:92] lw: remote out of the list: 10.233.31.121:80/TCP/10.233.103.15:9090
I0422 04:02:29.182744       1 graceful_termination.go:92] lw: remote out of the list: 10.233.62.29:443/TCP/10.233.82.153:8443
W0422 04:03:27.494707       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:12:33.505492       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:22:25.514577       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:27:54.529146       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:34:35.540028       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:44:07.544075       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:52:10.551980       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:59:28.564059       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:05:08.578165       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:11:01.589927       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:20:16.599376       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:26:57.602225       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:32:00.616563       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:37:26.624334       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:47:06.636209       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:53:07.648237       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:02:31.660475       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:08:43.663726       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:14:38.675943       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:20:14.691859       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:28:54.696736       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:35:05.705705       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:44:34.710152       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

I0422 03:14:19.857634       1 node.go:172] Successfully retrieved node IP: 192.168.0.102
I0422 03:14:19.858177       1 server_others.go:140] Detected node IP 192.168.0.102
I0422 03:14:21.387953       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary
I0422 03:14:21.388122       1 server_others.go:274] Using ipvs Proxier.
I0422 03:14:21.388154       1 server_others.go:276] creating dualStackProxier for ipvs.
W0422 03:14:21.388335       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
W0422 03:14:21.390070       1 proxier.go:445] IPVS scheduler not specified, use rr by default
W0422 03:14:21.391316       1 proxier.go:445] IPVS scheduler not specified, use rr by default
W0422 03:14:21.391430       1 ipset.go:113] ipset name truncated; [KUBE-6-LOAD-BALANCER-SOURCE-CIDR] -> [KUBE-6-LOAD-BALANCER-SOURCE-CID]
W0422 03:14:21.392256       1 ipset.go:113] ipset name truncated; [KUBE-6-NODE-PORT-LOCAL-SCTP-HASH] -> [KUBE-6-NODE-PORT-LOCAL-SCTP-HAS]
I0422 03:14:21.393891       1 server.go:643] Version: v1.21.5
I0422 03:14:21.430263       1 conntrack.go:52] Setting nf_conntrack_max to 262144
I0422 03:14:21.430704       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
I0422 03:14:21.430795       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
I0422 03:14:21.503728       1 config.go:224] Starting endpoint slice config controller
I0422 03:14:21.505862       1 config.go:315] Starting service config controller
I0422 03:14:21.506005       1 shared_informer.go:240] Waiting for caches to sync for service config
I0422 03:14:21.506194       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
W0422 03:14:21.583548       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:14:21.588955       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:14:21.606693       1 shared_informer.go:247] Caches are synced for endpoint slice config 
I0422 03:14:21.717736       1 shared_informer.go:247] Caches are synced for service config 
W0422 03:20:57.603267       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:30:45.609149       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:36:57.622990       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:45:50.634153       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:49:21.469458       1 graceful_termination.go:92] lw: remote out of the list: 10.233.26.252:19093/TCP/10.233.82.131:19093
W0422 03:55:02.659289       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:00:41.661220       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:07:25.664013       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:15:57.673338       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:24:36.704595       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:31:15.711006       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:39:26.709968       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:46:08.717963       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:51:23.725620       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:00:03.748276       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:05:24.772249       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:11:53.785350       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:21:14.816614       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:31:03.823547       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:36:21.836265       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:44:37.851660       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:50:52.861652       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:57:50.870364       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:04:06.881942       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:09:22.892361       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:17:51.905498       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:26:00.923714       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:35:18.936490       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:41:25.949663       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

I0422 03:13:45.792304       1 node.go:172] Successfully retrieved node IP: 192.168.0.103
I0422 03:13:45.792581       1 server_others.go:140] Detected node IP 192.168.0.103
I0422 03:13:47.836555       1 server_others.go:206] kube-proxy running in dual-stack mode, IPv4-primary
I0422 03:13:47.837700       1 server_others.go:274] Using ipvs Proxier.
I0422 03:13:47.837758       1 server_others.go:276] creating dualStackProxier for ipvs.
W0422 03:13:47.838327       1 server_others.go:512] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
W0422 03:13:47.839440       1 proxier.go:445] IPVS scheduler not specified, use rr by default
W0422 03:13:47.840116       1 proxier.go:445] IPVS scheduler not specified, use rr by default
W0422 03:13:47.840248       1 ipset.go:113] ipset name truncated; [KUBE-6-LOAD-BALANCER-SOURCE-CIDR] -> [KUBE-6-LOAD-BALANCER-SOURCE-CID]
W0422 03:13:47.840315       1 ipset.go:113] ipset name truncated; [KUBE-6-NODE-PORT-LOCAL-SCTP-HASH] -> [KUBE-6-NODE-PORT-LOCAL-SCTP-HAS]
I0422 03:13:47.841908       1 server.go:643] Version: v1.21.5
I0422 03:13:47.863115       1 conntrack.go:52] Setting nf_conntrack_max to 262144
I0422 03:13:47.863351       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
I0422 03:13:47.863431       1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
I0422 03:13:47.926493       1 config.go:224] Starting endpoint slice config controller
I0422 03:13:47.926635       1 config.go:315] Starting service config controller
I0422 03:13:48.014323       1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
I0422 03:13:48.016299       1 shared_informer.go:240] Waiting for caches to sync for service config
W0422 03:13:48.038044       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:13:48.043238       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:13:48.114798       1 shared_informer.go:247] Caches are synced for endpoint slice config 
I0422 03:13:48.217793       1 shared_informer.go:247] Caches are synced for service config 
W0422 03:22:26.089218       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:26:47.905855       1 graceful_termination.go:92] lw: remote out of the list: 10.233.31.121:80/TCP/10.233.103.10:9090
W0422 03:28:21.133126       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:35:44.126281       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:41:39.151482       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:47:05.227843       1 trace.go:205] Trace[253042453]: "iptables save" (22-Apr-2022 03:47:00.883) (total time: 4343ms):
Trace[253042453]: [4.343615011s] [4.343615011s] END
W0422 03:47:28.839916       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
E0422 03:47:28.840010       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.EndpointSlice: Get "https://lb.kubesphere.local:6443/apis/discovery.k8s.io/v1beta1/endpointslices?allowWatchBookmarks=true&labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=217924&timeout=9m59s&timeoutSeconds=599&watch=true": http2: client connection lost
I0422 03:47:30.298180       1 trace.go:205] Trace[699306089]: "iptables save" (22-Apr-2022 03:47:26.308) (total time: 3989ms):
Trace[699306089]: [3.989057665s] [3.989057665s] END
I0422 03:47:43.486019       1 trace.go:205] Trace[406545640]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:47:29.712) (total time: 13773ms):
Trace[406545640]: [13.773176854s] [13.773176854s] END
E0422 03:47:43.486384       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://lb.kubesphere.local:6443/api/v1/services?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=219188": net/http: TLS handshake timeout
I0422 03:47:45.113392       1 trace.go:205] Trace[1180827875]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:47:29.953) (total time: 15159ms):
Trace[1180827875]: [15.159329759s] [15.159329759s] END
E0422 03:47:45.113955       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.EndpointSlice: failed to list *v1beta1.EndpointSlice: Get "https://lb.kubesphere.local:6443/apis/discovery.k8s.io/v1beta1/endpointslices?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=217924": net/http: TLS handshake timeout
W0422 03:48:11.664449       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:48:11.666835       1 trace.go:205] Trace[1818781349]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:47:48.249) (total time: 23417ms):
Trace[1818781349]: ---"Objects listed" 23417ms (03:48:00.666)
Trace[1818781349]: [23.417539831s] [23.417539831s] END
W0422 03:48:34.699694       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:48:34.703607       1 trace.go:205] Trace[1955402911]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:47:45.380) (total time: 49322ms):
Trace[1955402911]: ---"Objects listed" 49322ms (03:48:00.702)
Trace[1955402911]: [49.322921277s] [49.322921277s] END
W0422 03:49:24.423416       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
W0422 03:49:24.423417       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1beta1.EndpointSlice ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
I0422 03:50:03.971820       1 trace.go:205] Trace[982565061]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:49:27.860) (total time: 36110ms):
Trace[982565061]: ---"Objects listed" 36109ms (03:50:00.970)
Trace[982565061]: [36.110043713s] [36.110043713s] END
W0422 03:50:10.309431       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:50:10.314743       1 trace.go:205] Trace[1511897565]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:49:30.227) (total time: 40086ms):
Trace[1511897565]: ---"Objects listed" 40086ms (03:50:00.313)
Trace[1511897565]: [40.086887978s] [40.086887978s] END
W0422 03:50:14.288904       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 03:52:18.990983       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
W0422 03:52:18.990983       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1beta1.EndpointSlice ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
I0422 03:52:56.425833       1 trace.go:205] Trace[2010106037]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:52:19.972) (total time: 36452ms):
Trace[2010106037]: ---"Objects listed" 36452ms (03:52:00.425)
Trace[2010106037]: [36.452853146s] [36.452853146s] END
W0422 03:53:04.972824       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:53:04.975996       1 trace.go:205] Trace[1358364186]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:52:20.273) (total time: 44702ms):
Trace[1358364186]: ---"Objects listed" 44701ms (03:53:00.974)
Trace[1358364186]: [44.702275199s] [44.702275199s] END
W0422 03:53:10.424733       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:53:37.622841       1 trace.go:205] Trace[1521155477]: "iptables save" (22-Apr-2022 03:53:35.496) (total time: 2126ms):
Trace[1521155477]: [2.126020976s] [2.126020976s] END
I0422 03:53:47.948113       1 graceful_termination.go:92] lw: remote out of the list: 10.233.26.252:19093/TCP/10.233.82.125:19093
W0422 03:53:55.431665       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1beta1.EndpointSlice ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
W0422 03:53:55.431666       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
I0422 03:54:55.328769       1 trace.go:205] Trace[831651882]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:53:57.184) (total time: 58143ms):
Trace[831651882]: ---"Objects listed" 58142ms (03:54:00.327)
Trace[831651882]: [58.143715574s] [58.143715574s] END
W0422 03:55:00.800743       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 03:55:00.803033       1 trace.go:205] Trace[447763635]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 03:53:58.606) (total time: 62196ms):
Trace[447763635]: ---"Objects listed" 62195ms (03:55:00.802)
Trace[447763635]: [1m2.196144651s] [1m2.196144651s] END
W0422 03:55:17.002075       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 04:00:47.957886       1 graceful_termination.go:92] lw: remote out of the list: 10.233.31.121:80/TCP/10.233.103.15:9090
W0422 04:03:19.196276       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:12:19.215907       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:21:29.253492       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:27:01.274361       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:32:47.280571       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:37:55.273983       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:47:29.237201       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 04:54:25.246279       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:01:59.263640       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:08:30.267040       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:17:17.280011       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:22:58.291789       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:29:00.300852       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:34:26.314571       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:41:31.319831       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:49:33.325476       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 05:54:40.336361       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:02:48.072582       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
E0422 06:02:48.073458       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.EndpointSlice: Get "https://lb.kubesphere.local:6443/apis/discovery.k8s.io/v1beta1/endpointslices?allowWatchBookmarks=true&labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=244401&timeout=8m17s&timeoutSeconds=497&watch=true": http2: client connection lost
I0422 06:03:49.053359       1 trace.go:205] Trace[1183068183]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 06:02:49.575) (total time: 59477ms):
Trace[1183068183]: [59.477829643s] [59.477829643s] END
E0422 06:03:49.053597       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://lb.kubesphere.local:6443/api/v1/services?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=242755": http2: client connection lost
I0422 06:03:49.053977       1 trace.go:205] Trace[248189813]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 06:02:49.276) (total time: 59777ms):
Trace[248189813]: [59.777242001s] [59.777242001s] END
E0422 06:03:49.054135       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.EndpointSlice: failed to list *v1beta1.EndpointSlice: Get "https://lb.kubesphere.local:6443/apis/discovery.k8s.io/v1beta1/endpointslices?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=244401": http2: client connection lost
W0422 06:03:51.043659       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:03:51.050241       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:09:43.059203       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:17:48.072672       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:24:44.089321       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:33:05.100409       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:36:35.333132       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1beta1.EndpointSlice ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
W0422 06:36:35.333132       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
W0422 06:37:05.225227       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 06:37:05.228891       1 trace.go:205] Trace[616219736]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 06:36:36.228) (total time: 28999ms):
Trace[616219736]: ---"Objects listed" 28999ms (06:37:00.228)
Trace[616219736]: [28.999903301s] [28.999903301s] END
W0422 06:37:16.923059       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 06:37:16.929771       1 trace.go:205] Trace[2072990283]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 06:36:36.419) (total time: 40510ms):
Trace[2072990283]: ---"Objects listed" 40509ms (06:37:00.928)
Trace[2072990283]: [40.510146967s] [40.510146967s] END
W0422 06:38:03.487371       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1beta1.EndpointSlice ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
W0422 06:38:03.487622       1 reflector.go:436] k8s.io/client-go/informers/factory.go:134: watch of *v1.Service ended with: an error on the server ("unable to decode an event from the watch stream: http2: client connection lost") has prevented the request from succeeding
I0422 06:38:20.053912       1 trace.go:205] Trace[349886349]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 06:38:06.412) (total time: 13640ms):
Trace[349886349]: [13.64080288s] [13.64080288s] END
E0422 06:38:20.054377       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://lb.kubesphere.local:6443/api/v1/services?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=250151": net/http: TLS handshake timeout
I0422 06:38:20.072807       1 trace.go:205] Trace[1126344468]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 06:38:06.263) (total time: 13809ms):
Trace[1126344468]: [13.809496192s] [13.809496192s] END
E0422 06:38:20.073001       1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.EndpointSlice: failed to list *v1beta1.EndpointSlice: Get "https://lb.kubesphere.local:6443/apis/discovery.k8s.io/v1beta1/endpointslices?labelSelector=%21service.kubernetes.io%2Fheadless%2C%21service.kubernetes.io%2Fservice-proxy-name&resourceVersion=250857": net/http: TLS handshake timeout
I0422 06:39:15.280511       1 trace.go:205] Trace[1163316924]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 06:38:26.023) (total time: 49253ms):
Trace[1163316924]: ---"Objects listed" 49252ms (06:39:00.276)
Trace[1163316924]: [49.253041473s] [49.253041473s] END
W0422 06:39:15.307761       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
I0422 06:39:15.308809       1 trace.go:205] Trace[414270998]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 06:38:26.360) (total time: 48948ms):
Trace[414270998]: ---"Objects listed" 48948ms (06:39:00.308)
Trace[414270998]: [48.948295022s] [48.948295022s] END
W0422 06:39:15.319817       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice
W0422 06:45:17.338806       1 warnings.go:70] discovery.k8s.io/v1beta1 EndpointSlice is deprecated in v1.21+, unavailable in v1.25+; use discovery.k8s.io/v1 EndpointSlice

calico-node这边日志比较多，只保留了其中一个的最后部分，三个的话，文本长度超了:

2022-04-22 07:16:53.839 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calia7f7eb96625"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calide7141974fe"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali556a0acc020"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calic66115cff75"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calib8f15fd5d10"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali04c2c65dec3"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calia26a378d556"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali3ccc55ddb0b"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali45fc0621d8a"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali1330a922f04"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali261b3e9fa90"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali7a1c24a64a4"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali6ef7791d878"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali1b471ea6c20"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali629b8c67f54"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calif7c7bbacc1d"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali50440ffe8d8"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="tunl0"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.93.0/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="kube-ipvs0"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.0.3/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.18.192/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.31.121/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.5.163/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.18.33/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.62.29/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.48.197/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.26.100/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.0.1/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.26.252/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.41.171/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.29.220/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.21.29/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.34.77/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.54.100/32"
2022-04-22 07:16:53.840 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.17.152/32"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.40.76/32"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.3.30/32"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.43.10/32"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.52.8/32"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.35.163/32"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.47.248/32"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.6.241/32"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="nodelocaldns"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="169.254.25.10/32"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="docker0"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="172.17.0.1/16"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="ens3"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="192.168.0.102/24"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/reachaddr.go 59: Found matching interface CIDR CIDR="192.168.0.102/24"
2022-04-22 07:16:53.841 [INFO][98] monitor-addresses/startup.go 753: Using autodetected IPv4 address 192.168.0.102/24, detected by connecting to 192.168.0.102
2022-04-22 07:17:12.390 [INFO][92] cni-config-monitor/token_watch.go 53: Notified of change to serviceaccount files. event="/var/run/secrets/kubernetes.io/serviceaccount/..2022_04_22_07_17_12.880475348": CREATE
2022-04-22 07:17:12.397 [INFO][92] cni-config-monitor/token_watch.go 102: Wrote updated CNI kubeconfig file. path="/host/etc/cni/net.d/calico-kubeconfig"
2022-04-22 07:17:13.398 [INFO][92] cni-config-monitor/token_watch.go 53: Notified of change to serviceaccount files. event="/var/run/secrets/kubernetes.io/serviceaccount/..2022_04_22_07_17_12.880475348": CHMOD
2022-04-22 07:17:13.401 [INFO][92] cni-config-monitor/token_watch.go 102: Wrote updated CNI kubeconfig file. path="/host/etc/cni/net.d/calico-kubeconfig"
2022-04-22 07:17:14.402 [INFO][92] cni-config-monitor/token_watch.go 53: Notified of change to serviceaccount files. event="/var/run/secrets/kubernetes.io/serviceaccount/..data_tmp": RENAME
2022-04-22 07:17:14.405 [INFO][92] cni-config-monitor/token_watch.go 102: Wrote updated CNI kubeconfig file. path="/host/etc/cni/net.d/calico-kubeconfig"
2022-04-22 07:17:15.406 [INFO][92] cni-config-monitor/token_watch.go 53: Notified of change to serviceaccount files. event="/var/run/secrets/kubernetes.io/serviceaccount/..data": CREATE
2022-04-22 07:17:15.408 [INFO][92] cni-config-monitor/token_watch.go 102: Wrote updated CNI kubeconfig file. path="/host/etc/cni/net.d/calico-kubeconfig"
2022-04-22 07:17:16.408 [INFO][92] cni-config-monitor/token_watch.go 53: Notified of change to serviceaccount files. event="/var/run/secrets/kubernetes.io/serviceaccount/..2022_04_22_06_28_34.329144144": REMOVE
2022-04-22 07:17:16.410 [INFO][92] cni-config-monitor/token_watch.go 102: Wrote updated CNI kubeconfig file. path="/host/etc/cni/net.d/calico-kubeconfig"
2022-04-22 07:17:36.840 [INFO][96] felix/summary.go 100: Summarising 10 dataplane reconciliation loops over 1m2.5s: avg=20ms longest=43ms (resync-filter-v4)
2022-04-22 07:17:53.843 [INFO][98] monitor-addresses/reachaddr.go 46: Auto-detected address by connecting to remote Destination="192.168.0.102" IP=192.168.0.102
2022-04-22 07:17:53.855 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calia7f7eb96625"
2022-04-22 07:17:53.855 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calide7141974fe"
2022-04-22 07:17:53.855 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali556a0acc020"
2022-04-22 07:17:53.855 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calic66115cff75"
2022-04-22 07:17:53.855 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calib8f15fd5d10"
2022-04-22 07:17:53.855 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali04c2c65dec3"
2022-04-22 07:17:53.855 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calia26a378d556"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali3ccc55ddb0b"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali45fc0621d8a"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali1330a922f04"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali261b3e9fa90"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali7a1c24a64a4"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali6ef7791d878"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali1b471ea6c20"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali629b8c67f54"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="calif7c7bbacc1d"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="cali50440ffe8d8"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="tunl0"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.93.0/32"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="kube-ipvs0"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.0.3/32"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.18.192/32"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.31.121/32"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.5.163/32"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.18.33/32"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.62.29/32"
2022-04-22 07:17:53.856 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.48.197/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.26.100/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.0.1/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.26.252/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.41.171/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.29.220/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.21.29/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.34.77/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.54.100/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.17.152/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.40.76/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.3.30/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.43.10/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.52.8/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.35.163/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.47.248/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="10.233.6.241/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="nodelocaldns"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="169.254.25.10/32"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="docker0"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="172.17.0.1/16"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 55: Checking interface CIDRs Name="ens3"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 57: Checking CIDR CIDR="192.168.0.102/24"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/reachaddr.go 59: Found matching interface CIDR CIDR="192.168.0.102/24"
2022-04-22 07:17:53.857 [INFO][98] monitor-addresses/startup.go 753: Using autodetected IPv4 address 192.168.0.102/24, detected by connecting to 192.168.0.102
2022-04-22 07:18:39.168 [INFO][96] felix/summary.go 100: Summarising 9 dataplane reconciliation loops over 1m2.3s: avg=27ms longest=94ms ()

configmap你需要哪部分的详情配置:

NAMESPACE                         NAME                                    DATA   AGE
default                           kube-root-ca.crt                        1      24h
kube-node-lease                   kube-root-ca.crt                        1      24h
kube-public                       cluster-info                            1      24h
kube-public                       kube-root-ca.crt                        1      24h
kube-system                       calico-config                           4      24h
kube-system                       coredns                                 1      24h
kube-system                       extension-apiserver-authentication      6      24h
kube-system                       kube-proxy                              2      24h
kube-system                       kube-root-ca.crt                        1      24h
kube-system                       kubeadm-config                          2      24h
kube-system                       kubelet-config-1.21                     1      24h
kube-system                       nodelocaldns                            1      24h
kubekey-system                    kube-root-ca.crt                        1      24h
kubekey-system                    sample-kubeconfig                       1      24h
kubesphere-controls-system        kube-root-ca.crt                        1      24h
kubesphere-controls-system        kubeconfig-admin                        1      24h
kubesphere-controls-system        kubeconfig-boss-zhao                    1      24h
kubesphere-controls-system        kubeconfig-dev-wu                       1      24h
kubesphere-controls-system        kubeconfig-dev-zheng                    1      24h
kubesphere-controls-system        kubeconfig-hr-qian                      1      24h
kubesphere-controls-system        kubeconfig-leader-li                    1      24h
kubesphere-controls-system        kubeconfig-leader-sun                   1      24h
kubesphere-controls-system        kubeconfig-pm-zhou                      1      24h
kubesphere-devops-system          devops-config                           1      24h
kubesphere-devops-system          devops-jenkins                          9      24h
kubesphere-devops-system          jenkins-agent-config                    1      24h
kubesphere-devops-system          jenkins-casc-config                     2      24h
kubesphere-devops-system          kube-root-ca.crt                        1      24h
kubesphere-devops-worker          ks-devops-agent                         1      24h
kubesphere-devops-worker          kube-root-ca.crt                        1      24h
kubesphere-monitoring-federated   kube-root-ca.crt                        1      24h
kubesphere-monitoring-system      7b8d27e6.kubesphere.io                  0      24h
kubesphere-monitoring-system      kube-root-ca.crt                        1      24h
kubesphere-monitoring-system      notification-manager-template           1      24h
kubesphere-monitoring-system      prometheus-k8s-rulefiles-0              1      24h
kubesphere-system                 ks-console-config                       1      24h
kubesphere-system                 ks-controller-manager-leader-election   0      24h
kubesphere-system                 ks-router-config                        2      24h
kubesphere-system                 kube-root-ca.crt                        1      24h
kubesphere-system                 kubesphere-config                       1      24h
kubesphere-system                 minio                                   1      24h
kubesphere-system                 openldap-bootstrap                      1      24h
kubesphere-system                 sample-bookinfo                         1      24h
test                              kube-root-ca.crt                        1      24h
test                              rabbitm-45fu44-rabbitmq                 3      23h
test                              test-es-conf                            2      23h
test                              test-mariadb-conf                       1      24h
test                              test-redis-conf                         1      23h
test                              zookeep-2lp2st-zookeeper-scripts        2      23h

24sama

sxilef
可以粘贴一下kube-proxy这个configmap的内容
然后我看kube-proxy日志中有些时候也连不上apiserver的地址lb.kubesphere.local，这个域名的ip地址是你的master节点的内网ip地址吗？
还可以用下面命令看一下apiserver的endpoint

kubectl get ep

最后可以看看kube-apiserver的日志

sxilef

24sama

kube-proxy configmap:

Name:         kube-proxy
Namespace:    kube-system
Labels:       app=kube-proxy
Annotations:  <none>

Data
====
config.conf:
----
apiVersion: kubeproxy.config.k8s.io/v1alpha1
bindAddress: 0.0.0.0
bindAddressHardFail: false
clientConnection:
  acceptContentTypes: ""
  burst: 0
  contentType: ""
  kubeconfig: /var/lib/kube-proxy/kubeconfig.conf
  qps: 0
clusterCIDR: 10.233.64.0/18
configSyncPeriod: 0s
conntrack:
  maxPerCore: null
  min: null
  tcpCloseWaitTimeout: null
  tcpEstablishedTimeout: null
detectLocalMode: ""
enableProfiling: false
healthzBindAddress: ""
hostnameOverride: ""
iptables:
  masqueradeAll: false
  masqueradeBit: 14
  minSyncPeriod: 0s
  syncPeriod: 30s
ipvs:
  excludeCIDRs: null
  minSyncPeriod: 0s
  scheduler: ""
  strictARP: false
  syncPeriod: 0s
  tcpFinTimeout: 0s
  tcpTimeout: 0s
  udpTimeout: 0s
kind: KubeProxyConfiguration
metricsBindAddress: ""
mode: ipvs
nodePortAddresses: null
oomScoreAdj: null
portRange: ""
showHiddenMetricsForVersion: ""
udpIdleTimeout: 0s
winkernel:
  enableDSR: false
  networkName: ""
  sourceVip: ""
kubeconfig.conf:
----
apiVersion: v1
kind: Config
clusters:
- cluster:
    certificate-authority: /var/run/secrets/kubernetes.io/serviceaccount/ca.crt
    server: https://lb.kubesphere.local:6443
  name: default
contexts:
- context:
    cluster: default
    namespace: default
    user: default
  name: default
current-context: default
users:
- name: default
  user:
    tokenFile: /var/run/secrets/kubernetes.io/serviceaccount/token
Events:  <none>

是的，这个域名的ip是master节点的ip地址

# kubekey hosts BEGIN
192.168.0.101  ks-master-1.cluster.local ks-master-1
192.168.0.102  ks-node-1.cluster.local ks-node-1
192.168.0.103  ks-node-2.cluster.local ks-node-2
192.168.0.101  lb.kubesphere.local
# kubekey hosts END

apiserver endpoint:

NAME                                          ENDPOINTS            AGE
k8s-sigs.io-nfs-subdir-external-provisioner   <none>               25h
kubernetes                                    192.168.0.101:6443   25h

kube-apiserver:

W0422 06:04:23.151616       1 client_config.go:615] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0422 06:04:23.156353       1 client_config.go:615] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0422 06:04:23.189648       1 metricsserver.go:238] Metrics API not available.
W0422 06:04:23.190159       1 options.go:183] ks-apiserver starts without redis provided, it will use in memory cache. This may cause inconsistencies when running ks-apiserver with multiple replicas.
I0422 06:04:23.661224       1 interface.go:60] start helm repo informer
I0422 06:04:23.802747       1 apiserver.go:356] Start cache objects
I0422 06:04:25.713949       1 apiserver.go:562] Finished caching objects
I0422 06:04:25.714078       1 apiserver.go:278] Start listening on :9090

24sama

W0422 06:04:23.151616       1 client_config.go:615] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0422 06:04:23.156353       1 client_config.go:615] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0422 06:04:23.189648       1 metricsserver.go:238] Metrics API not available.
W0422 06:04:23.190159       1 options.go:183] ks-apiserver starts without redis provided, it will use in memory cache. This may cause inconsistencies when running ks-apiserver with multiple replicas.
I0422 06:04:23.661224       1 interface.go:60] start helm repo informer
I0422 06:04:23.802747       1 apiserver.go:356] Start cache objects
I0422 06:04:25.713949       1 apiserver.go:562] Finished caching objects
I0422 06:04:25.714078       1 apiserver.go:278] Start listening on :9090

这个日志ks-apiserver的日志，我们需要看看kube-system namespace下的kube-apiserver的日志

sxilef

24sama

I0422 07:40:03.727298       1 trace.go:205] Trace[128487253]: "Update" url:/api/v1/namespaces/default/endpoints/k8s-sigs.io-nfs-subdir-external-provisioner,user-agent:nfs-subdir-external-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,client:192.168.0.102,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 07:40:02.618) (total time: 1108ms):
Trace[128487253]: ---"Object stored in database" 1108ms (07:40:00.726)
Trace[128487253]: [1.108673116s] [1.108673116s] END
I0422 07:40:21.511701       1 client.go:360] parsed scheme: "passthrough"
I0422 07:40:21.512156       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:40:21.512275       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:41:01.536290       1 client.go:360] parsed scheme: "passthrough"
I0422 07:41:01.536593       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:41:01.536645       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:41:42.980576       1 client.go:360] parsed scheme: "passthrough"
I0422 07:41:42.980850       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:41:42.980909       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:42:19.276326       1 client.go:360] parsed scheme: "passthrough"
I0422 07:42:19.276874       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:42:19.276975       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:42:53.055874       1 client.go:360] parsed scheme: "passthrough"
I0422 07:42:53.056185       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:42:53.056246       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:43:37.292638       1 client.go:360] parsed scheme: "passthrough"
I0422 07:43:37.292882       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:43:37.292931       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:44:07.887183       1 client.go:360] parsed scheme: "passthrough"
I0422 07:44:07.887515       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:44:07.887576       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:44:48.636025       1 client.go:360] parsed scheme: "passthrough"
I0422 07:44:48.636447       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:44:48.636569       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:45:24.169794       1 client.go:360] parsed scheme: "passthrough"
I0422 07:45:24.170576       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:45:24.170677       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:45:55.195496       1 client.go:360] parsed scheme: "passthrough"
I0422 07:45:55.195936       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:45:55.196087       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:46:33.675283       1 trace.go:205] Trace[1777478497]: "GuaranteedUpdate etcd3" type:*coordination.Lease (22-Apr-2022 07:46:33.113) (total time: 561ms):
Trace[1777478497]: ---"Transaction committed" 560ms (07:46:00.675)
Trace[1777478497]: [561.666751ms] [561.666751ms] END
I0422 07:46:33.676441       1 trace.go:205] Trace[443629587]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.21.5 (linux/amd64) kubernetes/aea7bba/leader-election,client:192.168.0.101,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (22-Apr-2022 07:46:33.113) (total time: 563ms):
Trace[443629587]: ---"Object stored in database" 562ms (07:46:00.675)
Trace[443629587]: [563.212047ms] [563.212047ms] END
I0422 07:46:35.515641       1 client.go:360] parsed scheme: "passthrough"
I0422 07:46:35.515956       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:46:35.516058       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:47:16.626260       1 client.go:360] parsed scheme: "passthrough"
I0422 07:47:16.626501       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:47:16.626562       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:47:54.837575       1 client.go:360] parsed scheme: "passthrough"
I0422 07:47:54.838098       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:47:54.838206       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:48:03.317394       1 trace.go:205] Trace[1930747474]: "Get" url:/api/v1/namespaces/default/endpoints/k8s-sigs.io-nfs-subdir-external-provisioner,user-agent:nfs-subdir-external-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,client:192.168.0.102,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 07:48:02.500) (total time: 817ms):
Trace[1930747474]: ---"About to write a response" 816ms (07:48:00.317)
Trace[1930747474]: [817.036699ms] [817.036699ms] END
I0422 07:48:03.318360       1 trace.go:205] Trace[1583538196]: "Get" url:/api/v1/namespaces/kubesphere-system/configmaps/ks-controller-manager-leader-election,user-agent:controller-manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,client:10.233.103.18,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 07:48:02.502) (total time: 815ms):
Trace[1583538196]: ---"About to write a response" 815ms (07:48:00.318)
Trace[1583538196]: [815.294754ms] [815.294754ms] END
I0422 07:48:03.318991       1 trace.go:205] Trace[1840013583]: "Get" url:/api/v1/namespaces/kubesphere-monitoring-system/secrets/alertmanager-main,user-agent:operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:192.168.0.102,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 07:48:02.741) (total time: 577ms):
Trace[1840013583]: ---"About to write a response" 575ms (07:48:00.317)
Trace[1840013583]: [577.290527ms] [577.290527ms] END
I0422 07:48:33.684204       1 client.go:360] parsed scheme: "passthrough"
I0422 07:48:33.684615       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:48:33.684702       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:49:08.223230       1 client.go:360] parsed scheme: "passthrough"
I0422 07:49:08.223519       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:49:08.223571       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:49:49.924475       1 client.go:360] parsed scheme: "passthrough"
I0422 07:49:49.925110       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:49:49.925220       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:50:24.061411       1 client.go:360] parsed scheme: "passthrough"
I0422 07:50:24.061931       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:50:24.062034       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:51:08.327194       1 client.go:360] parsed scheme: "passthrough"
I0422 07:51:08.327585       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:51:08.327671       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:51:44.894285       1 client.go:360] parsed scheme: "passthrough"
I0422 07:51:44.895895       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:51:44.896026       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:52:27.218891       1 client.go:360] parsed scheme: "passthrough"
I0422 07:52:27.219410       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:52:27.219625       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:53:03.475667       1 client.go:360] parsed scheme: "passthrough"
I0422 07:53:03.476005       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:53:03.476065       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
W0422 07:53:13.655814       1 watcher.go:220] watch chan error: etcdserver: mvcc: required revision has been compacted
I0422 07:53:29.879814       1 trace.go:205] Trace[2103323776]: "Get" url:/api/v1/namespaces/kubesphere-monitoring-system/configmaps/7b8d27e6.kubesphere.io,user-agent:notification-manager-operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:192.168.0.102,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 07:53:29.248) (total time: 631ms):
Trace[2103323776]: ---"About to write a response" 630ms (07:53:00.879)
Trace[2103323776]: [631.109523ms] [631.109523ms] END
I0422 07:53:40.805542       1 client.go:360] parsed scheme: "passthrough"
I0422 07:53:40.806026       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:53:40.806137       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:54:12.800502       1 client.go:360] parsed scheme: "passthrough"
I0422 07:54:12.801013       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:54:12.801107       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:54:42.861773       1 client.go:360] parsed scheme: "passthrough"
I0422 07:54:42.862361       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:54:42.862455       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:55:18.068957       1 client.go:360] parsed scheme: "passthrough"
I0422 07:55:18.069364       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:55:18.069447       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:55:55.471594       1 client.go:360] parsed scheme: "passthrough"
I0422 07:55:55.472108       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:55:55.472189       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:56:37.866362       1 client.go:360] parsed scheme: "passthrough"
I0422 07:56:37.866790       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:56:37.866936       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:57:11.844368       1 client.go:360] parsed scheme: "passthrough"
I0422 07:57:11.844768       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:57:11.844912       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:57:47.840865       1 client.go:360] parsed scheme: "passthrough"
I0422 07:57:47.841173       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:57:47.841221       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:58:18.654725       1 client.go:360] parsed scheme: "passthrough"
I0422 07:58:18.655199       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:58:18.655299       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:58:53.913156       1 client.go:360] parsed scheme: "passthrough"
I0422 07:58:53.914057       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:58:53.914263       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 07:59:31.986108       1 client.go:360] parsed scheme: "passthrough"
I0422 07:59:31.986345       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 07:59:31.986396       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:00:15.137251       1 client.go:360] parsed scheme: "passthrough"
I0422 08:00:15.137732       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:00:15.137830       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:00:49.238767       1 client.go:360] parsed scheme: "passthrough"
I0422 08:00:49.239172       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:00:49.239248       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:01:26.910330       1 client.go:360] parsed scheme: "passthrough"
I0422 08:01:26.911920       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:01:26.912260       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:02:00.531420       1 client.go:360] parsed scheme: "passthrough"
I0422 08:02:00.531810       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:02:00.531866       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:02:42.143368       1 client.go:360] parsed scheme: "passthrough"
I0422 08:02:42.144298       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:02:42.144392       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:03:14.030341       1 client.go:360] parsed scheme: "passthrough"
I0422 08:03:14.030942       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:03:14.031042       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:03:58.043689       1 client.go:360] parsed scheme: "passthrough"
I0422 08:03:58.044663       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:03:58.044856       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:04:31.366765       1 client.go:360] parsed scheme: "passthrough"
I0422 08:04:31.367017       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:04:31.367067       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:05:08.889802       1 client.go:360] parsed scheme: "passthrough"
I0422 08:05:08.890255       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:05:08.890322       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:05:46.111542       1 client.go:360] parsed scheme: "passthrough"
I0422 08:05:46.111813       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:05:46.111859       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:05:48.096897       1 trace.go:205] Trace[2055522808]: "Get" url:/api/v1/namespaces/kubesphere-system/configmaps/ks-controller-manager-leader-election,user-agent:controller-manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,client:10.233.103.18,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 08:05:47.566) (total time: 529ms):
Trace[2055522808]: ---"About to write a response" 529ms (08:05:00.096)
Trace[2055522808]: [529.800778ms] [529.800778ms] END
I0422 08:05:48.097213       1 trace.go:205] Trace[318840245]: "GuaranteedUpdate etcd3" type:*v1.Endpoints (22-Apr-2022 08:05:47.219) (total time: 877ms):
Trace[318840245]: ---"Transaction committed" 873ms (08:05:00.097)
Trace[318840245]: [877.258251ms] [877.258251ms] END
I0422 08:05:48.110310       1 trace.go:205] Trace[980133007]: "Get" url:/api/v1/namespaces/default/endpoints/k8s-sigs.io-nfs-subdir-external-provisioner,user-agent:nfs-subdir-external-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,client:192.168.0.102,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 08:05:47.349) (total time: 760ms):
Trace[980133007]: ---"About to write a response" 760ms (08:05:00.110)
Trace[980133007]: [760.823226ms] [760.823226ms] END
I0422 08:06:29.868758       1 client.go:360] parsed scheme: "passthrough"
I0422 08:06:29.869326       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:06:29.869430       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:07:03.464310       1 client.go:360] parsed scheme: "passthrough"
I0422 08:07:03.464822       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:07:03.464915       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:07:39.312194       1 client.go:360] parsed scheme: "passthrough"
I0422 08:07:39.312692       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:07:39.312836       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:08:12.505517       1 client.go:360] parsed scheme: "passthrough"
I0422 08:08:12.506071       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:08:12.506240       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:08:54.079068       1 client.go:360] parsed scheme: "passthrough"
I0422 08:08:54.079537       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:08:54.079653       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:09:33.188316       1 client.go:360] parsed scheme: "passthrough"
I0422 08:09:33.189125       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:09:33.189346       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:09:36.750069       1 trace.go:205] Trace[2093520205]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.21.5 (linux/amd64) kubernetes/aea7bba/leader-election,client:192.168.0.101,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (22-Apr-2022 08:09:35.989) (total time: 760ms):
Trace[2093520205]: ---"About to write a response" 760ms (08:09:00.749)
Trace[2093520205]: [760.712467ms] [760.712467ms] END
I0422 08:09:36.750337       1 trace.go:205] Trace[1045158213]: "Get" url:/api/v1/namespaces/default/endpoints/k8s-sigs.io-nfs-subdir-external-provisioner,user-agent:nfs-subdir-external-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,client:192.168.0.102,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 08:09:35.799) (total time: 950ms):
Trace[1045158213]: ---"About to write a response" 950ms (08:09:00.749)
Trace[1045158213]: [950.780247ms] [950.780247ms] END
I0422 08:09:36.750477       1 trace.go:205] Trace[2136025216]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.21.5 (linux/amd64) kubernetes/aea7bba/leader-election,client:192.168.0.101,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (22-Apr-2022 08:09:35.575) (total time: 1174ms):
Trace[2136025216]: ---"About to write a response" 1174ms (08:09:00.750)
Trace[2136025216]: [1.174633812s] [1.174633812s] END
I0422 08:09:36.750620       1 trace.go:205] Trace[1168700078]: "Get" url:/api/v1/nodes/ks-master-1,user-agent:kube-controllers/v0.0.0 (linux/amd64) kubernetes/$Format,client:10.233.103.14,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 08:09:35.585) (total time: 1165ms):
Trace[1168700078]: ---"About to write a response" 1164ms (08:09:00.749)
Trace[1168700078]: [1.165375905s] [1.165375905s] END
I0422 08:09:36.750068       1 trace.go:205] Trace[622939302]: "GuaranteedUpdate etcd3" type:*coordination.Lease (22-Apr-2022 08:09:35.976) (total time: 772ms):
Trace[622939302]: ---"Transaction committed" 771ms (08:09:00.749)
Trace[622939302]: [772.964536ms] [772.964536ms] END
I0422 08:09:36.750709       1 trace.go:205] Trace[304075896]: "Get" url:/api/v1/namespaces/kubesphere-monitoring-system/configmaps/7b8d27e6.kubesphere.io,user-agent:notification-manager-operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:192.168.0.102,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 08:09:35.651) (total time: 1099ms):
Trace[304075896]: ---"About to write a response" 1099ms (08:09:00.750)
Trace[304075896]: [1.099313709s] [1.099313709s] END
I0422 08:09:36.751155       1 trace.go:205] Trace[222678065]: "Update" url:/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ks-master-1,user-agent:kubelet/v1.21.5 (linux/amd64) kubernetes/aea7bba,client:192.168.0.101,accept:application/vnd.kubernetes.protobuf,application/json,protocol:HTTP/2.0 (22-Apr-2022 08:09:35.976) (total time: 774ms):
Trace[222678065]: ---"Object stored in database" 773ms (08:09:00.750)
Trace[222678065]: [774.68351ms] [774.68351ms] END
I0422 08:10:07.631577       1 client.go:360] parsed scheme: "passthrough"
I0422 08:10:07.631847       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:10:07.631893       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:10:41.721153       1 client.go:360] parsed scheme: "passthrough"
I0422 08:10:41.721521       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:10:41.721613       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:11:19.718664       1 client.go:360] parsed scheme: "passthrough"
I0422 08:11:19.719235       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:11:19.719361       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:11:55.097952       1 client.go:360] parsed scheme: "passthrough"
I0422 08:11:55.098644       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:11:55.098782       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:12:20.917177       1 trace.go:205] Trace[897535369]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.21.5 (linux/amd64) kubernetes/aea7bba/leader-election,client:192.168.0.101,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (22-Apr-2022 08:12:20.059) (total time: 857ms):
Trace[897535369]: ---"About to write a response" 857ms (08:12:00.916)
Trace[897535369]: [857.266453ms] [857.266453ms] END
I0422 08:12:36.116296       1 client.go:360] parsed scheme: "passthrough"
I0422 08:12:36.116682       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:12:36.116752       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:13:06.298339       1 client.go:360] parsed scheme: "passthrough"
I0422 08:13:06.298635       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:13:06.298694       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:13:46.503070       1 client.go:360] parsed scheme: "passthrough"
I0422 08:13:46.503616       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:13:46.503710       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:14:31.237250       1 client.go:360] parsed scheme: "passthrough"
I0422 08:14:31.239342       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:14:31.239641       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:15:03.837700       1 client.go:360] parsed scheme: "passthrough"
I0422 08:15:03.838174       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:15:03.838272       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:15:45.106734       1 client.go:360] parsed scheme: "passthrough"
I0422 08:15:45.107053       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:15:45.107107       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:16:28.279268       1 client.go:360] parsed scheme: "passthrough"
I0422 08:16:28.279972       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:16:28.280068       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:17:11.238071       1 client.go:360] parsed scheme: "passthrough"
I0422 08:17:11.238612       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:17:11.238702       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:17:43.970214       1 client.go:360] parsed scheme: "passthrough"
I0422 08:17:43.970764       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:17:43.970926       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:18:24.265083       1 client.go:360] parsed scheme: "passthrough"
I0422 08:18:24.265540       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:18:24.265643       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:19:03.785428       1 trace.go:205] Trace[1100026849]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager,user-agent:kube-controller-manager/v1.21.5 (linux/amd64) kubernetes/aea7bba/leader-election,client:192.168.0.101,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (22-Apr-2022 08:19:03.073) (total time: 711ms):
Trace[1100026849]: ---"About to write a response" 711ms (08:19:00.785)
Trace[1100026849]: [711.731752ms] [711.731752ms] END
I0422 08:19:07.170947       1 client.go:360] parsed scheme: "passthrough"
I0422 08:19:07.171394       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:19:07.171492       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:19:37.323582       1 trace.go:205] Trace[514073814]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-scheduler,user-agent:kube-scheduler/v1.21.5 (linux/amd64) kubernetes/aea7bba/leader-election,client:192.168.0.101,accept:application/vnd.kubernetes.protobuf, */*,protocol:HTTP/2.0 (22-Apr-2022 08:19:36.786) (total time: 537ms):
Trace[514073814]: ---"About to write a response" 536ms (08:19:00.323)
Trace[514073814]: [537.090026ms] [537.090026ms] END
I0422 08:19:37.323610       1 trace.go:205] Trace[1932331611]: "Get" url:/apis/coordination.k8s.io/v1/namespaces/kubesphere-system/leases/ks-controller-manager-leader-election,user-agent:controller-manager/v0.0.0 (linux/amd64) kubernetes/$Format/leader-election,client:10.233.103.18,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 08:19:36.523) (total time: 799ms):
Trace[1932331611]: ---"About to write a response" 799ms (08:19:00.323)
Trace[1932331611]: [799.585125ms] [799.585125ms] END
I0422 08:19:39.597623       1 client.go:360] parsed scheme: "passthrough"
I0422 08:19:39.597979       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:19:39.598074       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:20:12.520136       1 client.go:360] parsed scheme: "passthrough"
I0422 08:20:12.520349       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:20:12.520399       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:20:49.087201       1 client.go:360] parsed scheme: "passthrough"
I0422 08:20:49.087679       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:20:49.087775       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:21:29.579075       1 client.go:360] parsed scheme: "passthrough"
I0422 08:21:29.579849       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:21:29.579980       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:22:08.135305       1 client.go:360] parsed scheme: "passthrough"
I0422 08:22:08.135679       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:22:08.136189       1 clientconn.go:948] ClientConn switching balancer to "pick_first"
I0422 08:22:43.695083       1 client.go:360] parsed scheme: "passthrough"
I0422 08:22:43.695571       1 passthrough.go:48] ccResolverWrapper: sending update to cc: {[{https://192.168.0.101:2379  <nil> 0 <nil>}] <nil> <nil>}
I0422 08:22:43.695659       1 clientconn.go:948] ClientConn switching balancer to "pick_first"

24sama

sxilef
kube-proxy

I0422 06:39:15.308809       1 trace.go:205] Trace[414270998]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:134 (22-Apr-2022 06:38:26.360) (total time: 48948ms):

kube-apiserver

I0422 08:09:36.750709       1 trace.go:205] Trace[304075896]: "Get" url:/api/v1/namespaces/kubesphere-monitoring-system/configmaps/7b8d27e6.kubesphere.io,user-agent:notification-manager-operator/v0.0.0 (linux/amd64) kubernetes/$Format,client:192.168.0.102,accept:application/json, */*,protocol:HTTP/2.0 (22-Apr-2022 08:09:35.651) (total time: 1099ms):
Trace[304075896]: ---"About to write a response" 1099ms (08:09:00.750)

看了下日志，有问题节点的kube-proxy不是完全无法连接，而是有时能连上master的apiserver，但是用时也会很长。我认为你可以排查一下这个有问题节点的网络情况。

sxilef

24sama

所以也就是nfs pod重启，主要是网络这部分的问题，由于网络时有卡顿导致的

那么创建有状态副本时的Warning FailedScheduling 100s default-scheduler 0/3 nodes are available: 3 pod has unbound immediate PersistentVolumeClaims.
这个是否也是网络问题呢？

还有安装时提醒的语句Default storageClass in cluster is not unique!是否可以忽略呢？

24sama

sxilef

Default storageClass in cluster is not unique!

这句只是提示，可以忽略

Warning FailedScheduling 100s default-scheduler 0/3 nodes are available: 3 pod has unbound immediate PersistentVolumeClaims.

这个报警应该是，pod起来的前提是需要有pvc bound好一个pv，但是可能因为你的网络卡顿问题，nfs pod去创建pv的时间加上pvc绑定该pv的时间会比较长，所以kubelet会先报一个警告，等这些全部准备好了可用了，pod自然就起来了。

sxilef

24sama

好的，多谢 😄