KubeSphere 3.0 监控模块忽然挂载卷失效

Andy

kubectl describe pod/prometheus-k8s-0 -n kubesphere-monitoring-system
获取到如下信息：

 Normal   Scheduled    <unknown>              default-scheduler   Successfully assigned kubesphere-monitoring-system/prometheus-k8s-0 to k8s-node2
  Warning  FailedMount  5m10s                  kubelet, k8s-node2  Unable to attach or mount volumes: unmounted volumes=[secret-kube-etcd-client-certs], unattached volumes=[prometheus-k8s-token-cndz7 config config-out tls-assets prometheus-k8s-db prometheus-k8s-rulefiles-0 secret-kube-etcd-client-certs]: timed out waiting for the condition
  Warning  FailedMount  2m54s (x2 over 7m24s)  kubelet, k8s-node2  Unable to attach or mount volumes: unmounted volumes=[secret-kube-etcd-client-certs], unattached volumes=[prometheus-k8s-db prometheus-k8s-rulefiles-0 secret-kube-etcd-client-certs prometheus-k8s-token-cndz7 config config-out tls-assets]: timed out waiting for the condition
  Warning  FailedMount  73s (x12 over 9m27s)   kubelet, k8s-node2  MountVolume.SetUp failed for volume "secret-kube-etcd-client-certs" : secret "kube-etcd-client-certs" not found`

freemankevin

Andy 遇到了同样的问题，你解决了吗

Jeff

Andy 检查下对应的 secret 是否存在，如果存在的话重启下这个pod试下

freemankevin

Jeff

kubectl -n kubesphere-monitoring-system create  secret generic kube-etcd-client-certs \
 --from-file=etcd-client-ca.crt=/etc/kubernetes/pki/etcd/ca.crt \
 --from-file=etcd-client.crt=/etc/kubernetes/pki/etcd/healthcheck-client.crt \
 --from-file=etcd-client.key=/etc/kubernetes/pki/etcd/healthcheck-client.key

freemankevin

Jeff 感谢

freemankevin

freemankevin
当时没注意，汗！！

  Warning  FailedMount  78s (x60 over 107m)   kubelet, node2  MountVolume.SetUp failed for volume "secret-kube-etcd-client-certs" : secret "kube-etcd-client-certs" not found

freemankevin

kubesphere-monitoring-system   prometheus-k8s-0                                     3/3     Running     1          62s     192.168.104.22    node2    <none>           <none>
kubesphere-monitoring-system   prometheus-k8s-1                                     3/3     Running     1          70s     192.168.166.165   node1    <none>           <none>
kubesphere-monitoring-system   prometheus-operator-78c5cdbc8f-crwbp                 2/2     Running     0          4h20m   192.168.166.153   node1    <none>           <none>

xuanyuanaosheng

 kubectl -n kubesphere-monitoring-system create  secret generic kube-etcd-client-certs \
 --from-file=etcd-client-ca.crt=/etc/kubernetes/ssl/ca.pem \
 --from-file=etcd-client.crt=/etc/kubernetes/ssl/etcd.pem \
 --from-file=etcd-client.key=/etc/kubernetes/ssl/etcd-key.pem