基于k8s上最小化安装失败

bmingithub

@abbbbbqwezxc 你好，麻烦看下openebs-provisioner-和open-ebs-ndm-那几个pod的log有没有什么错误或者异常

abbbbbqwezxc

Feynman @zheng1 @bmingithub 重装了一遍，和官网流程一样的，还是一样的问题，pod都正常的，就是测试openebs一直是pending的

helm和tiller的版本是

k8s版本是：

现在还没有安装kubesphere，感觉会和昨天出一样的问题，我去自己试一下nfs存储安装，小菜鸡一个，不着急的

rayzhou2017

我们有人复现了多节点部署k8s 1.17出现openebs pending问题，可能是API变化的原因，你可以先试试1.16版本。等我们解决1.17的问题再回复你。

abbbbbqwezxc

rayzhou2017 好的，多谢你了

bmingithub

你按照这个步骤安装试下， abbbbbqwezxc

设置master可调度
安装openebs，
安装ks-minimal
master设置成不可调度

Feynman

abbbbbqwezxc 你先取消 master 节点的 taint 后安装 kubesphere ，kubesphere 安装完成了再给 master 打 taint

rayzhou2017

master安装过程先别打污点

abbbbbqwezxc

Feynman @bmingithub @rainwu 好的多谢，我再试一下，看看什么结果

bmingithub

abbbbbqwezxc hi，请问现在ok了么？

abbbbbqwezxc

bmingithub 网络不太好，在等pod安装，有问题再在这里反馈，多谢你了

abbbbbqwezxc

@Feynman @bmingithub @rainwu 已经安装成功了，多谢大家的帮助，十分感谢，虽然kubectl get pvc -n openebs的状态还是pending的，但是去掉污点后安装kubesphere，各个pod的情况都正常安装了，安装后加上的污点，页面能正常访问了，多谢各位了

Feynman

abbbbbqwezxc 👍 是我们 openebs 文档有两个问题，造成了一些疑惑：
第一个是示例 deployment 的 apiversion ，应根据 K8s 不同版本提示 apiversion，第二个是打 taint 的顺序。我们会对文档做更新

bmingithub

abbbbbqwezxc 那个示例的pvc使用的storageclass是WaitForFristConsumer，需要绑定了pod了以后才能执行创建。要看看那个示例中的pod创建成功了没有。

hekingkong

Feynman 文档更新了嘛？

Feynman

hekingkong 是的，已更新：https://kubesphere.com.cn/docs/zh-CN/appendix/install-openebs/

hekingkong

Feynman 你好，已取消master 节点的 taint ，已成功安装，但还有三个POD显示不成功，请问是什么原因？

YangYongQiang

Feynman 大佬好，我按照上面的做饭去掉污点后安装kubesphere

这个ks-account 一直处于一个init的状态

这个日志显示一直在初始化，您有时间帮我排查一下吗？

helm 版本安装的时候不知道为啥客户端与服务端版本不一致，会有影响吗？

rayzhou2017

hekingkong 你应该看日志，这个截图一般人都看不出原因。

hekingkong

rayzhou2017 是否这个日志？
[root@k8s-master _]# cat /var/log/containers/node-exporter-qc2ws_kubesphere-monitoring-system_node-exporter-46368750406b5a5fb517f8b9da7a28509a3d0229cc240e1e3d0370a30113a1cb.log
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“Starting node_exporter (version=0.16.0, branch=ks-v0.16.0, revision=19e1eb3029d2d7ef564fe8cd5d8a03d6bcade7ff)\” source=\“node_exporter.go:82\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687321851Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“Build context (go=go1.11.5, user=root@ks-allinone, date=20190226-09:19:57)\” source=\“node_exporter.go:83\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.68735563Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“Enabled collectors:\” source=\“node_exporter.go:90\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687885057Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - arp\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687901862Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - bcache\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687908416Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - bonding\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687912721Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - conntrack\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687923677Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - cpu\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687928063Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - diskstats\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687932176Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - edac\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687936196Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - entropy\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687940292Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - filefd\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687944151Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - filesystem\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687948045Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - hwmon\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687951885Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - infiniband\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687955859Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - ipvs\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687959752Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - loadavg\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687963532Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - mdadm\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687967298Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - meminfo\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687971036Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - netdev\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687974796Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - netstat\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687978551Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - nfs\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687982317Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - nfsd\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687986105Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - sockstat\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687989994Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - stat\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687994846Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - textfile\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.68800621Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - time\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688027331Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - timex\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688032943Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - uname\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688036883Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - vmstat\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688040619Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - wifi\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688044426Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - xfs\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688048081Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - zfs\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.68805182Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“Listening on 127.0.0.1:9100\” source=\“node_exporter.go:111\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688055561Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=fatal msg=\“listen tcp 127.0.0.1:9100: bind: address already in use\” source=\“node_exporter.go:114\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688137634Z”}
[root@k8s-master _]# cat /var/log/containers/node-exporter-qc2ws_kubesphere-monitoring-system_node-exporter-46368750406b5a5fb517f8b9da7a28509a3d0229cc240e1e3d0370a30113a1cb.log
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“Starting node_exporter (version=0.16.0, branch=ks-v0.16.0, revision=19e1eb3029d2d7ef564fe8cd5d8a03d6bcade7ff)\” source=\“node_exporter.go:82\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687321851Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“Build context (go=go1.11.5, user=root@ks-allinone, date=20190226-09:19:57)\” source=\“node_exporter.go:83\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.68735563Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“Enabled collectors:\” source=\“node_exporter.go:90\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687885057Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - arp\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687901862Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - bcache\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687908416Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - bonding\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687912721Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - conntrack\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687923677Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - cpu\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687928063Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - diskstats\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687932176Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - edac\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687936196Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - entropy\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687940292Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - filefd\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687944151Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - filesystem\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687948045Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - hwmon\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687951885Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - infiniband\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687955859Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - ipvs\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687959752Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - loadavg\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687963532Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - mdadm\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687967298Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - meminfo\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687971036Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - netdev\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687974796Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - netstat\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687978551Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - nfs\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687982317Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - nfsd\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687986105Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - sockstat\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687989994Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - stat\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.687994846Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - textfile\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.68800621Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - time\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688027331Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - timex\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688032943Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - uname\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688036883Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - vmstat\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688040619Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - wifi\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688044426Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - xfs\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688048081Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“ - zfs\” source=\“node_exporter.go:97\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.68805182Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=info msg=\“Listening on 127.0.0.1:9100\” source=\“node_exporter.go:111\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688055561Z”}
{“log”:"time=\“2020-05-26T06:44:27Z\” level=fatal msg=\“listen tcp 127.0.0.1:9100: bind: address already in use\” source=\“node_exporter.go:114\”\n",“stream”:“stderr”,“time”:“2020-05-26T06:44:27.688137634Z”}

rayzhou2017

不是，你不是有几个pod crash了吗？你看看这个crash的日志，用kubectl命令查

hekingkong

rayzhou2017 好像不行啊。