创建部署问题时,请参考下面模板,你提供的信息越多,越容易及时获得解答。如果未按模板创建问题,管理员有权关闭问题。
确保帖子格式清晰易读,用 markdown code block 语法格式化代码块。
你只花一分钟创建的问题,不能指望别人花上半个小时给你解答。
操作系统信息
例如:虚拟机/物理机,Centos7.5/Ubuntu18.04,4C/8G
Kubernetes版本信息
将 kubectl version
命令执行结果贴在下方
Client Version: version.Info{Major:“1”, Minor:“21”, GitVersion:“v1.21.5”, GitCommit:“aea7bbadd2fc0cd689de94a54e5b7b758869d691”, GitTreeState:“clean”, BuildDate:“2021-09-15T21:10:45Z”, GoVersion:“go1.16.8”, Compiler:“gc”, Platform:“linux/amd64”}
Server Version: version.Info{Major:“1”, Minor:“21”, GitVersion:“v1.21.5”, GitCommit:“aea7bbadd2fc0cd689de94a54e5b7b758869d691”, GitTreeState:“clean”, BuildDate:“2021-09-15T21:04:16Z”, GoVersion:“go1.16.8”, Compiler:“gc”, Platform:“linux/amd64”}
容器运行时
将 docker version
/ crictl version
/ nerdctl version
结果贴在下方
Client: Docker Engine - Community
Version: 20.10.10
KubeSphere版本信息
例如:v2.1.1/v3.0.0。离线安装还是在线安装。在已有K8s上安装还是使用kk安装。
v3.2.0,使用kk安装
问题是什么
报错日志是什么,最好有截图。
边缘端能够加入kubeedge,但是从云端部署应用时,一直无法部署,容器等待中
cloudcore报错
W1118 18:10:59.812516 1 validation.go:168] TLSTunnelPrivateKeyFile does not exist in /etc/kubeedge/certs/server.key, will load from secret
W1118 18:10:59.812568 1 validation.go:171] TLSTunnelCertFile does not exist in /etc/kubeedge/certs/server.crt, will load from secret
W1118 18:10:59.812578 1 validation.go:174] TLSTunnelCAFile does not exist in /etc/kubeedge/ca/rootCA.crt, will load from secret
I1118 18:10:59.812763 1 server.go:73] Version: v1.7.2
W1118 18:10:59.812784 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
I1118 18:11:00.831061 1 module.go:34] Module cloudhub registered successfully
I1118 18:11:00.902750 1 module.go:34] Module edgecontroller registered successfully
I1118 18:11:00.902810 1 module.go:34] Module devicecontroller registered successfully
I1118 18:11:00.902838 1 module.go:34] Module synccontroller registered successfully
I1118 18:11:00.902877 1 module.go:34] Module cloudStream registered successfully
W1118 18:11:00.902888 1 module.go:37] Module router is disabled, do not register
W1118 18:11:00.902893 1 module.go:37] Module dynamiccontroller is disabled, do not register
I1118 18:11:00.902948 1 core.go:24] Starting module synccontroller
I1118 18:11:00.902985 1 core.go:24] Starting module cloudStream
I1118 18:11:00.903050 1 core.go:24] Starting module cloudhub
I1118 18:11:00.903099 1 core.go:24] Starting module edgecontroller
I1118 18:11:00.903122 1 core.go:24] Starting module devicecontroller
I1118 18:11:00.904058 1 upstream.go:121] start upstream controller
I1118 18:11:00.904506 1 downstream.go:870] Start downstream devicecontroller
I1118 18:11:00.906086 1 downstream.go:566] start downstream controller
I1118 18:11:01.006570 1 server.go:243] Ca and CaKey don't exist in local directory, and will read from the secret
I1118 18:11:01.099920 1 server.go:247] Ca and CaKey don't exist in the secret, and will be created by CloudCore
I1118 18:11:01.205814 1 server.go:288] CloudCoreCert and key don't exist in local directory, and will read from the secret
I1118 18:11:01.208342 1 server.go:292] CloudCoreCert and key don't exist in the secret, and will be signed by CA
I1118 18:11:01.213518 1 streamserver.go:280] Prepare to start stream server ...
I1118 18:11:01.213885 1 tunnelserver.go:136] Succeed in loading TunnelCA from CloudHub
I1118 18:11:01.213990 1 tunnelserver.go:149] Succeed in loading TunnelCert and Key from CloudHub
I1118 18:11:01.214098 1 tunnelserver.go:169] Prepare to start tunnel server ...
I1118 18:11:01.299207 1 signcerts.go:100] Succeed to creating token
I1118 18:11:01.299260 1 server.go:44] start unix domain socket server
I1118 18:11:01.299569 1 server.go:64] Starting cloudhub websocket server
I1118 18:11:01.299959 1 uds.go:71] listening on: //var/lib/kubeedge/kubeedge.sock
I1118 18:11:02.904747 1 upstream.go:63] Start upstream devicecontroller
I1118 18:17:15.782158 1 messagehandler.go:293] edge node edgenode-quse for project e632aba927ea4ac2b575ec1603d56f10 connected
W1118 18:17:15.782205 1 upstream.go:204] parse message: 9a10a462-219a-4c74-a0c9-5b2a8d1ecce1 resource type with error: resource type not found
I1118 18:17:15.791666 1 upstream.go:88] Dispatch message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44
W1118 18:17:15.791681 1 upstream.go:92] Parse message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44 resource type with error: unknown resource
W1118 18:17:16.388025 1 upstream.go:807] message: ca644754-f1e5-4c1b-a225-0a12b5e04818 process failure, node edgenode-quse not found
I1118 18:17:17.780881 1 tunnelserver.go:110] get a new tunnel agent hostname edgenode-quse, internalIP 10.62.131.99
I1118 18:19:15.609009 1 upstream.go:88] Dispatch message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44
W1118 18:19:15.609046 1 upstream.go:92] Parse message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44 resource type with error: unknown resource
E1118 18:20:07.755218 1 upstream.go:728] apiserver get service account token failed: err serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "demo-project"
W1118 18:31:23.655126 1 upstream.go:627] message: 1c50878b-6a27-4a19-8625-3d625c820120 process failure with error: serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "demo-project", namespace: demo-project, name: default
I1118 18:32:15.628048 1 upstream.go:88] Dispatch message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44
W1118 18:32:15.628065 1 upstream.go:92] Parse message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44 resource type with error: unknown resource
I1118 18:33:15.623118 1 upstream.go:88] Dispatch message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44
W1118 18:33:15.623148 1 upstream.go:92] Parse message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44 resource type with error: unknown resource
E1118 18:33:16.082998 1 upstream.go:728] apiserver get service account token failed: err serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "default"
W1118 18:33:16.083018 1 upstream.go:627] message: 8521dccd-d9ca-4e64-b63e-f1b4cebfb9fd process failure with error: serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "default", namespace: default, name: default
E1118 18:34:16.086466 1 upstream.go:728] apiserver get service account token failed: err serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "default"
W1118 18:34:16.086484 1 upstream.go:627] message: 90f171a5-2a8e-4496-ba2d-a0e645034059 process failure with error: serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "default", namespace: default, name: default
I1118 18:35:15.632674 1 upstream.go:88] Dispatch message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44
W1118 18:35:15.632693 1 upstream.go:92] Parse message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44 resource type with error: unknown resource
E1118 18:35:16.662692 1 upstream.go:728] apiserver get service account token failed: err serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "default"
W1118 18:35:16.662731 1 upstream.go:627] message: 7ee303e4-61dc-410d-a038-e6e91ff2fe9f process failure with error: serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "default", namespace: default, name: default
I1118 18:36:15.635483 1 upstream.go:88] Dispatch message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44
W1118 18:36:15.635520 1 upstream.go:92] Parse message: 5710c66e-2d2a-4c89-b4bc-790cbc6b5b44 resource type with error: unknown resource
E1118 18:36:16.664455 1 upstream.go:728] apiserver get service account token failed: err serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "default"
W1118 18:36:16.664476 1 upstream.go:627] message: cf910c1f-7b0d-4360-82c6-c4c6a3f0e47f process failure with error: serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "default", namespace: default, name: default
E1118 18:37:17.761339 1 upstream.go:728] apiserver get service account token failed: err serviceaccounts "default" is forbidden: User "system:serviceaccount:kubeedge:cloudcore" cannot create resource "serviceaccounts/token" in API group "" in the namespace "default"
边缘端报错如下:
Nov 18 18:53:23 raspberrypi edgecore[7366]: E1118 18:53:23.518909 7366 metaclient.go:130] send sync message default/serviceaccounttoken/default failed, error:timeout to get response, retries: 2
Nov 18 18:53:23 raspberrypi edgecore[7366]: E1118 18:53:23.519065 7366 serviceaccount.go:41] get service account token from metaManager failed, err: timed out waiting for the condition
Nov 18 18:53:23 raspberrypi edgecore[7366]: I1118 18:53:23.519629 7366 process.go:470] ########## process get: req[{Header:{ID:6e507d0d-9e8e-4803-8e20-95b9db5e8198 ParentID: Timestamp:1637232683507 ResourceVersion: Sync:true} Router:{Source:edged Group:meta Operation:query Resource:default/serviceaccounttoken/default} Content:&TokenRequest{ObjectMeta:{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},Spec:TokenRequestSpec{Audiences:[],BoundObjectRef:&BoundObjectReference{Kind:Pod,APIVersion:v1,Name:nginx-cfccdd6bb-dkqgx,UID:bb63e2fc-f241-4fd6-a59d-5ec338c2f818,},ExpirationSeconds:*3607,},Status:TokenRequestStatus{Token:,ExpirationTimestamp:0001-01-01 00:00:00 +0000 UTC,},}}], resp[{Header:{ID: ParentID: Timestamp:0 ResourceVersion: Sync:false} Router:{Source: Group: Operation: Resource:} Content:<nil>}], err[timeout to get response]
Nov 18 18:53:23 raspberrypi edgecore[7366]: E1118 18:53:23.520473 7366 process.go:472] remote query failed: timeout to get response
Nov 18 18:53:23 raspberrypi edgecore[7366]: E1118 18:53:23.531681 7366 projected.go:201] Error preparing data for projected volume kube-api-access-9wsv8 for pod default/nginx-cfccdd6bb-dkqgx: get service account token from metaManager failed, err: timed out waiting for the condition
Nov 18 18:53:23 raspberrypi edgecore[7366]: I1118 18:53:23.531990 7366 record.go:24] Warning FailedMount MountVolume.SetUp failed for volume "kube-api-access-9wsv8" : get service account token from metaManager failed, err: timed out waiting for the condition
Nov 18 18:53:23 raspberrypi edgecore[7366]: E1118 18:53:23.532349 7366 nestedpendingoperations.go:301] Operation for "{volumeName:kubernetes.io/projected/bb63e2fc-f241-4fd6-a59d-5ec338c2f818-kube-api-access-9wsv8 podName:bb63e2fc-f241-4fd6-a59d-5ec338c2f818 nodeName:}" failed. No retries permitted until 2021-11-18 18:55:25.532091639 +0800 CST m=+2291.984650194 (durationBeforeRetry 2m2s). Error: "MountVolume.SetUp failed for volume \"kube-api-access-9wsv8\" (UniqueName: \"kubernetes.io/projected/bb63e2fc-f241-4fd6-a59d-5ec338c2f818-kube-api-access-9wsv8\") pod \"nginx-cfccdd6bb-dkqgx\" (UID: \"bb63e2fc-f241-4fd6-a59d-5ec338c2f818\") : get service account token from metaManager failed, err: timed out waiting for the condition"
请高人帮助解决