操作系统信息
虚拟机,openEuler,6.6.0-72.0.0.76.oe2403sp1.x86_64
Kubernetes版本信息
v1.30.0
容器运行时
containerd v1.7.13
KubeSphere版本信息
在线安装。无K8S集群
问题是什么
必须打开并且为true ?
在用kkv1.3.10安装k8s时,配置文件里,设置了autoRenewCerts:false,设置了certs有效期100年,安装k8s完毕后,继续安装kubesphere,当时kubesphere的企业空间添加删除没问题,第二天发现增加企业空间正常,但是却无法删除企业空间,查看ks-controller-manager的日志,发现大量报错:
ks-controller-manager,还是报错:
I0120 10:43:03.558362 1 controller.go:217] “Starting workers” controller=“namespace” controllerGroup="" controllerKind=“Namespace” worker count=2
I0120 10:43:03.558383 1 controller.go:217] “Starting workers” controller=“workspacerolebinding” controllerGroup=“iam.kubesphere.io” controllerKind=“WorkspaceRoleBinding” worker count=2
E0120 10:43:03.633037 1 controller.go:316] “Reconciler error” err=“failed to sync global role binding whizard-telemetry to cluster host: failed to get cluster client: the server has asked for the client to provide credentials” controller=“globalrolebinding” controllerGroup=“iam.kubesphere.io” controllerKind=“GlobalRoleBinding” GlobalRoleBinding=“whizard-telemetry” namespace="" name=“whizard-telemetry” reconcileID=“d3440585-f3ed-4711-8cc5-724ee11ff5e2”
I0120 10:43:03.558438 1 controller.go:217] “Starting workers” controller=“storageclass-capability” controllerGroup=“storage.k8s.io” controllerKind=“StorageClass” worker count=2
I0120 10:43:03.558460 1 controller.go:217] “Starting workers” controller=“repository” controllerGroup=“kubesphere.io” controllerKind=“Repository” worker count=1
E0120 10:43:03.633314 1 controller.go:316] “Reconciler error” err="Operation cannot be fulfilled on clusters.cluster.kubesphere.io \“host\”: the object has been modified; please apply your changes to the latest version and try again" controller=“cluster” controllerGroup=“cluster.kubesphere.io” controllerKind=“Cluster” Cluster=“host” namespace="" name=“host” reconcileID=“152e9d6d-6ec2-466d-9b8a-d1288752bf90”
I0120 10:43:03.569785 1 controller.go:217] “Starting workers” controller=“extensionVersion” controllerGroup=“kubesphere.io” controllerKind=“ExtensionVersion” worker count=1
I0120 10:43:03.569811 1 controller.go:217] “Starting workers” controller=“clusterlabel” controllerGroup=“cluster.kubesphere.io” controllerKind=“Label” worker count=1
E0120 10:43:03.633729 1 controller.go:316] “Reconciler error” err=“failed to cascade delete workspacetemplate test2: cluster not ready: host” controller=“workspacetemplate” controllerGroup=“tenant.kubesphere.io” controllerKind=“WorkspaceTemplate” WorkspaceTemplate=“test2” namespace="" name=“test2” reconcileID=“cbbd1bf7-c7fe-4784-8826-77c07bd2c654”
I0120 10:43:03.633795 1 controller.go:217] “Starting workers” controller=“installplan” controllerGroup=“kubesphere.io” controllerKind=“InstallPlan” worker count=2
I0120 10:43:03.634817 1 controller.go:217] “Starting workers” controller=“ks-serviceaccount” controllerGroup=“kubesphere.io” controllerKind=“ServiceAccount” worker count=2
I0120 10:43:03.635493 1 controller.go:217] “Starting workers” controller=“workspace” controllerGroup=“tenant.kubesphere.io” controllerKind=“Workspace” worker count=2
I0120 10:43:03.637143 1 controller.go:217] “Starting workers” controller=“csr” controllerGroup=“certificates.k8s.io” controllerKind=“CertificateSigningRequest” worker count=1
I0120 10:43:03.637224 1 controller.go:217] “Starting workers” controller=“serviceaccount” controllerGroup="" controllerKind=“ServiceAccount” worker count=1
I0120 10:43:03.637533 1 controller.go:217] “Starting workers” controller=“application” controllerGroup=“app.k8s.io” controllerKind=“Application” worker count=1
I0120 10:43:03.638058 1 controller.go:217] “Starting workers” controller=“user” controllerGroup=“iam.kubesphere.io” controllerKind=“User” worker count=2
I0120 10:43:03.639999 1 controller.go:217] “Starting workers” controller=“resourcequota” controllerGroup=“quota.kubesphere.io” controllerKind=“ResourceQuota” worker count=8
E0120 10:43:03.733225 1 controller.go:316] “Reconciler error” err=“failed to sync global role binding anonymous to cluster host: failed to get cluster client: the server has asked for the client to provide credentials” controller=“globalrolebinding” controllerGroup=“iam.kubesphere.io” controllerKind=“GlobalRoleBinding” GlobalRoleBinding=“anonymous” namespace="" name=“anonymous” reconcileID=“14b3610e-1725-4ab9-b116-9bca3a820a9c”
E0120 10:43:03.734335 1 controller.go:316] “Reconciler error” err=“failed to cascade delete workspacetemplate test1: cluster not ready: host” controller=“workspacetemplate” controllerGroup=“tenant.kubesphere.io” controllerKind=“WorkspaceTemplate” WorkspaceTemplate=“test1” namespace="" name=“test1” reconcileID=“4d914079-65c6-49b2-b55d-a475a1cc2f44”
E0120 10:43:03.734438 1 controller.go:316] “Reconciler error” err=“failed to sync global role binding ks-console to cluster host: failed to get cluster client: the server has asked for the client to provide credentials” controller=“globalrolebinding” controllerGroup=“iam.kubesphere.io” controllerKind=“GlobalRoleBinding” GlobalRoleBinding=“ks-console” namespace="" name=“ks-console” reconcileID=“0afa51ac-bb11-4a54-bf25-4f5903b405fd”
E0120 10:43:03.739604 1 controller.go:316] “Reconciler error” err=“failed to cascade delete workspacetemplate test3: cluster not ready: host” controller=“workspacetemplate” controllerGroup=“tenant.kubesphere.io” controllerKind=“WorkspaceTemplate” WorkspaceTemplate=“test3” namespace="" name=“test3” reconcileID=“d0752745-50d2-483f-b8b8-4bf3230d2561”
E0120 10:43:03.739705 1 controller.go:316] “Reconciler error” err=“failed to sync user admin to cluster host: failed to get cluster client: the server has asked for the client to provide credentials” controller=“user” controllerGroup=“iam.kubesphere.io” controllerKind=“User” User=“admin” namespace="" name=“admin” reconcileID=“d2b18349-8936-4c26-a249-43c8662b8939”
E0120 10:43:03.841472 1 controller.go:316] “Reconciler error” err=“failed to sync workspace template sv-cz-alg-test-devops to cluster host: failed to get cluster client for host: the server has asked for the client to provide credentials” controller=“workspacetemplate” controllerGroup=“tenant.kubesphere.io” controllerKind=“WorkspaceTemplate” WorkspaceTemplate=“sv-cz-alg-test-devops” namespace="" name=“sv-cz-alg-test-devops” reconcileID=“4fb48108-407d-4819-b9b6-4efe19ebef36”
E0120 10:43:03.841481 1 controller.go:316] “Reconciler error” err=“failed to sync global role binding notification-tenant-sidecar to cluster host: failed to get cluster client: the server has asked for the client to provide credentials” controller=“globalrolebinding” controllerGroup=“iam.kubesphere.io” controllerKind=“GlobalRoleBinding” GlobalRoleBinding=“notification-tenant-sidecar” namespace="" name=“notification-tenant-sidecar” reconcileID=“a13f68d4-9d2e-4718-8bfc-f73b1bddf113”
E0120 10:43:03.841822 1 controller.go:316] “Reconciler error” err=“failed to sync workspace template system-workspace to cluster host: failed to get cluster client for host: the server has asked for the client to provide credentials” controller=“workspacetemplate” controllerGroup=“tenant.kubesphere.io” controllerKind=“WorkspaceTemplate” WorkspaceTemplate=“system-workspace” namespace="" name=“system-workspace” reconcileID=“509473f9-7170-4cb6-8853-275eca19fa00”
E0120 10:43:03.841920 1 controller.go:316] “Reconciler error” err=“failed to sync global role binding ks-gateway-authenticated to cluster host: failed to get cluster client: the server has asked for the client to provide credentials” controller=“globalrolebinding” controllerGroup=“iam.kubesphere.io” controllerKind=“GlobalRoleBinding” GlobalRoleBinding=“ks-gateway-authenticated” namespace="" name=“ks-gateway-authenticated” reconcileID=“c432ed80-dd84-4cb8-b8ef-d3b13861d2cf”
E0120 10:43:03.856129 1 controller.go:316] “Reconciler error” err=“failed to sync global role binding pre-registration to cluster host: failed to get cluster client: the server has asked for the client to provide credentials” controller=“globalrolebinding” controllerGroup=“iam.kubesphere.io” controllerKind=“GlobalRoleBinding” GlobalRoleBinding=“pre-registration” namespace="" name=“pre-registration” reconcileID=“39f8c650-0fe1-441b-9f06-15428a8b5d66”
E0120 10:43:03.856441 1 controller.go:316] “Reconciler error” err="Operation cannot be fulfilled on clusters.cluster.kubesphere.io \“host\”: the object has been modified; please apply your changes to the latest version and try again" controller=“cluster” controllerGroup=“cluster.kubesphere.io” controllerKind=“Cluster” Cluster=“host” namespace="" name=“host” reconcileID=“9b6457e4-0525-4f5d-ba47-b5652f9d1572”
E0120 10:43:03.936908 1 controller.go:316] “Reconciler error” err=“failed to sync global role binding whizard-alerting-anonymous to cluster host: failed to get cluster client: the server has asked for the client to provide credentials” controller=“globalrolebinding” controllerGroup=“iam.kubesphere.io” controllerKind=“GlobalRoleBinding” GlobalRoleBinding=“whizard-alerting-anonymous” namespace="" name=“whizard-alerting-anonymous” reconcileID=“e0475072-4ae5-48b4-ac7f-37f632bf3633”
E0120 10:43:03.938440 1 controller.go:316] “Reconciler error” err=“failed to sync user admin to cluster host: failed to get cluster client: the server has asked for the client to provide credentials” controller=“user” controllerGroup=“iam.kubesphere.io” controllerKind=“User” User=“admin” namespace="" name=“admin” reconcileID=“8ca66e14-b46a-463d-b00c-5adfa29ac80f”
后面用kk重装k8s v1.30.0是将配置文件的autoRenewCerts设置为true,kubesphere的企业空间添加删除正常了。