创建部署问题时，请参考下面模板，你提供的信息越多，越容易及时获得解答。如果未按模板创建问题，管理员有权关闭问题。
确保帖子格式清晰易读，用 markdown code block 语法格式化代码块。
你只花一分钟创建的问题，不能指望别人花上半个小时给你解答。

操作系统信息
例如：虚拟机/物理机，ubuntu 20.04.3

Kubernetes版本信息
将 kubectl version 命令执行结果贴在下方

root@karma:/usr/k8s# kubectl version

Client Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.12", GitCommit:"b058e1760c79f46a834ba59bd7a3486ecf28237d", GitTreeState:"clean", BuildDate:"2022-07-13T14:59:18Z", GoVersion:"go1.16.15", Compiler:"gc", Platform:"linux/amd64"}

Server Version: version.Info{Major:"1", Minor:"22", GitVersion:"v1.22.12", GitCommit:"b058e1760c79f46a834ba59bd7a3486ecf28237d", GitTreeState:"clean", BuildDate:"2022-07-13T14:53:39Z", GoVersion:"go1.16.15", Compiler:"gc", Platform:"linux/amd64"}

容器运行时

root@karma:/usr/k8s# docker version

Client: Docker Engine - Community

Version: 24.0.7

API version: 1.43

Go version: go1.20.10

Git commit: afdd53b

Built: Thu Oct 26 09:07:41 2023

OS/Arch: linux/amd64

Context: default

Server: Docker Engine - Community

Engine:

Version: 24.0.7

API version: 1.43 (minimum version 1.12)

Go version: go1.20.10

Git commit: 311b9ff

Built: Thu Oct 26 09:07:41 2023

OS/Arch: linux/amd64

Experimental: false

containerd:

Version: 1.6.25

GitCommit: d8f198a4ed8892c764191ef7b3b06d8a2eeb5c7f

runc:

Version: 1.1.10

GitCommit: v1.1.10-0-g18a0cb0

docker-init:

Version: 0.19.0

GitCommit: de40ad0

KubeSphere版本信息
使用kk安装。

./kk create cluster –with-kubernetes v1.22.12 –with-kubesphere v3.4.0

问题

http://ip:30880/ 无法访问控制台

日志都正常：

kubectl logs -n kubesphere-system $(kubectl get pod -n kubesphere-system -l 'app in (ks-install, ks-installer)' -o jsonpath='{.items[0].metadata.name}') -f

2023-11-28T02:47:42Z INFO : shell-operator latest

2023-11-28T02:47:42Z INFO : HTTP SERVER Listening on 0.0.0.0:9115

2023-11-28T02:47:42Z INFO : Use temporary dir: /tmp/shell-operator

2023-11-28T02:47:42Z INFO : Initialize hooks manager ...

2023-11-28T02:47:42Z INFO : Search and load hooks ...

2023-11-28T02:47:42Z INFO : Load hook config from '/hooks/kubesphere/installRunner.py'

2023-11-28T02:47:42Z INFO : Load hook config from '/hooks/kubesphere/schedule.sh'

2023-11-28T02:47:42Z INFO : Initializing schedule manager ...

2023-11-28T02:47:42Z INFO : KUBE Init Kubernetes client

2023-11-28T02:47:42Z INFO : KUBE-INIT Kubernetes client is configured successfully

2023-11-28T02:47:42Z INFO : MAIN: run main loop

2023-11-28T02:47:42Z INFO : MAIN: add onStartup tasks

2023-11-28T02:47:42Z INFO : QUEUE add all HookRun@OnStartup

2023-11-28T02:47:42Z INFO : Running schedule manager ...

2023-11-28T02:47:42Z INFO : MSTOR Create new metric shell_operator_tasks_queue_length

2023-11-28T02:47:42Z INFO : MSTOR Create new metric shell_operator_live_ticks

2023-11-28T02:47:42Z INFO : GVR for kind 'ClusterConfiguration' is installer.kubesphere.io/v1alpha1, Resource=clusterconfigurations

2023-11-28T02:47:42Z INFO : EVENT Kube event 'c4d95b33-c84c-427a-9521-cec11eefb725'

2023-11-28T02:47:42Z INFO : QUEUE add TASK_HOOK_RUN@KUBE_EVENTS kubesphere/installRunner.py

2023-11-28T02:47:45Z INFO : TASK_RUN HookRun@KUBE_EVENTS kubesphere/installRunner.py

2023-11-28T02:47:45Z INFO : Running hook 'kubesphere/installRunner.py' binding 'KUBE_EVENTS' ...

Delete old cluster configuration successfully

Create cluster configuration successfully

2023-11-28T02:47:46Z INFO : EVENT Kube event 'c4d95b33-c84c-427a-9521-cec11eefb725'

2023-11-28T02:47:46Z INFO : QUEUE add TASK_HOOK_RUN@KUBE_EVENTS kubesphere/installRunner.py

2023-11-28T02:47:49Z INFO : TASK_RUN HookRun@KUBE_EVENTS kubesphere/installRunner.py

2023-11-28T02:47:49Z INFO : Running hook 'kubesphere/installRunner.py' binding 'KUBE_EVENTS' ...

[WARNING]: No inventory was parsed, only implicit localhost is available

[WARNING]: provided hosts list is empty, only localhost is available. Note that

the implicit localhost does not match 'all'

PLAY [localhost] ***************************************************************

TASK [download : Generating images list] ***************************************

skipping: [localhost]

TASK [download : Synchronizing images] *****************************************

TASK [kubesphere-defaults : KubeSphere | Setting images' namespace override] ***

ok: [localhost]

TASK [kubesphere-defaults : KubeSphere | Configuring defaults] *****************

ok: [localhost] => {

"msg": "Check roles/kubesphere-defaults/defaults/main.yml"

}

TASK [preinstall : KubeSphere | Stopping if Kubernetes version is nonsupport] ***

ok: [localhost] => {

"changed": false,

"msg": "All assertions passed"

}

TASK [preinstall : KubeSphere | Checking StorageClass] *************************

changed: [localhost]

TASK [preinstall : KubeSphere | Stopping if StorageClass was not found] ********

skipping: [localhost]

TASK [preinstall : KubeSphere | Checking default StorageClass] *****************

changed: [localhost]

TASK [preinstall : KubeSphere | Stopping if default StorageClass was not found] ***

ok: [localhost] => {

"changed": false,

"msg": "All assertions passed"

}

TASK [preinstall : KubeSphere | Stop if bad admin password] ********************

skipping: [localhost]

TASK [preinstall : KubeSphere | Checking KubeSphere component] *****************

changed: [localhost]

TASK [preinstall : KubeSphere | Getting KubeSphere component version] **********

skipping: [localhost]

TASK [preinstall : KubeSphere | Getting KubeSphere component version] **********

skipping: [localhost] => (item=ks-openldap)

skipping: [localhost] => (item=ks-redis)

skipping: [localhost] => (item=ks-minio)

skipping: [localhost] => (item=ks-openpitrix)

skipping: [localhost] => (item=elasticsearch-logging)

skipping: [localhost] => (item=elasticsearch-logging-curator)

skipping: [localhost] => (item=istio)

skipping: [localhost] => (item=istio-init)

skipping: [localhost] => (item=jaeger-operator)

skipping: [localhost] => (item=ks-jenkins)

skipping: [localhost] => (item=ks-sonarqube)

skipping: [localhost] => (item=logging-fluentbit-operator)

skipping: [localhost] => (item=uc)

skipping: [localhost] => (item=metrics-server)

PLAY RECAP *********************************************************************

localhost : ok=7 changed=3 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0

[WARNING]: No inventory was parsed, only implicit localhost is available

[WARNING]: provided hosts list is empty, only localhost is available. Note that

the implicit localhost does not match 'all'

PLAY [localhost] ***************************************************************

TASK [download : Generating images list] ***************************************

skipping: [localhost]

TASK [download : Synchronizing images] *****************************************

TASK [kubesphere-defaults : KubeSphere | Setting images' namespace override] ***

ok: [localhost]

TASK [kubesphere-defaults : KubeSphere | Configuring defaults] *****************

ok: [localhost] => {

"msg": "Check roles/kubesphere-defaults/defaults/main.yml"

}

TASK [Metrics-Server | Getting metrics-server installation files] **************

skipping: [localhost]

TASK [metrics-server : Metrics-Server | Creating manifests] ********************

skipping: [localhost] => (item={'file': 'metrics-server.yaml'})

TASK [metrics-server : Metrics-Server | Checking Metrics-Server] ***************

skipping: [localhost]

TASK [Metrics-Server | Uninstalling old metrics-server] ************************

skipping: [localhost]

TASK [Metrics-Server | Installing new metrics-server] **************************

skipping: [localhost]

TASK [metrics-server : Metrics-Server | Waitting for metrics.k8s.io ready] *****

skipping: [localhost]

TASK [Metrics-Server | Importing metrics-server status] ************************

skipping: [localhost]

PLAY RECAP *********************************************************************

localhost : ok=2 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0

[WARNING]: No inventory was parsed, only implicit localhost is available

[WARNING]: provided hosts list is empty, only localhost is available. Note that

the implicit localhost does not match 'all'

PLAY [localhost] ***************************************************************

TASK [download : Generating images list] ***************************************

skipping: [localhost]

TASK [download : Synchronizing images] *****************************************

TASK [kubesphere-defaults : KubeSphere | Setting images' namespace override] ***

ok: [localhost]

TASK [kubesphere-defaults : KubeSphere | Configuring defaults] *****************

ok: [localhost] => {

"msg": "Check roles/kubesphere-defaults/defaults/main.yml"

}

TASK [common : KubeSphere | Checking kube-node-lease namespace] ****************

changed: [localhost]

TASK [common : KubeSphere | Getting system namespaces] *************************

ok: [localhost]

TASK [common : set_fact] *******************************************************

ok: [localhost]

TASK [common : debug] **********************************************************

ok: [localhost] => {

"msg": [

"kubesphere-system",

"kubesphere-controls-system",

"kubesphere-monitoring-system",

"kubesphere-monitoring-federated",

"kube-node-lease"

]

}

TASK [common : KubeSphere | Creating KubeSphere namespace] *********************

changed: [localhost] => (item=kubesphere-system)

changed: [localhost] => (item=kubesphere-controls-system)

changed: [localhost] => (item=kubesphere-monitoring-system)

changed: [localhost] => (item=kubesphere-monitoring-federated)

changed: [localhost] => (item=kube-node-lease)

TASK [common : KubeSphere | Labeling system-workspace] *************************

changed: [localhost] => (item=default)

changed: [localhost] => (item=kube-public)

changed: [localhost] => (item=kube-system)

changed: [localhost] => (item=kubesphere-system)

changed: [localhost] => (item=kubesphere-controls-system)

changed: [localhost] => (item=kubesphere-monitoring-system)

changed: [localhost] => (item=kubesphere-monitoring-federated)

changed: [localhost] => (item=kube-node-lease)

TASK [common : KubeSphere | Labeling namespace for network policy] *************

changed: [localhost]

TASK [common : KubeSphere | Getting Kubernetes master num] *********************

changed: [localhost]

TASK [common : KubeSphere | Setting master num] ********************************

ok: [localhost]

TASK [KubeSphere | Getting common component installation files] ****************

changed: [localhost] => (item=common)

TASK [common : KubeSphere | Checking Kubernetes version] ***********************

changed: [localhost]

TASK [KubeSphere | Getting common component installation files] ****************

changed: [localhost] => (item=snapshot-controller)

TASK [common : KubeSphere | Creating snapshot controller values] ***************

changed: [localhost] => (item={'name': 'custom-values-snapshot-controller', 'file': 'custom-values-snapshot-controller.yaml'})

TASK [common : KubeSphere | Updating snapshot crd] *****************************

changed: [localhost]

TASK [common : KubeSphere | Deploying snapshot controller] *********************

changed: [localhost]

TASK [KubeSphere | Checking openpitrix common component] ***********************

changed: [localhost]

TASK [common : include_tasks] **************************************************

skipping: [localhost] => (item={'op': 'openpitrix-db', 'ks': 'mysql-pvc'})

skipping: [localhost] => (item={'op': 'openpitrix-etcd', 'ks': 'etcd-pvc'})

TASK [common : Getting PersistentVolumeName (mysql)] ***************************

skipping: [localhost]

TASK [common : Getting PersistentVolumeSize (mysql)] ***************************

skipping: [localhost]

TASK [common : Setting PersistentVolumeName (mysql)] ***************************

skipping: [localhost]

TASK [common : Setting PersistentVolumeSize (mysql)] ***************************

skipping: [localhost]

TASK [common : Getting PersistentVolumeName (etcd)] ****************************

skipping: [localhost]

TASK [common : Getting PersistentVolumeSize (etcd)] ****************************

skipping: [localhost]

TASK [common : Setting PersistentVolumeName (etcd)] ****************************

skipping: [localhost]

TASK [common : Setting PersistentVolumeSize (etcd)] ****************************

skipping: [localhost]

TASK [common : KubeSphere | Checking mysql PersistentVolumeClaim] **************

changed: [localhost]

TASK [common : KubeSphere | Setting mysql db pv size] **************************

skipping: [localhost]

TASK [common : KubeSphere | Checking redis PersistentVolumeClaim] **************

changed: [localhost]

TASK [common : KubeSphere | Setting redis db pv size] **************************

skipping: [localhost]

TASK [common : KubeSphere | Checking minio PersistentVolumeClaim] **************

changed: [localhost]

TASK [common : KubeSphere | Setting minio pv size] *****************************

skipping: [localhost]

TASK [common : KubeSphere | Checking openldap PersistentVolumeClaim] ***********

changed: [localhost]

TASK [common : KubeSphere | Setting openldap pv size] **************************

skipping: [localhost]

TASK [common : KubeSphere | Checking etcd db PersistentVolumeClaim] ************

changed: [localhost]

TASK [common : KubeSphere | Setting etcd pv size] ******************************

skipping: [localhost]

TASK [common : KubeSphere | Checking redis ha PersistentVolumeClaim] ***********

changed: [localhost]

TASK [common : KubeSphere | Setting redis ha pv size] **************************

skipping: [localhost]

TASK [common : KubeSphere | Checking es-master PersistentVolumeClaim] **********

changed: [localhost]

TASK [common : KubeSphere | Setting es master pv size] *************************

skipping: [localhost]

TASK [common : KubeSphere | Checking es data PersistentVolumeClaim] ************

changed: [localhost]

TASK [common : KubeSphere | Setting es data pv size] ***************************

skipping: [localhost]

TASK [common : KubeSphere | Checking opensearch-master PersistentVolumeClaim] ***

changed: [localhost]

TASK [common : KubeSphere | Setting opensearch master pv size] *****************

skipping: [localhost]

TASK [common : KubeSphere | Checking opensearch data PersistentVolumeClaim] ****

changed: [localhost]

TASK [common : KubeSphere | Setting opensearch data pv size] *******************

skipping: [localhost]

TASK [KubeSphere | Creating common component manifests] ************************

changed: [localhost] => (item={'path': 'redis', 'file': 'redis.yaml'})

TASK [common : KubeSphere | Deploying etcd and mysql] **************************

skipping: [localhost] => (item=etcd.yaml)

skipping: [localhost] => (item=mysql.yaml)

TASK [common : KubeSphere | Getting minio installation files] ******************

skipping: [localhost] => (item=minio-ha)

TASK [common : KubeSphere | Creating manifests] ********************************

skipping: [localhost] => (item={'name': 'custom-values-minio', 'file': 'custom-values-minio.yaml'})

TASK [common : KubeSphere | Checking minio] ************************************

skipping: [localhost]

TASK [common : KubeSphere | Deploying minio] ***********************************

skipping: [localhost]

TASK [common : debug] **********************************************************

skipping: [localhost]

TASK [common : fail] ***********************************************************

skipping: [localhost]

TASK [common : KubeSphere | Importing minio status] ****************************

skipping: [localhost]

TASK [common : KubeSphere | Generet Random password] ***************************

skipping: [localhost]

TASK [common : KubeSphere | Creating Redis Password Secret] ********************

skipping: [localhost]

TASK [common : KubeSphere | Getting redis installation files] ******************

skipping: [localhost] => (item=redis-ha)

TASK [common : KubeSphere | Creating manifests] ********************************

skipping: [localhost] => (item={'name': 'custom-values-redis', 'file': 'custom-values-redis.yaml'})

TASK [common : KubeSphere | Checking old redis status] *************************

skipping: [localhost]

TASK [common : KubeSphere | Deleting and backup old redis svc] *****************

skipping: [localhost]

TASK [common : KubeSphere | Deploying redis] ***********************************

skipping: [localhost]

TASK [common : KubeSphere | Deploying redis] ***********************************

skipping: [localhost] => (item=redis.yaml)

TASK [common : KubeSphere | Importing redis status] ****************************

skipping: [localhost]

TASK [common : KubeSphere | Getting openldap installation files] ***************

skipping: [localhost] => (item=openldap-ha)

TASK [common : KubeSphere | Creating manifests] ********************************

skipping: [localhost] => (item={'name': 'custom-values-openldap', 'file': 'custom-values-openldap.yaml'})

TASK [common : KubeSphere | Checking old openldap status] **********************

skipping: [localhost]

TASK [common : KubeSphere | Shutdown ks-account] *******************************

skipping: [localhost]

TASK [common : KubeSphere | Deleting and backup old openldap svc] **************

skipping: [localhost]

TASK [common : KubeSphere | Checking openldap] *********************************

skipping: [localhost]

TASK [common : KubeSphere | Deploying openldap] ********************************

skipping: [localhost]

TASK [common : KubeSphere | Loading old openldap data] *************************

skipping: [localhost]

TASK [common : KubeSphere | Checking openldap-ha status] ***********************

skipping: [localhost]

TASK [common : KubeSphere | Getting openldap-ha pod list] **********************

skipping: [localhost]

TASK [common : KubeSphere | Getting old openldap data] *************************

skipping: [localhost]

TASK [common : KubeSphere | Migrating openldap data] ***************************

skipping: [localhost]

TASK [common : KubeSphere | Disabling old openldap] ****************************

skipping: [localhost]

TASK [common : KubeSphere | Restarting openldap] *******************************

skipping: [localhost]

TASK [common : KubeSphere | Restarting ks-account] *****************************

skipping: [localhost]

TASK [common : KubeSphere | Importing openldap status] *************************

skipping: [localhost]

TASK [common : KubeSphere | Checking KubeSphere Config is Exists] **************

changed: [localhost]

TASK [common : KubeSphere | Generet Random password] ***************************

skipping: [localhost]

TASK [common : KubeSphere | Creating Redis Password Secret] ********************

skipping: [localhost]

TASK [common : KubeSphere | Getting redis installation files] ******************

skipping: [localhost] => (item=redis-ha)

TASK [common : KubeSphere | Creating manifests] ********************************

skipping: [localhost] => (item={'name': 'custom-values-redis', 'file': 'custom-values-redis.yaml'})

TASK [common : KubeSphere | Checking old redis status] *************************

skipping: [localhost]

TASK [common : KubeSphere | Deleting and backup old redis svc] *****************

skipping: [localhost]

TASK [common : KubeSphere | Deploying redis] ***********************************

skipping: [localhost]

TASK [common : KubeSphere | Deploying redis] ***********************************

skipping: [localhost] => (item=redis.yaml)

TASK [common : KubeSphere | Importing redis status] ****************************

skipping: [localhost]

TASK [common : KubeSphere | Getting openldap installation files] ***************

skipping: [localhost] => (item=openldap-ha)

TASK [common : KubeSphere | Creating manifests] ********************************

skipping: [localhost] => (item={'name': 'custom-values-openldap', 'file': 'custom-values-openldap.yaml'})

TASK [common : KubeSphere | Checking old openldap status] **********************

skipping: [localhost]

TASK [common : KubeSphere | Shutdown ks-account] *******************************

skipping: [localhost]

TASK [common : KubeSphere | Deleting and backup old openldap svc] **************

skipping: [localhost]

TASK [common : KubeSphere | Checking openldap] *********************************

skipping: [localhost]

TASK [common : KubeSphere | Deploying openldap] ********************************

skipping: [localhost]

TASK [common : KubeSphere | Loading old openldap data] *************************

skipping: [localhost]

TASK [common : KubeSphere | Checking openldap-ha status] ***********************

skipping: [localhost]

TASK [common : KubeSphere | Getting openldap-ha pod list] **********************

skipping: [localhost]

TASK [common : KubeSphere | Getting old openldap data] *************************

skipping: [localhost]

TASK [common : KubeSphere | Migrating openldap data] ***************************

skipping: [localhost]

TASK [common : KubeSphere | Disabling old openldap] ****************************

skipping: [localhost]

TASK [common : KubeSphere | Restarting openldap] *******************************

skipping: [localhost]

TASK [common : KubeSphere | Restarting ks-account] *****************************

skipping: [localhost]

TASK [common : KubeSphere | Importing openldap status] *************************

skipping: [localhost]

TASK [common : KubeSphere | Getting minio installation files] ******************

skipping: [localhost] => (item=minio-ha)

TASK [common : KubeSphere | Creating manifests] ********************************

skipping: [localhost] => (item={'name': 'custom-values-minio', 'file': 'custom-values-minio.yaml'})

TASK [common : KubeSphere | Checking minio] ************************************

skipping: [localhost]

TASK [common : KubeSphere | Deploying minio] ***********************************

skipping: [localhost]

TASK [common : debug] **********************************************************

skipping: [localhost]

TASK [common : fail] ***********************************************************

skipping: [localhost]

TASK [common : KubeSphere | Importing minio status] ****************************

skipping: [localhost]

TASK [common : KubeSphere | Getting curator installation files] ****************

skipping: [localhost]

TASK [common : KubeSphere | Creating custom manifests] *************************

skipping: [localhost] => (item={'name': 'custom-values-elasticsearch-curator', 'file': 'custom-values-elasticsearch-curator.yaml'})

TASK [common : KubeSphere | Creating elasticsearch credentials secret] *********

skipping: [localhost]

TASK [common : KubeSphere | Getting Elasticsearch host] ************************

skipping: [localhost]

TASK [common : KubeSphere | Importing es status] *******************************

skipping: [localhost]

TASK [common : KubeSphere | Deploying elasticsearch-logging-curator] ***********

skipping: [localhost]

TASK [common : KubeSphere | Getting opensearch and curator installation files] ***

skipping: [localhost]

TASK [common : KubeSphere | Creating custom manifests] *************************

skipping: [localhost] => (item={'name': 'custom-values-opensearch-master', 'file': 'custom-values-opensearch-master.yaml'})

skipping: [localhost] => (item={'name': 'custom-values-opensearch-data', 'file': 'custom-values-opensearch-data.yaml'})

skipping: [localhost] => (item={'name': 'custom-values-opensearch-curator', 'file': 'custom-values-opensearch-curator.yaml'})

skipping: [localhost] => (item={'name': 'custom-values-opensearch-dashboard', 'file': 'custom-values-opensearch-dashboard.yaml'})

TASK [common : KubeSphere | Checking opensearch data StatefulSet] **************

skipping: [localhost]

TASK [common : KubeSphere | Checking opensearch storageclass] ******************

skipping: [localhost]

TASK [common : KubeSphere | Commenting opensearch storageclass parameter] ******

skipping: [localhost]

TASK [common : KubeSphere | Creating opensearch credentials secret] ************

skipping: [localhost]

TASK [common : KubeSphere | Checking internal opensearch] **********************

skipping: [localhost]

TASK [common : ks-logging | Debug opensearch_host] *****************************

skipping: [localhost]

TASK [common : KubeSphere | Deploying opensearch-logging] **********************

skipping: [localhost]

TASK [common : KubeSphere | Getting PersistentVolume Name] *********************

skipping: [localhost]

TASK [common : ks-logging | Debug opensearch_host] *****************************

skipping: [localhost]

TASK [common : KubeSphere | Patching PersistentVolume (persistentVolumeReclaimPolicy)] ***

skipping: [localhost]

TASK [common : KubeSphere | Deleting opensearch] *******************************

skipping: [localhost]

TASK [common : KubeSphere | Waiting for seconds] *******************************

skipping: [localhost]

TASK [common : KubeSphere | Deploying opensearch-logging] **********************

skipping: [localhost]

TASK [common : ks-logging | Debug opensearch_result] ***************************

skipping: [localhost]

TASK [common : KubeSphere | Importing opensearch status] ***********************

skipping: [localhost]

TASK [common : KubeSphere | Deploying opensearch-logging-curator] **************

skipping: [localhost]

TASK [common : KubeSphere | Deploying opensearch-dashboard] ********************

skipping: [localhost]

TASK [common : KubeSphere | Getting fluentbit installation files] **************

skipping: [localhost]

TASK [common : ks-logging | Getting Kubernetes Node info] **********************

skipping: [localhost]

TASK [common : ks-logging | Setting container runtime of kubernetes] ***********

skipping: [localhost]

TASK [common : ks-logging | Setting container runtime of kubernetes] ***********

skipping: [localhost]

TASK [common : ks-logging | Debug container_runtime] ***************************

skipping: [localhost]

TASK [common : ks-logging | Debug logging_container_runtime] *******************

skipping: [localhost]

TASK [common : KubeSphere | Creating custom manifests] *************************

skipping: [localhost] => (item={'path': 'fluentbit', 'file': 'custom-fluentbit-fluentBit.yaml'})

skipping: [localhost] => (item={'path': 'init', 'file': 'custom-fluentbit-operator-deployment.yaml'})

TASK [common : KubeSphere | Preparing fluentbit operator setup] ****************

skipping: [localhost]

TASK [common : KubeSphere | Deploying new fluentbit operator] ******************

skipping: [localhost]

TASK [common : KubeSphere | Importing fluentbit status] ************************

skipping: [localhost]

TASK [common : Setting persistentVolumeReclaimPolicy (mysql)] ******************

skipping: [localhost]

TASK [common : Setting persistentVolumeReclaimPolicy (etcd)] *******************

skipping: [localhost]

PLAY RECAP *********************************************************************

localhost : ok=30 changed=24 unreachable=0 failed=0 skipped=123 rescued=0 ignored=0

[WARNING]: No inventory was parsed, only implicit localhost is available

[WARNING]: provided hosts list is empty, only localhost is available. Note that

the implicit localhost does not match 'all'

PLAY [localhost] ***************************************************************

TASK [download : Generating images list] ***************************************

skipping: [localhost]

TASK [download : Synchronizing images] *****************************************

TASK [kubesphere-defaults : KubeSphere | Setting images' namespace override] ***

ok: [localhost]

TASK [kubesphere-defaults : KubeSphere | Configuring defaults] *****************

ok: [localhost] => {

"msg": "Check roles/kubesphere-defaults/defaults/main.yml"

}

TASK [ks-core/init-token : KubeSphere | Creating KubeSphere directory] *********

ok: [localhost]

TASK [ks-core/init-token : KubeSphere | Getting installation init files] *******

changed: [localhost] => (item=jwt-script)

TASK [ks-core/init-token : KubeSphere | Creating KubeSphere Secret] ************

changed: [localhost]

TASK [ks-core/init-token : KubeSphere | Creating KubeSphere Secret] ************

ok: [localhost]

TASK [ks-core/init-token : KubeSphere | Creating KubeSphere Secret] ************

skipping: [localhost]

TASK [ks-core/init-token : KubeSphere | Enabling Token Script] *****************

changed: [localhost]

TASK [ks-core/init-token : KubeSphere | Getting KubeSphere Token] **************

changed: [localhost]

TASK [ks-core/init-token : KubeSphere | Checking KubeSphere secrets] ***********

changed: [localhost]

TASK [ks-core/init-token : KubeSphere | Deleting KubeSphere secret] ************

skipping: [localhost]

TASK [ks-core/init-token : KubeSphere | Creating components token] *************

changed: [localhost]

TASK [ks-core/ks-core : KubeSphere | Setting Kubernetes version] ***************

ok: [localhost]

TASK [ks-core/ks-core : KubeSphere | Getting Kubernetes master num] ************

changed: [localhost]

TASK [ks-core/ks-core : KubeSphere | Setting master num] ***********************

ok: [localhost]

TASK [ks-core/ks-core : KubeSphere | Override master num] **********************

skipping: [localhost]

TASK [ks-core/ks-core : KubeSphere | Setting enableHA] *************************

ok: [localhost]

TASK [ks-core/ks-core : KubeSphere | Checking ks-core Helm Release] ************

changed: [localhost]

TASK [ks-core/ks-core : KubeSphere | Checking ks-core Exsit] *******************

changed: [localhost]

TASK [ks-core/ks-core : KubeSphere | Convert ks-core to helm mananged] *********

skipping: [localhost] => (item={'ns': 'kubesphere-controls-system', 'kind': 'serviceaccounts', 'resource': 'kubesphere-cluster-admin', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-controls-system', 'kind': 'serviceaccounts', 'resource': 'kubesphere-router-serviceaccount', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-controls-system', 'kind': 'role', 'resource': 'system:kubesphere-router-role', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-controls-system', 'kind': 'rolebinding', 'resource': 'nginx-ingress-role-nisa-binding', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-controls-system', 'kind': 'deployment', 'resource': 'default-http-backend', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-controls-system', 'kind': 'service', 'resource': 'default-http-backend', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'secrets', 'resource': 'ks-controller-manager-webhook-cert', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'serviceaccounts', 'resource': 'kubesphere', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'configmaps', 'resource': 'ks-console-config', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'configmaps', 'resource': 'ks-router-config', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'configmaps', 'resource': 'sample-bookinfo', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'clusterroles', 'resource': 'system:kubesphere-router-clusterrole', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'clusterrolebindings', 'resource': 'system:nginx-ingress-clusterrole-nisa-binding', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'clusterrolebindings', 'resource': 'system:kubesphere-cluster-admin', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'clusterrolebindings', 'resource': 'kubesphere', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'services', 'resource': 'ks-apiserver', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'services', 'resource': 'ks-console', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'services', 'resource': 'ks-controller-manager', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'deployments', 'resource': 'ks-apiserver', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'deployments', 'resource': 'ks-console', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'deployments', 'resource': 'ks-controller-manager', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'validatingwebhookconfigurations', 'resource': 'users.iam.kubesphere.io', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'validatingwebhookconfigurations', 'resource': 'resourcesquotas.quota.kubesphere.io', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'validatingwebhookconfigurations', 'resource': 'network.kubesphere.io', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'validatingwebhookconfigurations', 'resource': 'cluster.kubesphere.io', 'release': 'ks-core'})

skipping: [localhost] => (item={'ns': 'kubesphere-system', 'kind': 'users.iam.kubesphere.io', 'resource': 'admin', 'release': 'ks-core'})

TASK [ks-core/ks-core : KubeSphere | Patch admin user] *************************

skipping: [localhost]

TASK [ks-core/ks-core : KubeSphere | Getting ks-core helm charts] **************

changed: [localhost] => (item=ks-core)

TASK [ks-core/ks-core : KubeSphere | Checking KubeSphere Admin User] ***********

changed: [localhost]

TASK [ks-core/ks-core : set_fact] **********************************************

ok: [localhost]

TASK [ks-core/ks-core : shell] *************************************************

skipping: [localhost]

TASK [ks-core/ks-core : KubeSphere | Creating manifests] ***********************

changed: [localhost] => (item={'path': 'ks-core', 'file': 'custom-values-ks-core.yaml'})

TASK [ks-core/ks-core : KubeSphere | Upgrade CRDs] *****************************

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/servicemesh.kubesphere.io_servicepolicies.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_globalroles.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_users.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/app_v1beta1_application.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_federatedusers.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_workspacerolebindings.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_loginrecords.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/application.kubesphere.io_helmcategories.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/tenant.kubesphere.io_workspacetemplates.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/servicemesh.kubesphere.io_strategies.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/alerting.kubesphere.io_clusterrulegroups.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_globalrolebindings.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/network.kubesphere.io_namespacenetworkpolicies.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_rolebases.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/cluster.kubesphere.io_clusters.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/alerting.kubesphere.io_globalrulegroups.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/application.kubesphere.io_helmreleases.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_groups.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/network.kubesphere.io_ipamblocks.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/gateway.kubesphere.io_gateways.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/tenant.kubesphere.io_workspaces.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/application.kubesphere.io_helmrepos.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/gateway.kubesphere.io_nginxes.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/network.kubesphere.io_ipamhandles.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_federatedroles.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_workspaceroles.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/quota.kubesphere.io_resourcequotas.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/application.kubesphere.io_helmapplicationversions.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_groupbindings.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/iam.kubesphere.io_federatedrolebindings.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/network.kubesphere.io_ippools.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/storage.kubesphere.io_storageclasseraccessor.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/alerting.kubesphere.io_rulegroups.yaml)

changed: [localhost] => (item=/kubesphere/kubesphere/ks-core/crds/application.kubesphere.io_helmapplications.yaml)

TASK [ks-core/ks-core : KubeSphere | Creating ks-core] *************************

changed: [localhost]

TASK [ks-core/ks-core : KubeSphere | Creating manifests] ***********************

changed: [localhost] => (item={'path': 'ks-core', 'file': 'ks-upgrade.yaml'})

TASK [ks-core/ks-core : Kubesphere | Checking Users Manger and Workspaces Manger] ***

changed: [localhost]

TASK [ks-core/ks-core : Kubesphere | Checking migration job] *******************

skipping: [localhost]

TASK [ks-core/ks-core : KubeSphere | Creating migration job] *******************

skipping: [localhost]

TASK [ks-core/ks-core : KubeSphere | Importing ks-core status] *****************

changed: [localhost]

TASK [ks-core/ks-core : KubeSphere | Checking RoleTemplate Alerting Management] ***

changed: [localhost]

TASK [ks-core/ks-core : KubeSphere | Deleteing RoleTemplate Alerting Management] ***

skipping: [localhost]

TASK [ks-core/prepare : KubeSphere | Checking core components (1)] *************

changed: [localhost]

TASK [ks-core/prepare : KubeSphere | Checking core components (2)] *************

changed: [localhost]

TASK [ks-core/prepare : KubeSphere | Checking core components (3)] *************

skipping: [localhost]

TASK [ks-core/prepare : KubeSphere | Checking core components (4)] *************

skipping: [localhost]

TASK [ks-core/prepare : KubeSphere | Updating ks-core status] ******************

skipping: [localhost]

TASK [ks-core/prepare : set_fact] **********************************************

skipping: [localhost]

TASK [ks-core/prepare : KubeSphere | Creating KubeSphere directory] ************

ok: [localhost]

TASK [ks-core/prepare : KubeSphere | Getting installation init files] **********

changed: [localhost] => (item=ks-init)

TASK [ks-core/prepare : KubeSphere | Initing KubeSphere] ***********************

changed: [localhost] => (item=role-templates.yaml)

TASK [ks-core/prepare : KubeSphere | Generating kubeconfig-admin] **************

skipping: [localhost]

PLAY RECAP *********************************************************************

localhost : ok=31 changed=22 unreachable=0 failed=0 skipped=16 rescued=0 ignored=0

Start installing monitoring

Start installing multicluster

Start installing openpitrix

Start installing network

**************************************************

Waiting for all tasks to be completed ...

task network status is successful (1/4)

task openpitrix status is successful (2/4)

task multicluster status is successful (3/4)

task monitoring status is successful (4/4)

**************************************************

Collecting installation results ...

#####################################################

### Welcome to KubeSphere! ###

#####################################################

Console: http://192.168.9.15:30880

Account: admin

Password: P@88w0rd

NOTES：

1. After you log into the console, please check the

monitoring status of service components in

"Cluster Management". If any service is not

ready, please wait patiently until all components

are up and running.

2. Please change the default password after login.

#####################################################

https://kubesphere.io 2023-11-28 02:52:37

#####################################################

root@karma:/usr/k8s# sudo netstat -tlunp

Active Internet connections (only servers)

Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name

tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 4210/sshd: /usr/sbi

tcp 0 0 127.0.0.1:9100 0.0.0.0:* LISTEN 42063/node_exporter

tcp 0 0 127.0.0.1:9099 0.0.0.0:* LISTEN 28625/calico-node

tcp 0 0 192.168.9.15:9100 0.0.0.0:* LISTEN 56506/kube-rbac-pro

tcp 0 0 127.0.0.53:53 0.0.0.0:* LISTEN 3572/systemd-resolv

tcp 0 0 127.0.0.1:2379 0.0.0.0:* LISTEN 19389/etcd

tcp 0 0 192.168.9.15:2379 0.0.0.0:* LISTEN 19389/etcd

tcp 0 0 192.168.9.15:2380 0.0.0.0:* LISTEN 19389/etcd

tcp 0 0 127.0.0.1:10249 0.0.0.0:* LISTEN 26759/kube-proxy

tcp 0 0 127.0.0.1:10248 0.0.0.0:* LISTEN 21160/kubelet

tcp 0 0 127.0.0.1:6012 0.0.0.0:* LISTEN 18771/sshd: karma@p

tcp 0 0 127.0.0.1:6011 0.0.0.0:* LISTEN 44584/sshd: karma@p

tcp 0 0 127.0.0.1:6010 0.0.0.0:* LISTEN 2104/sshd: karma@pt

tcp 0 0 127.0.0.1:37579 0.0.0.0:* LISTEN 21160/kubelet

tcp 0 0 169.254.25.10:9254 0.0.0.0:* LISTEN 26442/node-cache

tcp 0 0 169.254.25.10:53 0.0.0.0:* LISTEN 26442/node-cache

tcp6 0 0 :::22 :::* LISTEN 4210/sshd: /usr/sbi

tcp6 0 0 :::9253 :::* LISTEN 26442/node-cache

tcp6 0 0 :::9353 :::* LISTEN 26442/node-cache

tcp6 0 0 :::10259 :::* LISTEN 20872/kube-schedule

tcp6 0 0 :::10256 :::* LISTEN 26759/kube-proxy

tcp6 0 0 :::10257 :::* LISTEN 20863/kube-controll

tcp6 0 0 :::10250 :::* LISTEN 21160/kubelet

tcp6 0 0 ::1:6011 :::* LISTEN 44584/sshd: karma@p

tcp6 0 0 ::1:6010 :::* LISTEN 2104/sshd: karma@pt

tcp6 0 0 ::1:6012 :::* LISTEN 18771/sshd: karma@p

tcp6 0 0 :::6443 :::* LISTEN 20870/kube-apiserve

udp 0 0 169.254.25.10:53 0.0.0.0:* 26442/node-cache

udp 0 0 127.0.0.53:53 0.0.0.0:* 3572/systemd-resolv

udp 0 0 192.168.9.15:68 0.0.0.0:* 3566/systemd-networ

root@karma:/usr/k8s# kubectl describe pod kube-apiserver-karma -n kube-system

Name: kube-apiserver-karma

Namespace: kube-system

Priority: 2000001000

Priority Class Name: system-node-critical

Node: karma/192.168.9.15

Start Time: Tue, 28 Nov 2023 02:46:24 +0000

Labels: component=kube-apiserver

tier=control-plane

Annotations: kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.9.15:6443

kubernetes.io/config.hash: fec1605e55abab3e3b7c3b3604a9a698

kubernetes.io/config.mirror: fec1605e55abab3e3b7c3b3604a9a698

kubernetes.io/config.seen: 2023-11-28T02:46:16.546589367Z

kubernetes.io/config.source: file

seccomp.security.alpha.kubernetes.io/pod: runtime/default

Status: Running

IP: 192.168.9.15

IPs:

IP: 192.168.9.15

Controlled By: Node/karma

Containers:

kube-apiserver:

Container ID: docker://375f0a03652a9bb914e0d7269ce955f4fe835cb989120e8ed9ba57f741ae6378

Image: registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver:v1.22.12

Image ID: docker-pullable://registry.cn-beijing.aliyuncs.com/kubesphereio/kube-apiserver@sha256:2d468b56fa96f11ba3b7b9c402111c023cf97c89d93ce113536e7f8370660d52

Port: <none>

Host Port: <none>

Command:

kube-apiserver

--advertise-address=192.168.9.15

--allow-privileged=true

--authorization-mode=Node,RBAC

--bind-address=0.0.0.0

--client-ca-file=/etc/kubernetes/pki/ca.crt

--enable-admission-plugins=NodeRestriction

--enable-bootstrap-token-auth=true

--etcd-cafile=/etc/ssl/etcd/ssl/ca.pem

--etcd-certfile=/etc/ssl/etcd/ssl/node-karma.pem

--etcd-keyfile=/etc/ssl/etcd/ssl/node-karma-key.pem

--etcd-servers=https://192.168.9.15:2379

--feature-gates=RotateKubeletServerCertificate=true,TTLAfterFinished=true

--kubelet-client-certificate=/etc/kubernetes/pki/apiserver-kubelet-client.crt

--kubelet-client-key=/etc/kubernetes/pki/apiserver-kubelet-client.key

--kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname

--proxy-client-cert-file=/etc/kubernetes/pki/front-proxy-client.crt

--proxy-client-key-file=/etc/kubernetes/pki/front-proxy-client.key

--requestheader-allowed-names=front-proxy-client

--requestheader-client-ca-file=/etc/kubernetes/pki/front-proxy-ca.crt

--requestheader-extra-headers-prefix=X-Remote-Extra-

--requestheader-group-headers=X-Remote-Group

--requestheader-username-headers=X-Remote-User

--secure-port=6443

--service-account-issuer=https://kubernetes.default.svc.cluster.local

--service-account-key-file=/etc/kubernetes/pki/sa.pub

--service-account-signing-key-file=/etc/kubernetes/pki/sa.key

--service-cluster-ip-range=10.233.0.0/18

--tls-cert-file=/etc/kubernetes/pki/apiserver.crt

--tls-private-key-file=/etc/kubernetes/pki/apiserver.key

State: Running

Started: Tue, 28 Nov 2023 02:46:18 +0000

Ready: True

Restart Count: 0

Requests:

cpu: 250m

Liveness: http-get https://192.168.9.15:6443/livez delay=10s timeout=15s period=10s #success=1 #failure=8

Readiness: http-get https://192.168.9.15:6443/readyz delay=0s timeout=15s period=1s #success=1 #failure=3

Startup: http-get https://192.168.9.15:6443/livez delay=10s timeout=15s period=10s #success=1 #failure=24

Environment: <none>

Mounts:

/etc/ca-certificates from etc-ca-certificates (ro)

/etc/kubernetes/pki from k8s-certs (ro)

/etc/pki from etc-pki (ro)

/etc/ssl/certs from ca-certs (ro)

/etc/ssl/etcd/ssl from etcd-certs-0 (ro)

/usr/local/share/ca-certificates from usr-local-share-ca-certificates (ro)

/usr/share/ca-certificates from usr-share-ca-certificates (ro)

Conditions:

Type Status

Initialized True

Ready True

ContainersReady True

PodScheduled True

Volumes:

ca-certs: