./kk add nodes -f sample.yaml 报错

bjdaijun

创建部署问题时，请参考下面模板，你提供的信息越多，越容易及时获得解答。如果未按模板创建问题，管理员有权关闭问题。
确保帖子格式清晰易读，用 markdown code block 语法格式化代码块。
你只花一分钟创建的问题，不能指望别人花上半个小时给你解答。

操作系统信息
ubuntu 22.04

Kubernetes版本信息
将 kubectl version 命令执行结果贴在下方

Client Version: version.Info{Major:“1”, Minor:“21”, GitVersion:“v1.21.5”, GitCommit:“aea7bbadd2fc0cd689de94a54e5b7b758869d691”, GitTreeState:“clean”, BuildDate:“2021-09-15T21:10:45Z”, GoVersion:“go1.16.8”, Compiler:“gc”, Platform:“linux/amd64”}

Server Version: version.Info{Major:“1”, Minor:“21”, GitVersion:“v1.21.5”, GitCommit:“aea7bbadd2fc0cd689de94a54e5b7b758869d691”, GitTreeState:“clean”, BuildDate:“2021-09-15T21:04:16Z”, GoVersion:“go1.16.8”, Compiler:“gc”, Platform:“linux/amd64”}

容器运行时
将 docker version / crictl version / nerdctl version 结果贴在下方

Client:

Version: 20.10.12

API version: 1.41

Go version: go1.16.2

Git commit: 20.10.12-0ubuntu2~20.04.1

Built: Wed Apr 6 02:14:38 2022

OS/Arch: linux/amd64

Context: default

Experimental: true

Server:

Engine:

Version: 20.10.12

API version: 1.41 (minimum version 1.12)

Go version: go1.16.2

Git commit: 20.10.12-0ubuntu2~20.04.1

Built: Thu Feb 10 15:03:35 2022

OS/Arch: linux/amd64

Experimental: false

containerd:

Version: 1.5.9-0ubuntu1~20.04.4

GitCommit:

runc:

Version: 1.1.0-0ubuntu1~20.04.1

GitCommit:

docker-init:

Version: 0.19.0

GitCommit:

KubeSphere版本信息
v3.2.1

问题是什么
通过kk增加新节点，总是报错。

09:18:34 CST message: [localhost]

docker is existed

09:18:34 CST success: [LocalHost]

09:18:34 CST [ConfigureOSModule] Prepare to init OS

09:18:35 CST success: [node2]

09:18:35 CST success: [ecs-5b73]

09:18:35 CST [ConfigureOSModule] Generate init os script

09:18:35 CST success: [ecs-5b73]

09:18:35 CST success: [node2]

09:18:35 CST [ConfigureOSModule] Exec init os script

09:18:36 CST stdout: [node2]

net.ipv4.ip_forward = 1

vm.swappiness = 1

net.core.somaxconn = 1024

net.ipv4.tcp_max_tw_buckets = 5000

net.ipv4.tcp_max_syn_backlog = 1024

kernel.unknown_nmi_panic = 1

net.bridge.bridge-nf-call-arptables = 1

net.bridge.bridge-nf-call-ip6tables = 1

net.bridge.bridge-nf-call-iptables = 1

net.ipv4.ip_local_reserved_ports = 30000-32767

vm.max_map_count = 262144

fs.inotify.max_user_instances = 524288

kernel.pid_max = 65535

09:18:39 CST stdout: [ecs-5b73]

net.ipv4.ip_forward = 1

vm.swappiness = 1

net.core.somaxconn = 1024

net.ipv4.tcp_max_tw_buckets = 5000

net.ipv4.tcp_max_syn_backlog = 1024

net.bridge.bridge-nf-call-arptables = 1

net.bridge.bridge-nf-call-ip6tables = 1

net.bridge.bridge-nf-call-iptables = 1

net.ipv4.ip_local_reserved_ports = 30000-32767

vm.max_map_count = 262144

fs.inotify.max_user_instances = 524288

kernel.pid_max = 65535

09:18:39 CST success: [node2]

09:18:39 CST success: [ecs-5b73]

09:18:39 CST [ConfigureOSModule] configure the ntp server for each node

09:18:39 CST skipped: [node2]

09:18:39 CST skipped: [ecs-5b73]

09:18:39 CST [KubernetesStatusModule] Get kubernetes cluster status

09:18:39 CST stdout: [ecs-5b73]

v1.21.5

09:18:39 CST stdout: [ecs-5b73]

The connection to the server lb.kubesphere.local:6443 was refused - did you specify the right host or port?

09:18:39 CST message: [ecs-5b73]

get kubernetes cluster info failed: Failed to exec command: sudo -E /bin/bash -c “/usr/local/bin/kubectl –no-headers=true get nodes -o custom-columns=:metadata.name,:status.nodeInfo.kubeletVersion,:status.addresses”

The connection to the server lb.kubesphere.local:6443 was refused - did you specify the right host or port?: Process exited with status 1

09:18:39 CST retry: [ecs-5b73]

09:18:44 CST stdout: [ecs-5b73]

v1.21.5

09:18:44 CST stdout: [ecs-5b73]

The connection to the server lb.kubesphere.local:6443 was refused - did you specify the right host or port?

09:18:44 CST message: [ecs-5b73]

The connection to the server lb.kubesphere.local:6443 was refused - did you specify the right host or port?: Process exited with status 1

09:18:44 CST retry: [ecs-5b73]

09:18:49 CST stdout: [ecs-5b73]

v1.21.5

09:18:49 CST stdout: [ecs-5b73]

The connection to the server lb.kubesphere.local:6443 was refused - did you specify the right host or port?

09:18:49 CST message: [ecs-5b73]

The connection to the server lb.kubesphere.local:6443 was refused - did you specify the right host or port?: Process exited with status 1

09:18:49 CST failed: [ecs-5b73]

error: Pipeline[AddNodesPipeline] execute failed: Module[KubernetesStatusModule] exec failed:

failed: [ecs-5b73] [GetClusterStatus] exec failed after 3 retires: get kubernetes cluster info failed: Failed to exec command: sudo -E /bin/bash -c “/usr/local/bin/kubectl –no-headers=true get nodes -o custom-columns=:metadata.name,:status.nodeInfo.kubeletVersion,:status.addresses”

The connection to the server lb.kubesphere.local:6443 was refused - did you specify the right host or port?: Process exited with status 1

补充：执行kk命令之前 kubectl 命令正常使用。执行kk add nodes 报错后， kubectl命令短暂无法使用，过一会儿自动恢复。

24sama

bjdaijun
可以贴一下kube-apiserver的日志吗

stealth-y

24sama

我遇见一样的报错这是我的报错日志

W0120 02:59:33.413985 1 feature_gate.go:241] Setting GA feature gate ExpandCSIVolumes=true. It will be removed in a future release.

W0120 02:59:33.414114 1 feature_gate.go:241] Setting GA feature gate CSIStorageCapacity=true. It will be removed in a future release.

I0120 02:59:33.414340 1 server.go:555] external host was not specified, using 192.168.50.66

I0120 02:59:33.417403 1 server.go:163] Version: v1.26.5

I0120 02:59:33.417444 1 server.go:165] “Golang settings” GOGC="“ GOMAXPROCS=”“ GOTRACEBACK=”"

I0120 02:59:34.267734 1 shared_informer.go:270] Waiting for caches to sync for node_authorizer

I0120 02:59:34.269217 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.

I0120 02:59:34.269243 1 plugins.go:161] Loaded 12 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.

W0120 02:59:34.316905 1 genericapiserver.go:660] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.

I0120 02:59:34.317987 1 instance.go:277] Using reconciler: lease

I0120 02:59:34.575773 1 instance.go:621] API group “internal.apiserver.k8s.io” is not enabled, skipping.

I0120 02:59:34.936791 1 instance.go:621] API group “resource.k8s.io” is not enabled, skipping.

W0120 02:59:35.038422 1 genericapiserver.go:660] Skipping API authentication.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.038467 1 genericapiserver.go:660] Skipping API authentication.k8s.io/v1alpha1 because it has no resources.

W0120 02:59:35.040664 1 genericapiserver.go:660] Skipping API authorization.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.045845 1 genericapiserver.go:660] Skipping API autoscaling/v2beta1 because it has no resources.

W0120 02:59:35.045872 1 genericapiserver.go:660] Skipping API autoscaling/v2beta2 because it has no resources.

W0120 02:59:35.049211 1 genericapiserver.go:660] Skipping API batch/v1beta1 because it has no resources.

W0120 02:59:35.051923 1 genericapiserver.go:660] Skipping API certificates.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.054243 1 genericapiserver.go:660] Skipping API coordination.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.054313 1 genericapiserver.go:660] Skipping API discovery.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.059814 1 genericapiserver.go:660] Skipping API networking.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.059842 1 genericapiserver.go:660] Skipping API networking.k8s.io/v1alpha1 because it has no resources.

W0120 02:59:35.061455 1 genericapiserver.go:660] Skipping API node.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.061482 1 genericapiserver.go:660] Skipping API node.k8s.io/v1alpha1 because it has no resources.

W0120 02:59:35.061536 1 genericapiserver.go:660] Skipping API policy/v1beta1 because it has no resources.

W0120 02:59:35.066902 1 genericapiserver.go:660] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.066930 1 genericapiserver.go:660] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.

W0120 02:59:35.068968 1 genericapiserver.go:660] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.068995 1 genericapiserver.go:660] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.

W0120 02:59:35.074645 1 genericapiserver.go:660] Skipping API storage.k8s.io/v1alpha1 because it has no resources.

W0120 02:59:35.079956 1 genericapiserver.go:660] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.079983 1 genericapiserver.go:660] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.

W0120 02:59:35.085591 1 genericapiserver.go:660] Skipping API apps/v1beta2 because it has no resources.

W0120 02:59:35.085619 1 genericapiserver.go:660] Skipping API apps/v1beta1 because it has no resources.

W0120 02:59:35.087656 1 genericapiserver.go:660] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.087682 1 genericapiserver.go:660] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources.

W0120 02:59:35.089855 1 genericapiserver.go:660] Skipping API events.k8s.io/v1beta1 because it has no resources.

W0120 02:59:35.114711 1 genericapiserver.go:660] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.

I0120 02:59:35.979509 1 dynamic_cafile_content.go:157] “Starting controller” name=“request-header::/etc/kubernetes/pki/front-proxy-ca.crt”

I0120 02:59:35.979522 1 dynamic_cafile_content.go:157] “Starting controller” name=“client-ca-bundle::/etc/kubernetes/pki/ca.crt”

I0120 02:59:35.979808 1 dynamic_serving_content.go:132] “Starting controller” name=“serving-cert::/etc/kubernetes/pki/apiserver.crt::/etc/kubernetes/pki/apiserver.key”

I0120 02:59:35.980011 1 secure_serving.go:210] Serving securely on [::]:6443

I0120 02:59:35.980095 1 tlsconfig.go:240] “Starting DynamicServingCertificateController”

I0120 02:59:35.980181 1 controller.go:83] Starting OpenAPI AggregationController

I0120 02:59:35.980266 1 apf_controller.go:361] Starting API Priority and Fairness config controller

I0120 02:59:35.980354 1 controller.go:80] Starting OpenAPI V3 AggregationController

I0120 02:59:35.980426 1 autoregister_controller.go:141] Starting autoregister controller

I0120 02:59:35.980447 1 cache.go:32] Waiting for caches to sync for autoregister controller

I0120 02:59:35.980460 1 gc_controller.go:78] Starting apiserver lease garbage collector

I0120 02:59:35.980493 1 crdregistration_controller.go:111] Starting crd-autoregister controller

I0120 02:59:35.980503 1 shared_informer.go:270] Waiting for caches to sync for crd-autoregister

I0120 02:59:35.980530 1 available_controller.go:423] Starting AvailableConditionController

I0120 02:59:35.980545 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller

I0120 02:59:35.980633 1 dynamic_serving_content.go:132] “Starting controller” name=“aggregator-proxy-cert::/etc/kubernetes/pki/front-proxy-client.crt::/etc/kubernetes/pki/front-proxy-client.key”

I0120 02:59:35.980737 1 apiservice_controller.go:97] Starting APIServiceRegistrationController

I0120 02:59:35.980753 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller

I0120 02:59:35.981238 1 controller.go:121] Starting legacy_token_tracking_controller

I0120 02:59:35.981249 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller

I0120 02:59:35.981264 1 shared_informer.go:270] Waiting for caches to sync for cluster_authentication_trust_controller

I0120 02:59:35.981320 1 dynamic_cafile_content.go:157] “Starting controller” name=“client-ca-bundle::/etc/kubernetes/pki/ca.crt”

I0120 02:59:35.981437 1 dynamic_cafile_content.go:157] “Starting controller” name=“request-header::/etc/kubernetes/pki/front-proxy-ca.crt”

I0120 02:59:35.981253 1 shared_informer.go:270] Waiting for caches to sync for configmaps

I0120 02:59:35.981717 1 customresource_discovery_controller.go:288] Starting DiscoveryController

I0120 02:59:35.981822 1 controller.go:85] Starting OpenAPI controller

I0120 02:59:35.981868 1 establishing_controller.go:76] Starting EstablishingController

I0120 02:59:35.981877 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController

I0120 02:59:35.981912 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController

I0120 02:59:35.981917 1 controller.go:85] Starting OpenAPI V3 controller

I0120 02:59:35.981950 1 crd_finalizer.go:266] Starting CRDFinalizer

I0120 02:59:35.981962 1 naming_controller.go:291] Starting NamingConditionController

I0120 02:59:36.067939 1 shared_informer.go:277] Caches are synced for node_authorizer

I0120 02:59:36.080318 1 apf_controller.go:366] Running API Priority and Fairness config worker

I0120 02:59:36.080351 1 apf_controller.go:369] Running API Priority and Fairness periodic rebalancing process

I0120 02:59:36.080497 1 cache.go:39] Caches are synced for autoregister controller

I0120 02:59:36.080638 1 cache.go:39] Caches are synced for AvailableConditionController controller

I0120 02:59:36.080959 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

I0120 02:59:36.081348 1 shared_informer.go:277] Caches are synced for cluster_authentication_trust_controller

I0120 02:59:36.081557 1 shared_informer.go:277] Caches are synced for configmaps

I0120 02:59:36.137794 1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

I0120 02:59:36.181611 1 shared_informer.go:277] Caches are synced for crd-autoregister

I0120 02:59:36.643275 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).

I0120 02:59:36.984888 1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

I0120 02:59:52.257620 1 controller.go:615] quota admission added evaluator for: serviceaccounts

I0120 02:59:52.280956 1 controller.go:615] quota admission added evaluator for: daemonsets.apps

I0120 03:00:02.009695 1 controller.go:615] quota admission added evaluator for: endpoints

I0120 03:00:09.363730 1 controller.go:615] quota admission added evaluator for: deployments.apps

stealth-y

你好请问你这个问题有解决么，怎么解决的哈