KubeSphere2.1.1安装过程中报3个PVC(mysql-pvc,etcd-pvc和data-redis-ha-server)没有创建
[root@k8sphere01 ]# kubectl describe pvc -n kubesphere-system openldap-pvc-openldap-0
Name: openldap-pvc-openldap-0
Namespace: kubesphere-system
StorageClass: glusterfs
Status: Pending
Volume:
Labels: app.kubernetes.io/instance=ks-openldap
app.kubernetes.io/name=openldap-ha
Annotations: volume.beta.kubernetes.io/storage-provisioner: kubernetes.io/glusterfs
Finalizers: [kubernetes.io/pvc-protection]
Capacity:
Access Modes:
VolumeMode: Filesystem
Mounted By: openldap-0
Events:
Type Reason Age From Message
Warning ProvisioningFailed 67s (x46 over 88m) persistentvolume-controller Failed to provision volume with StorageClass “glusterfs”: failed to create volume: failed to create volume: Failed to allocate new volume: No space
[root@k8sphere01 ]#
[root@k8sphere01 ]# kubectl describe pvc -n kubesphere-system redis-pvc
Name: redis-pvc
Namespace: kubesphere-system
StorageClass: glusterfs
Status: Terminating (lasts 39h)
Volume: pvc-55214db7-abe8-461a-a122-c37674784d4b
Labels: <none>
Annotations: kubectl.kubernetes.io/last-applied-configuration:
{“apiVersion”:“v1″,“kind”:“PersistentVolumeClaim”,“metadata”:{“annotations”:{},“name”:“redis-pvc”,“namespace”:“kubesphere-system”},“spec”:…
pv.kubernetes.io/bind-completed: yes
pv.kubernetes.io/bound-by-controller: yes
volume.beta.kubernetes.io/storage-provisioner: kubernetes.io/glusterfs
Finalizers: [kubernetes.io/pvc-protection]
Capacity: 2Gi
Access Modes: RWO
VolumeMode: Filesystem
Mounted By: redis-6fd6c6d6f9-lfmwp
Events: <none>
[root@k8sphere01 ]#
huanggzeK零SK壹 是这个原因吗?————– Failed to allocate new volume: No space
rayzhou2017K零SK壹S
qcloud 应该是的
rayzhou2017 大佬,我存储空间扩容了,不再有空间满的问题后,再次install.sh,都已经进入到ks-install过程中了,以及出现以下成功界面:
Start installing monitoring
task monitoring status is successful
total: 1 completed:1
#####################################################
Welcome to KubeSphere!
#####################################################
Console: http://192.168.108.52:30880
Account: admin
Password: P@88w0rd
NOTES:
- After logging into the console, please check the
monitoring status of service components in
the “Cluster Status”. If the service is not
ready, please wait patiently. You can start
to use when all components are ready. - Please modify the default password after login.
#####################################################
但还是存在pvc的几个报错,如下:
TASK [common : Kubesphere | Check mysql PersistentVolumeClaim] *****************
fatal: [localhost]: FAILED! => {“changed”: true, “cmd”: “/usr/local/bin/kubectl get pvc -n kubesphere-system mysql-pvc -o jsonpath=‘{.status.capacity.storage}’\n”, “delta”: “0:00:00.575182″, “end”: “2020-05-13 09:31:09.169599”, “msg”: “non-zero return code”, “rc”: 1, “start”: “2020-05-13 09:31:08.594417”, “stderr”: "Error from server (NotFound): persistentvolumeclaims \“mysql-pvc\” not found", “stderr_lines”: ["Error from server (NotFound): persistentvolumeclaims \“mysql-pvc\” not found"], “stdout”: "", “stdout_lines”: []}
…ignoring
TASK [common : Kubesphere | Setting mysql db pv size] **************************
skipping: [localhost]
TASK [common : Kubesphere | Check redis PersistentVolumeClaim] *****************
changed: [localhost]
TASK [common : Kubesphere | Setting redis db pv size] **************************
ok: [localhost]
TASK [common : Kubesphere | Check minio PersistentVolumeClaim] *****************
fatal: [localhost]: FAILED! => {“changed”: true, “cmd”: “/usr/local/bin/kubectl get pvc -n kubesphere-system minio -o jsonpath=‘{.status.capacity.storage}’\n”, “delta”: “0:00:00.589378″, “end”: “2020-05-13 09:31:10.802323”, “msg”: “non-zero return code”, “rc”: 1, “start”: “2020-05-13 09:31:10.212945”, “stderr”: "Error from server (NotFound): persistentvolumeclaims \“minio\” not found", “stderr_lines”: ["Error from server (NotFound): persistentvolumeclaims \“minio\” not found"], “stdout”: "", “stdout_lines”: []}
…ignoring
TASK [common : Kubesphere | Setting minio pv size] *****************************
skipping: [localhost]
TASK [common : Kubesphere | Check openldap PersistentVolumeClaim] **************
changed: [localhost]
TASK [common : Kubesphere | Setting openldap pv size] **************************
ok: [localhost]
TASK [common : Kubesphere | Check etcd db PersistentVolumeClaim] ***************
fatal: [localhost]: FAILED! => {“changed”: true, “cmd”: “/usr/local/bin/kubectl get pvc -n kubesphere-system etcd-pvc -o jsonpath=‘{.status.capacity.storage}’\n”, “delta”: “0:00:00.565141”, “end”: “2020-05-13 09:31:12.423824”, “msg”: “non-zero return code”, “rc”: 1, “start”: “2020-05-13 09:31:11.858683”, “stderr”: "Error from server (NotFound): persistentvolumeclaims \“etcd-pvc\” not found", “stderr_lines”: ["Error from server (NotFound): persistentvolumeclaims \“etcd-pvc\” not found"], “stdout”: "", “stdout_lines”: []}
…ignoring
TASK [common : Kubesphere | Setting etcd pv size] ******************************
skipping: [localhost]
TASK [common : Kubesphere | Check redis ha PersistentVolumeClaim] **************
fatal: [localhost]: FAILED! => {“changed”: true, “cmd”: “/usr/local/bin/kubectl get pvc -n kubesphere-system data-redis-ha-server-0 -o jsonpath=‘{.status.capacity.storage}’\n”, “delta”: “0:00:00.573883”, “end”: “2020-05-13 09:31:13.234416”, “msg”: “non-zero return code”, “rc”: 1, “start”: “2020-05-13 09:31:12.660533”, “stderr”: "Error from server (NotFound): persistentvolumeclaims \“data-redis-ha-server-0\” not found", “stderr_lines”: ["Error from server (NotFound): persistentvolumeclaims \“data-redis-ha-server-0\” not found"], “stdout”: "", “stdout_lines”: []}
…ignoring
这几个pvc能否通过手工的方式来创建? 还是有其它方法能解决?
CauchyK零SK壹S
…ignoring的不用管
看下kubesphere-system下的pod状态
Cauchy
[root@k8sphere01 conf]# kubectl get pod -n kubesphere-system
NAME READY STATUS RESTARTS AGE
ks-account-596657f8c6-292zp 0/1 Init:0/2 0 5h35m
ks-account-6ddfd5bfcb-cnczz 0/1 Init:0/2 0 129m
ks-apigateway-9d446b8b8-wx9xw 0/1 CrashLoopBackOff 29 129m
ks-apiserver-7c4c4b49bc-m8tjv 1/1 Running 0 129m
ks-console-58fd4c4b9c-psbmr 1/1 Running 0 129m
ks-controller-manager-66f5d7d546-vbp6b 1/1 Running 0 129m
ks-installer-7d9fb945c7-v25pm 1/1 Running 165 2d
openldap-0 0/1 ContainerCreating 0 3d2h
redis-6fd6c6d6f9-lfmwp 0/1 ContainerCreating 1 3d2h
[root@k8sphere01 conf]#
如果ignoring的错误不用管的话,那就是安装成功了,可访问控制台报以下错误:
可访问控制端:http://192.168.108.72:30880/login
报以下错误:Internal Server Error
WwanjunleiK零S
还是pvc的问题,你的pvc创建失败了,控制台相关的pod都没启动, 这个应该是gfs的问题,你看看gfs的日志
CauchyK零SK壹S
用的什么存储?
VvincentgaoK零S
我自己搭建的nfs集群,不知道为什么mysql etcd redis的pvc都创建不出来,然后监控的两个pvc可以创建
VvincentgaoK零S
[root@online-aliyun-cn-shenzhen-c-vm-10041 cert]# ll /nfs/k8s/data/
total 32
drwxrwxrwx 5 root root 4096 May 15 13:51 ./
drwxr-xr-x 3 root root 4096 May 13 18:32 ../
drwxrwxrwx 3 root root 4096 May 15 13:51 kubesphere-monitoring-system-prometheus-k8s-db-prometheus-k8s-0-pvc-c277b5aa-6098-4d67-b22f-e9d0a2e8b355/
drwxrwxrwx 3 root root 4096 May 15 13:51 kubesphere-monitoring-system-prometheus-k8s-system-db-prometheus-k8s-system-0-pvc-11c1bbba-cdc1-4a9b-91c3-373df8c9646e/
drwx------ 2 root root 16384 May 13 18:14 lost+found/
这些就创建不了,导致安装失败
`TASK [common : include_tasks] **************************************************
skipping: [localhost] => (item={u’ks’: u’mysql-pvc’, u’op’: u’openpitrix-db’})
skipping: [localhost] => (item={u’ks’: u’etcd-pvc’, u’op’: u’openpitrix-etcd’})
TASK [common : Getting PersistentVolumeName (mysql)] ***************************
skipping: [localhost]
TASK [common : Getting PersistentVolumeSize (mysql)] ***************************
skipping: [localhost]
TASK [common : Setting PersistentVolumeName (mysql)] ***************************
skipping: [localhost]
TASK [common : Setting PersistentVolumeSize (mysql)] ***************************
skipping: [localhost]
TASK [common : Getting PersistentVolumeName (etcd)] ****************************
skipping: [localhost]
TASK [common : Getting PersistentVolumeSize (etcd)] ****************************
skipping: [localhost]
TASK [common : Setting PersistentVolumeName (etcd)] ****************************
skipping: [localhost]
TASK [common : Setting PersistentVolumeSize (etcd)] ****************************
skipping: [localhost]
TASK [common : Kubesphere | Check mysql PersistentVolumeClaim] *****************
fatal: [localhost]: FAILED! => {“changed”: true, “cmd”: “/usr/local/bin/kubectl get pvc -n kubesphere-system mysql-pvc -o jsonpath=‘{.status.capacity.storage}’\n”, “delta”: “0:00:00.409147″, “end”: “2020-05-15 05:50:27.114121″, “msg”: “non-zero return code”, “rc”: 1, “start”: “2020-05-15 05:50:26.704974”, “stderr”: "Error from server (NotFound): persistentvolumeclaims \“mysql-pvc\” not found", “stderr_lines”: ["Error from server (NotFound): persistentvolumeclaims \“mysql-pvc\” not found"], “stdout”: "", “stdout_lines”: []}
…ignoring
TASK [common : Kubesphere | Setting mysql db pv size] **************************
skipping: [localhost]
TASK [common : Kubesphere | Check redis PersistentVolumeClaim] *****************
fatal: [localhost]: FAILED! => {“changed”: true, “cmd”: “/usr/local/bin/kubectl get pvc -n kubesphere-system redis-pvc -o jsonpath=‘{.status.capacity.storage}’\n”, “delta”: “0:00:00.420811″, “end”: “2020-05-15 05:50:27.734230”, “msg”: “non-zero return code”, “rc”: 1, “start”: “2020-05-15 05:50:27.313419”, “stderr”: "Error from server (NotFound): persistentvolumeclaims \“redis-pvc\” not found", “stderr_lines”: ["Error from server (NotFound): persistentvolumeclaims \“redis-pvc\” not found"], “stdout”: "", “stdout_lines”: []}
…ignoring
TASK [common : Kubesphere | Setting redis db pv size] **************************
skipping: [localhost]
TASK [common : Kubesphere | Check minio PersistentVolumeClaim] *****************
fatal: [localhost]: FAILED! => {“changed”: true, “cmd”: “/usr/local/bin/kubectl get pvc -n kubesphere-system minio -o jsonpath=‘{.status.capacity.storage}’\n”, “delta”: “0:00:00.456821″, “end”: “2020-05-15 05:50:28.398121″, “msg”: “non-zero return code”, “rc”: 1, “start”: “2020-05-15 05:50:27.941300″, “stderr”: "Error from server (NotFound): persistentvolumeclaims \“minio\” not found", “stderr_lines”: ["Error from server (NotFound): persistentvolumeclaims \“minio\” not found"], “stdout”: "", “stdout_lines”: []}
…ignoring
TASK [common : Kubesphere | Setting minio pv size] *****************************
skipping: [localhost]`
这是我的默认存储
[root@online-aliyun-cn-shenzhen-c-vm-10041 ]# kubectl get sc
NAME PROVISIONER AGE
nfs-storage-master01 (default) nfs-storage-master01 37h
vincentgao 大佬解决这个问题了吗,我的也是这样
moyeeK零S
同样是 redis-ha redis-pvc 没有创建,
有没有redis-ha.yaml 了? 手动创建也行啊?