ks 2.1.0升级2.1.1版本失败

rysinal

通过查看ks-install err日志：

TASK [common : Kubesphere | Deploying common component] ************************
failed: [localhost] (item=mysql.yaml) => {"ansible_loop_var": "item", "changed": true, "cmd": "/usr/local/bin/kubectl -n kubesphere-system apply -f /etc/kubesphere/common/mysql.yaml\n", "delta": "0:00:00.846942", "end": "2020-04-19 17:03:20.734303", "failed_when_result": true, "item": "mysql.yaml", "msg": "non-zero return code", "rc": 1, "start": "2020-04-19 17:03:19.887361", "stderr": "The PersistentVolumeClaim \"mysql-pvc\" is invalid: spec.resources.requests.storage: Forbidden: field can not be less than previous value", "stderr_lines": ["The PersistentVolumeClaim \"mysql-pvc\" is invalid: spec.resources.requests.storage: Forbidden: field can not be less than previous value"], "stdout": "service/mysql unchanged\ndeployment.apps/mysql unchanged", "stdout_lines": ["service/mysql unchanged", "deployment.apps/mysql unchanged"]}

mysql-pvc是通过ks界面扩容过到60G，不知道是否有关系。
1、尝试在安装配置把common.yaml里mysql_volume_size的存储为60G重新执行升级操作也报同样的err
mysql_volume_size: 60Gi

2、也通过kubectl edit pvc mysql-pvc -n kubesphere-system 修改capacity.storage=60G 保存退出，但是回头再edit看还是20G？是有限制修改吗？

# Please edit the object below. Lines beginning with a '#' will be ignored,
# and an empty file will abort the edit. If an error occurs while saving this file will be
# reopened with the relevant failures.
#
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: |
      {"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"labels":{"app":"kubesphere","tier":"db"},"name":"mysql-pvc","namespace":"kubesphere-system"},"spec":{"accessModes":["ReadWriteOnce"],"resources":{"requests":{"storage":"30Gi"}},"storageClassName":"nfs-client"}}
    pv.kubernetes.io/bind-completed: "yes"
    pv.kubernetes.io/bound-by-controller: "yes"
    volume.beta.kubernetes.io/storage-provisioner: cluster.local/nfs-client-nfs-client-provisioner
  creationTimestamp: "2020-01-08T08:00:18Z"
  finalizers:
  - kubernetes.io/pvc-protection
  labels:
    app: kubesphere
    tier: db
  name: mysql-pvc
  namespace: kubesphere-system
  resourceVersion: "31122181"
  selfLink: /api/v1/namespaces/kubesphere-system/persistentvolumeclaims/mysql-pvc
  uid: 8470073d-d3ae-4e3d-8b07-819c388b2f2f
spec:
  accessModes:
  - ReadWriteOnce
  resources:
    requests:
      storage: 60Gi
  storageClassName: nfs-client
  volumeMode: Filesystem
  volumeName: pvc-8470073d-d3ae-4e3d-8b07-819c388b2f2f
status:
  accessModes:
  - ReadWriteOnce
  capacity:
    storage: 20Gi
  phase: Bound

Forest-L

rysinal
invalid: spec.resources.requests.storage: Forbidden: field can not be less than previous value。这是你贴的报错日志里面消息。
此mysql服务是给KubeSphere服务提供，20G就可以了，也不需要改变他的值。

rysinal

Forest-L 可是现在已经无法降低其大小了，升也没有反应，请问是需要删掉pv么

Forest-L

statuus下面20G没有改吧 status:
accessModes:

ReadWriteOnce
capacity:
storage: 20Gi
phase: Bound

rysinal

Forest-L
2、也通过kubectl edit pvc mysql-pvc -n kubesphere-system 修改capacity.storage=60G 保存退出，但是回头再edit看还是20G？是有限制修改吗？

这个就是改不起，每次edit都会还原，我觉得应该不是这个位置。。。

Forest-L

rysinal
目前nfs不支持扩容，在界面上修改的只是请求值，容量不会改变。看具体的日志如下：

如果common.yaml中设置的值为20Gi报上面的错是吗？

rysinal

Forest-L Forest-L install吗，我没见过上面的错误，第一遍升级默认配置的是20G，报错内容也是：

 failed: [localhost] (item=mysql.yaml) => {"ansible_loop_var": "item", "changed": true, "cmd": "/usr/local/bin/kubectl -n kubesphere-system apply -f /etc/kubesphere/common/mysql.yaml\n", "delta": "0:00:00.846942", "end": "2020-04-19 17:03:20.734303", "failed_when_result": true, "item": "mysql.yaml", "msg": "non-zero return code", "rc": 1, "start": "2020-04-19 17:03:19.887361", "stderr": "The PersistentVolumeClaim \"mysql-pvc\" is invalid: spec.resources.requests.storage: Forbidden: field can not be less than previous value", "stderr_lines": ["The PersistentVolumeClaim \"mysql-pvc\" is invalid: spec.resources.requests.storage: Forbidden: field can not be less than previous value"], "stdout": "service/mysql unchanged\ndeployment.apps/mysql unchanged", "stdout_lines": ["service/mysql unchanged", "deployment.apps/mysql unchanged"]}

这个pvc 我在管理界面手动执行过扩容操作，我觉得可能是这个手动执行的可视化操作出问题了。现在主要是卡在升级了，有没有办法跳过？

Forest-L

rysinal
这边测试了，有以下解决方法, 可以恢复之前得容量值，可以先模拟部署一个应用来验证再操作。
1、通过edit将对应得pv中策略delete改成Retain， pv中claimRef域下得uid值删掉。
2、通过scale将对应得workload的复本为0。
3、通过kubectl get pvc -n ns -o yaml > mysql.yaml指令保存mysql的pvc文件。
4、通过kubectl delete pvc指令删除需要修改的pvc。
5、打开上面重定向的文件，修改其中的requests.storage值为原来的值，把annotations下的内容全删掉，creationTimestamp、resourceVersion、selfLink、uid和status下所有的内容都删掉。
6、kubectl create -f mysql.yaml 指令创建pvc，看是否bound。
7、scale workload的复本为实际复本上。

rysinal

Forest-L 大佬按照流程出现了新的错误。

1、生成mysql.yaml

apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  finalizers:
  - kubernetes.io/pvc-protection
  labels:
    app: kubesphere
    tier: db
  name: mysql-pvc
  namespace: kubesphere-system
spec:
  accessModes:
  - ReadWriteOnce
  resources:
    requests:
      storage: 20Gi
  storageClassName: nfs-client
  volumeMode: Filesystem
  volumeName: pvc-8470073d-d3ae-4e3d-8b07-819c388b2f2f

2、删除旧的，部署新的mysql-pvc

kubectl apply  -f mysql.yaml
#这里发现新apply的mysql-pvc都变成60G了,是否需要删掉volumeName选项呢
kubectl get pvc -n kubesphere-system
mysql-pvc                 Bound    pvc-8470073d-d3ae-4e3d-8b07-819c388b2f2f   60Gi       RWO            nfs-client     18m

3、重启ks-installer

...
logs
...
TASK [common : Kubesphere | Deploying common component] ************************
failed: [localhost] (item=mysql.yaml) => {"ansible_loop_var": "item", "changed": true, "cmd": "/usr/local/bin/kubectl -n kubesphere-system apply -f /etc/kubesphere/common/mysql.yaml\n", "delta": "0:00:00.862893", "end": "2020-04-21 10:02:17.682972", "failed_when_result": true, "item": "mysql.yaml", "rc": 0, "start": "2020-04-21 10:02:16.820079", "stderr": "Warning: kubectlapply should be used on resource created by either kubectl create --save-config or kubectl apply", "stderr_lines": ["Warning: kubectl apply should be used on resource created by either kubectl create --save-config or kubectl apply"], "stdout": "service/mysql unchanged\npersistentvolumeclaim/mysql-pvc configured\ndeployment.apps/mysql unchanged", "stdout_lines": ["service/mysql unchanged", "persistentvolumeclaim/mysql-pvc configured", "deployment.apps/mysql unchanged"]}

PLAY RECAP *********************************************************************
localhost                  : ok=34   changed=24   unreachable=0    failed=1    skipped=78   rescued=0    ignored=1

可否远程支持一下，感谢

Forest-L

rysinal 向日葵或者tv12呗应该不会是60G呢

rysinal

Forest-L 好的，邮箱留一下呢