在部署完成后服务挺正常,界面也可访问,但是在网页上偶尔刷新的时候会出现internal server error异常提示:

ks-console的日志如下

![#################################################################################################################################################################################################################################
#################################################################################################################################################################################################################################
{ Error: socket hang up
    at createHangUpError (_http_client.js:323:15)
    at Socket.socketOnEnd (_http_client.js:426:23)
    at Socket.emit (events.js:203:15)
    at endReadableNT (_stream_readable.js:1145:12)
    at process._tickCallback (internal/process/next_tick.js:63:19) code: 'ECONNRESET' }
  --> GET /kapis/clusters/host/resources.kubesphere.io/v1alpha3/nodes?labelSelector=node-role.kubernetes.io%2Fmaster%3D 500 255ms - 2021/03/17T10:39:44.018
{ Error: socket hang up
    at createHangUpError (_http_client.js:323:15)
    at Socket.socketOnEnd (_http_client.js:426:23)
    at Socket.emit (events.js:203:15)
    at endReadableNT (_stream_readable.js:1145:12)
    at process._tickCallback (internal/process/next_tick.js:63:19) code: 'ECONNRESET' }
  --> GET /kapis/clusters/host/resources.kubesphere.io/v1alpha3/nodes?sortBy=createTime&limit=10 500 258ms - 2021/03/17T10:39:44.019
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:39:44.628
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:39:46.662
{ Error: connect ECONNREFUSED 10.106.64.89:80
    at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1107:14)
  errno: 'ECONNREFUSED',
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '10.106.64.89',
  port: 80 }
  --> GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 503 4ms - 2021/03/17T10:39:46.666
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:39:48.745
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/cluster?metrics_filter=cluster_cpu_usage%7Ccluster_cpu_total%7Ccluster_cpu_utilisation%7Ccluster_memory_usage_wo_cache%7Ccluster_memory_total%7Ccluster_memory_utilisation%7Ccluster_disk_size_usage%7Ccluster_disk_size_capacity%7Ccluster_disk_size_utilisation%7Ccluster_pod_running_count%7Ccluster_pod_quota%24 2021/03/17T10:39:49.813
  <-- GET / 2021/03/17T10:39:50.608
{ UnauthorizedError: Not Login
    at Object.throw (/opt/kubesphere/console/server/server.js:32979:11)
    at getCurrentUser (/opt/kubesphere/console/server/server.js:9194:14)
    at renderView (/opt/kubesphere/console/server/server.js:24415:46)
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:73168:16
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:81225:37
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:73168:16
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:81225:37
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32) message: 'Not Login' }
  --> GET / 302 2ms 43b 2021/03/17T10:39:50.610
  <-- GET /login 2021/03/17T10:39:50.611
  --> GET /login 200 6ms 15.63kb 2021/03/17T10:39:50.617
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:39:50.823
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/components/apiserver?metrics_filter=apiserver_request_latencies%7Capiserver_request_by_verb_latencies%7Capiserver_request_rate%24 2021/03/17T10:39:50.967
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/components/scheduler?metrics_filter=scheduler_schedule_attempts%7Cscheduler_schedule_attempt_rate%24 2021/03/17T10:39:50.989
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:39:52.872
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:39:54.937
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:39:56.989
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:39:59.045
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/cluster?metrics_filter=cluster_cpu_usage%7Ccluster_cpu_total%7Ccluster_cpu_utilisation%7Ccluster_memory_usage_wo_cache%7Ccluster_memory_total%7Ccluster_memory_utilisation%7Ccluster_disk_size_usage%7Ccluster_disk_size_capacity%7Ccluster_disk_size_utilisation%7Ccluster_pod_running_count%7Ccluster_pod_quota%24 2021/03/17T10:39:59.818
  <-- GET / 2021/03/17T10:40:00.608
{ UnauthorizedError: Not Login
    at Object.throw (/opt/kubesphere/console/server/server.js:32979:11)
    at getCurrentUser (/opt/kubesphere/console/server/server.js:9194:14)
    at renderView (/opt/kubesphere/console/server/server.js:24415:46)
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:73168:16
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:81225:37
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:73168:16
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:81225:37
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32) message: 'Not Login' }
  --> GET / 302 2ms 43b 2021/03/17T10:40:00.610
  <-- GET /login 2021/03/17T10:40:00.611
  --> GET /login 200 7ms 15.63kb 2021/03/17T10:40:00.618
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/components/apiserver?metrics_filter=apiserver_request_latencies%7Capiserver_request_by_verb_latencies%7Capiserver_request_rate%24 2021/03/17T10:40:00.973
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/components/scheduler?metrics_filter=scheduler_schedule_attempts%7Cscheduler_schedule_attempt_rate%24 2021/03/17T10:40:01.075
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:01.116
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:03.157
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:05.204
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:07.255
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:09.310
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/cluster?metrics_filter=cluster_cpu_usage%7Ccluster_cpu_total%7Ccluster_cpu_utilisation%7Ccluster_memory_usage_wo_cache%7Ccluster_memory_total%7Ccluster_memory_utilisation%7Ccluster_disk_size_usage%7Ccluster_disk_size_capacity%7Ccluster_disk_size_utilisation%7Ccluster_pod_running_count%7Ccluster_pod_quota%24 2021/03/17T10:40:09.817
  <-- GET / 2021/03/17T10:40:10.609
{ UnauthorizedError: Not Login
    at Object.throw (/opt/kubesphere/console/server/server.js:32979:11)
    at getCurrentUser (/opt/kubesphere/console/server/server.js:9194:14)
    at renderView (/opt/kubesphere/console/server/server.js:24415:46)
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:73168:16
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:81225:37
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:73168:16
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32)
    at next (/opt/kubesphere/console/server/server.js:73977:18)
    at /opt/kubesphere/console/server/server.js:81225:37
    at dispatch (/opt/kubesphere/console/server/server.js:73976:32) message: 'Not Login' }
  --> GET / 302 3ms 43b 2021/03/17T10:40:10.611
  <-- GET /login 2021/03/17T10:40:10.612
  --> GET /login 200 8ms 15.63kb 2021/03/17T10:40:10.620
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/components/apiserver?metrics_filter=apiserver_request_latencies%7Capiserver_request_by_verb_latencies%7Capiserver_request_rate%24 2021/03/17T10:40:10.979
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/components/scheduler?metrics_filter=scheduler_schedule_attempts%7Cscheduler_schedule_attempt_rate%24 2021/03/17T10:40:11.079
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:11.361
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:13.487
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:15.540
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:17.578
  <-- GET /kapis/clusters/host/resources.kubesphere.io/v1alpha2/componenthealth 2021/03/17T10:40:19.706
  <-- GET /kapis/clusters/host/monitoring.kubesphere.io/v1alpha3/cluster?metrics_filter=cluster_cpu_usage%7Ccluster_cpu_total%7Ccluster_cpu_utilisation%7Ccluster_memory_usage_wo_cache%7Ccluster_memory_total%7Ccluster_memory_utilisation%7Ccluster_disk_size_usage%7Ccluster_disk_size_capacity%7Ccluster_disk_size_utilisation%7Ccluster_pod_running_count%7Ccluster_pod_quota%24 2021/03/17T10:40:19.818
  <-- GET / 2021/03/17T10:40:20.608


大部分时候的刷新很正常,会无规律的出现。
应该不是时间同步的问题,能否帮忙定位可能是什么原因导致的?

    Phoaster-wry 可以分享一下console和apiserver的镜像版本以及更新策略吗?以及检查下kubele和docker服务是否稳定呢?

      zhu733756 版本是ks3.0.0版本,docker和k8s运行挺正常的,很怪异,因为绝大数时候访问正常,偶尔出现,但是重新刷新网页又能正常使用。

      W0319 08:30:47.567095 1 client_config.go:543] Neither –kubeconfig nor –master was specified. Using the inClusterConfig. This might not work.
      I0319 08:30:47.600129 1 apiserver.go:300] Start cache objects
      W0319 08:30:48.366654 1 apiserver.go:433] resource types.kubefed.io/v1beta1, Resource=federatedresourcequotas not exists in the cluster
      W0319 08:30:48.867418 1 apiserver.go:473] resource snapshot.storage.k8s.io/v1beta1, Resource=volumesnapshotclasses not exists in the cluster
      W0319 08:30:48.867465 1 apiserver.go:473] resource snapshot.storage.k8s.io/v1beta1, Resource=volumesnapshots not exists in the cluster
      W0319 08:30:48.867482 1 apiserver.go:473] resource snapshot.storage.k8s.io/v1beta1, Resource=volumesnapshotcontents not exists in the cluster
      I0319 08:30:49.167704 1 apiserver.go:502] Finished caching objects
      I0319 08:30:49.167747 1 apiserver.go:232] Start listening on :9090
      fatal error: bad map state

      goroutine 1743 [running]:
      runtime.throw(0×29ffdbc, 0xd)
      /usr/local/go/src/runtime/panic.go:774 +0×54 fp=0×400371e420 sp=0×400371e3f0 pc=0×3ded4
      runtime.evacuate_faststr(0×24a76c0, 0×4002298ed0, 0×0)
      /usr/local/go/src/runtime/map_faststr.go:426 +0×3ac fp=0×400371e4d0 sp=0×400371e420 pc=0×2289c
      runtime.growWork_faststr(0×24a76c0, 0×4002298ed0, 0×0)
      /usr/local/go/src/runtime/map_faststr.go:385 +0×64 fp=0×400371e500 sp=0×400371e4d0 pc=0×224a4
      runtime.mapassign_faststr(0×24a76c0, 0×4002298ed0, 0×2a339fd, 0×20, 0×400174a328)
      /usr/local/go/src/runtime/map_faststr.go:226 +0×340 fp=0×400371e570 sp=0×400371e500 pc=0×21ff0
      kubesphere.io/kubesphere/pkg/models/resources/v1alpha3/node.nodesGetter.annotateNode(0×312fa20, 0×40006e0eb0, 0×40017311a0, 0×40020f8000, 0×39, 0×40)
      /go/src/kubesphere.io/kubesphere/pkg/models/resources/v1alpha3/node/nodes.go:180 +0×510 fp=0×400371eaf0 sp=0×400371e570 pc=0×11c0210
      kubesphere.io/kubesphere/pkg/models/resources/v1alpha3/node.nodesGetter.List(0×312fa20, 0×40006e0eb0, 0×0, 0×0, 0×400223c180, 0×7030004, 0×4, 0xffffffffffffffff)
      /go/src/kubesphere.io/kubesphere/pkg/models/resources/v1alpha3/node/nodes.go:120 +0×604 fp=0×400371ec90 sp=0×400371eaf0 pc=0×11bf884
      kubesphere.io/kubesphere/pkg/models/resources/v1alpha3/node.(nodesGetter).List(0×40003f13d0, 0×0, 0×0, 0×400223c180, 0×40003f13d0, 0×8000101, 0×4002254368)
      <autogenerated>:1 +0×58 fp=0×400371ece0 sp=0×400371ec90 pc=0×11c1af8
      kubesphere.io/kubesphere/pkg/models/resources/v1alpha3/resource.(
      ResourceGetter).List(0×400000e498, 0×40030042f8, 0×5, 0×0, 0×0, 0×400223c180, 0xc, 0×4000503d40, 0×400371ee38)
      /go/src/kubesphere.io/kubesphere/pkg/models/resources/v1alpha3/resource/resource.go:155 +0×68 fp=0×400371ed30 sp=0×400371ece0 pc=0×11cd888
      kubesphere.io/kubesphere/pkg/kapis/resources/v1alpha3.(Handler).handleListResources(0×40001abd00, 0×40022526f0, 0×40008072d0)
      /go/src/kubesphere.io/kubesphere/pkg/kapis/resources/v1alpha3/handler.go:83 +0xf0 fp=0×400371ee00 sp=0×400371ed30 pc=0×2016f00
      kubesphere.io/kubesphere/pkg/kapis/resources/v1alpha3.(
      Handler).handleListResources-fm(0×40022526f0, 0×40008072d0)
      /go/src/kubesphere.io/kubesphere/pkg/kapis/resources/v1alpha3/handler.go:78 +0×38 fp=0×400371ee30 sp=0×400371ee00 pc=0×201be08
      github.com/emicklei/go-restful.(Container).dispatch.func5(0×40022526f0, 0×40008072d0)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/emicklei/go-restful/container.go:283 +0×40 fp=0×400371ee50 sp=0×400371ee30 pc=0×3c4d10
      github.com/emicklei/go-restful.(
      FilterChain).ProcessFilter(0×4002252780, 0×40022526f0, 0×40008072d0)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/emicklei/go-restful/filter.go:21 +0×90 fp=0×400371ee80 sp=0×400371ee50 pc=0×3babe0
      kubesphere.io/kubesphere/pkg/apiserver.logRequestAndResponse(0×40022526f0, 0×40008072d0, 0×4002252780)
      /go/src/kubesphere.io/kubesphere/pkg/apiserver/apiserver.go:531 +0×5c fp=0×400371f100 sp=0×400371ee80 pc=0×212cb4c
      github.com/emicklei/go-restful.(FilterChain).ProcessFilter(0×4002252780, 0×40022526f0, 0×40008072d0)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/emicklei/go-restful/filter.go:19 +0×68 fp=0×400371f130 sp=0×400371f100 pc=0×3babb8
      github.com/emicklei/go-restful.(
      Container).dispatch(0×40007159e0, 0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/emicklei/go-restful/container.go:285 +0×6a0 fp=0×400371f310 sp=0×400371f130 pc=0×3b7d50
      github.com/emicklei/go-restful.(Container).dispatch-fm(0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/emicklei/go-restful/container.go:203 +0×40 fp=0×400371f340 sp=0×400371f310 pc=0×3c6280
      net/http.HandlerFunc.ServeHTTP(0×40003f1bc0, 0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /usr/local/go/src/net/http/server.go:2036 +0×40 fp=0×400371f370 sp=0×400371f340 pc=0×29ce90
      net/http.(
      ServeMux).ServeHTTP(0×4000503a00, 0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /usr/local/go/src/net/http/server.go:2416 +0×1a4 fp=0×400371f3d0 sp=0×400371f370 pc=0×29e8d4
      github.com/emicklei/go-restful.(Container).ServeHTTP(0×40007159e0, 0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/emicklei/go-restful/container.go:303 +0×44 fp=0×400371f400 sp=0×400371f3d0 pc=0×3b80e4
      kubesphere.io/kubesphere/pkg/apiserver/filters.WithKubeAPIServer.func1(0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /go/src/kubesphere.io/kubesphere/pkg/apiserver/filters/kubeapiserver.go:71 +0×31c fp=0×400371f540 sp=0×400371f400 pc=0×1ce8f5c
      net/http.HandlerFunc.ServeHTTP(0×40004ba8c0, 0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /usr/local/go/src/net/http/server.go:2036 +0×40 fp=0×400371f570 sp=0×400371f540 pc=0×29ce90
      kubesphere.io/kubesphere/pkg/apiserver/filters.WithAuthorization.func1(0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /go/src/kubesphere.io/kubesphere/pkg/apiserver/filters/authorization.go:50 +0×27c fp=0×400371f670 sp=0×400371f570 pc=0×1ce8a3c
      net/http.HandlerFunc.ServeHTTP(0×40004ba940, 0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /usr/local/go/src/net/http/server.go:2036 +0×40 fp=0×400371f6a0 sp=0×400371f670 pc=0×29ce90
      kubesphere.io/kubesphere/pkg/apiserver/dispatch.(
      clusterDispatch).Dispatch(0×40004baa00, 0×30bdde0, 0×4001be2b60, 0×40001c9300, 0×3058400, 0×40004ba940)
      /go/src/kubesphere.io/kubesphere/pkg/apiserver/dispatch/dispatch.go:117 +0×2f8 fp=0×400371f830 sp=0×400371f6a0 pc=0×1ce52b8
      kubesphere.io/kubesphere/pkg/apiserver/filters.WithMultipleClusterDispatcher.func1(0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /go/src/kubesphere.io/kubesphere/pkg/apiserver/filters/dispatch.go:45 +0×108 fp=0×400371f8a0 sp=0×400371f830 pc=0×1ce8bb8
      net/http.HandlerFunc.ServeHTTP(0×4000911980, 0×30bdde0, 0×4001be2b60, 0×40001c9300)
      /usr/local/go/src/net/http/server.go:2036 +0×40 fp=0×400371f8d0 sp=0×400371f8a0 pc=0×29ce90
      kubesphere.io/kubesphere/pkg/apiserver/filters.WithAuthentication.func1(0×30bdde0, 0×4001be2b60, 0×4002af1500)
      /go/src/kubesphere.io/kubesphere/pkg/apiserver/filters/authentication.go:95 +0×948 fp=0×400371fab0 sp=0×400371f8d0 pc=0×1ce85b8
      net/http.HandlerFunc.ServeHTTP(0×40001ca6e0, 0×30bdde0, 0×4001be2b60, 0×4002af1500)
      /usr/local/go/src/net/http/server.go:2036 +0×40 fp=0×400371fae0 sp=0×400371fab0 pc=0×29ce90
      kubesphere.io/kubesphere/pkg/apiserver/filters.WithRequestInfo.func1(0×30bdde0, 0×4001be2b60, 0×4002af1400)
      /go/src/kubesphere.io/kubesphere/pkg/apiserver/filters/requestinfo.go:67 +0×31c fp=0×400371fbe0 sp=0×400371fae0 pc=0×1ce938c
      net/http.HandlerFunc.ServeHTTP(0×40002448d0, 0×30bdde0, 0×4001be2b60, 0×4002af1400)
      /usr/local/go/src/net/http/server.go:2036 +0×40 fp=0×400371fc10 sp=0×400371fbe0 pc=0×29ce90
      net/http.serverHandler.ServeHTTP(0×40009de0e0, 0×30bdde0, 0×4001be2b60, 0×4002af1400)
      /usr/local/go/src/net/http/server.go:2831 +0xc0 fp=0×400371fc40 sp=0×400371fc10 pc=0×29fba0
      net/http.(conn).serve(0×4000912b40, 0×30d09e0, 0×400349bb40)
      /usr/local/go/src/net/http/server.go:1919 +0×714 fp=0×400371ffc0 sp=0×400371fc40 pc=0×29be64
      runtime.goexit()
      /usr/local/go/src/runtime/asm_arm64.s:1128 +0×4 fp=0×400371ffc0 sp=0×400371ffc0 pc=0×6a594
      created by net/http.(
      Server).Serve
      /usr/local/go/src/net/http/server.go:2957 +0×2ec

      goroutine 1 [IO wait]:
      internal/poll.runtime_pollWait(0xffff98af4810, 0×72, 0×0)
      /usr/local/go/src/runtime/netpoll.go:184 +0×44
      internal/poll.(pollDesc).wait(0×40031f2118, 0×72, 0×0, 0×0, 0×29f28da)
      /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0×38
      internal/poll.(
      pollDesc).waitRead(…)
      /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
      internal/poll.(FD).Accept(0×40031f2100, 0×0, 0×0, 0×0, 0×0, 0×0, 0×0, 0×0)
      /usr/local/go/src/internal/poll/fd_unix.go:384 +0×188
      net.(
      netFD).accept(0×40031f2100, 0×40026519b8, 0×4002651a18, 0×29b540)
      /usr/local/go/src/net/fd_unix.go:238 +0×2c
      net.(TCPListener).accept(0×400167e200, 0×6053f0c0, 0×40026519f8, 0×47894)
      /usr/local/go/src/net/tcpsock_posix.go:139 +0×2c
      net.(
      TCPListener).Accept(0×400167e200, 0×4002651a60, 0×4002651a68, 0×18, 0×4000000180)
      /usr/local/go/src/net/tcpsock.go:261 +0×3c
      net/http.(Server).Serve(0×40009de0e0, 0×30bdb20, 0×400167e200, 0×0, 0×0)
      /usr/local/go/src/net/http/server.go:2925 +0×220
      net/http.(
      Server).ListenAndServe(0×40009de0e0, 0×0, 0×2a14f66)
      /usr/local/go/src/net/http/server.go:2854 +0xac
      kubesphere.io/kubesphere/pkg/apiserver.(APIServer).Run(0×400053e1a0, 0×4000055140, 0×0, 0×0)
      /go/src/kubesphere.io/kubesphere/pkg/apiserver/apiserver.go:236 +0×168
      kubesphere.io/kubesphere/cmd/ks-apiserver/app.Run(0×40002ef500, 0×4000055140, 0×0, 0×0)
      /go/src/kubesphere.io/kubesphere/cmd/ks-apiserver/app/server.go:89 +0×8c
      kubesphere.io/kubesphere/cmd/ks-apiserver/app.NewAPIServerCommand.func1(0×400017ac80, 0×400027f100, 0×0, 0×1, 0×0, 0×0)
      /go/src/kubesphere.io/kubesphere/cmd/ks-apiserver/app/server.go:55 +0xa0
      github.com/spf13/cobra.(
      Command).execute(0×400017ac80, 0×4000158030, 0×1, 0×1, 0×400017ac80, 0×4000158030)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/spf13/cobra/command.go:826 +0×314
      github.com/spf13/cobra.(Command).ExecuteC(0×400017ac80, 0×0, 0×4000114748, 0×3f74c)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/spf13/cobra/command.go:914 +0×22c
      github.com/spf13/cobra.(
      Command).Execute(…)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/spf13/cobra/command.go:864
      main.main()
      /go/src/kubesphere.io/kubesphere/cmd/ks-apiserver/apiserver.go:28 +0×24

      goroutine 18 [chan receive]:
      github.com/golang/glog.(*loggingT).flushDaemon(0×4c47a00)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/golang/glog/glog.go:882 +0×70
      created by github.com/golang/glog.init.0
      /go/src/kubesphere.io/kubesphere/vendor/github.com/golang/glog/glog.go:410 +0×2a8

      goroutine 19 [chan receive]:
      k8s.io/klog.(*loggingT).flushDaemon(0×4c47ba0)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/klog/klog.go:1010 +0×70
      created by k8s.io/klog.init.0
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/klog/klog.go:411 +0×118

      goroutine 915 [chan receive]:
      k8s.io/client-go/tools/cache.(controller).Run.func1(0×4000055140, 0×4001c8c300)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/controller.go:104 +0×2c
      created by k8s.io/client-go/tools/cache.(
      controller).Run
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0×7c

      goroutine 85 [syscall]:
      os/signal.signal_recv(0×0)
      /usr/local/go/src/runtime/sigqueue.go:147 +0xc4
      os/signal.loop()
      /usr/local/go/src/os/signal/signal_unix.go:23 +0×20
      created by os/signal.init.0
      /usr/local/go/src/os/signal/signal_unix.go:29 +0×38

      goroutine 100 [chan receive]:
      kubesphere.io/kubesphere/pkg/utils/signals.SetupSignalHandler.func1(0×4000169bc0, 0×4000055140)
      /go/src/kubesphere.io/kubesphere/pkg/utils/signals/signal.go:36 +0×2c
      created by kubesphere.io/kubesphere/pkg/utils/signals.SetupSignalHandler
      /go/src/kubesphere.io/kubesphere/pkg/utils/signals/signal.go:35 +0xcc

      goroutine 101 [chan receive]:
      github.com/go-redis/redis/internal/pool.(*ConnPool).reaper(0×40004ce000, 0xdf8475800)
      /go/src/kubesphere.io/kubesphere/vendor/github.com/go-redis/redis/internal/pool/pool.go:449 +0×88
      created by github.com/go-redis/redis/internal/pool.NewConnPool
      /go/src/kubesphere.io/kubesphere/vendor/github.com/go-redis/redis/internal/pool/pool.go:99 +0×198

      goroutine 110 [chan receive]:
      kubesphere.io/kubesphere/pkg/simple/client/cache.NewRedisClient.func1(0×4000055140, 0×400000e428)
      /go/src/kubesphere.io/kubesphere/pkg/simple/client/cache/redis.go:53 +0×2c
      created by kubesphere.io/kubesphere/pkg/simple/client/cache.NewRedisClient
      /go/src/kubesphere.io/kubesphere/pkg/simple/client/cache/redis.go:52 +0×250

      goroutine 689 [select]:
      net/http.(persistConn).readLoop(0×40004cc6c0)
      /usr/local/go/src/net/http/transport.go:2032 +0×794
      created by net/http.(
      Transport).dialConn
      /usr/local/go/src/net/http/transport.go:1580 +0×900

      goroutine 947 [select]:
      k8s.io/client-go/tools/cache.(Reflector).watchHandler(0×4001232e70, 0×3074c20, 0×4000b67380, 0×4001115b48, 0×400115d2c0, 0×4000055140, 0×0, 0×0)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/reflector.go:354 +0×134
      k8s.io/client-go/tools/cache.(
      Reflector).ListAndWatch(0×4001232e70, 0×4000055140, 0×0, 0×0)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/reflector.go:320 +0×6b4
      k8s.io/client-go/tools/cache.(Reflector).Run.func1()
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/reflector.go:152 +0×30
      k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0×40011796e0)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:152 +0×58
      k8s.io/apimachinery/pkg/util/wait.JitterUntil(0×4001115ee0, 0×3b9aca00, 0×0, 0×2b07801, 0×4000055140)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:153 +0xb0
      k8s.io/apimachinery/pkg/util/wait.Until(…)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88
      k8s.io/client-go/tools/cache.(
      Reflector).Run(0×4001232e70, 0×4000055140)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/reflector.go:151 +0×114
      k8s.io/apimachinery/pkg/util/wait.(Group).StartWithChannel.func1()
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0×30
      k8s.io/apimachinery/pkg/util/wait.(
      Group).Start.func1(0×4001222f90, 0×4000b3ba80)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0×5c
      created by k8s.io/apimachinery/pkg/util/wait.(*Group).Start
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0×5c

      goroutine 1013 [select]:
      net/http.(persistConn).writeLoop(0×40009885a0)
      /usr/local/go/src/net/http/transport.go:2210 +0xc0
      created by net/http.(
      Transport).dialConn
      /usr/local/go/src/net/http/transport.go:1581 +0×920

      goroutine 518 [IO wait]:
      internal/poll.runtime_pollWait(0xffff990c1618, 0×72, 0xffffffffffffffff)
      /usr/local/go/src/runtime/netpoll.go:184 +0×44
      internal/poll.(pollDesc).wait(0×4000a88b98, 0×72, 0×7f00, 0×7fdc, 0xffffffffffffffff)
      /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0×38
      internal/poll.(
      pollDesc).waitRead(…)
      /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
      internal/poll.(FD).Read(0×4000a88b80, 0×4000c94000, 0×7fdc, 0×7fdc, 0×0, 0×0, 0×0)
      /usr/local/go/src/internal/poll/fd_unix.go:169 +0×164
      net.(
      netFD).Read(0×4000a88b80, 0×4000c94000, 0×7fdc, 0×7fdc, 0×40019d5300, 0xb38dc, 0×40019d54c8)
      /usr/local/go/src/net/fd_unix.go:202 +0×44
      net.(conn).Read(0×40009b4078, 0×4000c94000, 0×7fdc, 0×7fdc, 0×0, 0×0, 0×0)
      /usr/local/go/src/net/net.go:184 +0×58
      crypto/tls.(
      atLeastReader).Read(0×4001a0a0a0, 0×4000c94000, 0×7fdc, 0×7fdc, 0×40019d5ed0, 0×4c6fd60, 0×40019d54f8)
      /usr/local/go/src/crypto/tls/conn.go:780 +0×58
      bytes.(Buffer).ReadFrom(0×40006ffad8, 0×3052160, 0×4001a0a0a0, 0×1ea41c, 0×2551940, 0×2901de0)
      /usr/local/go/src/bytes/buffer.go:204 +0xa4
      crypto/tls.(
      Conn).readFromUntil(0×40006ff880, 0×3056160, 0×40009b4078, 0×5, 0×40009b4078, 0×0)
      /usr/local/go/src/crypto/tls/conn.go:802 +0xd0
      crypto/tls.(Conn).readRecordOrCCS(0×40006ff880, 0×0, 0×0, 0×10b69b8)
      /usr/local/go/src/crypto/tls/conn.go:609 +0xe0
      crypto/tls.(
      Conn).readRecord(…)
      /usr/local/go/src/crypto/tls/conn.go:577
      crypto/tls.(Conn).Read(0×40006ff880, 0×40019b0000, 0×1000, 0×1000, 0×0, 0×0, 0×0)
      /usr/local/go/src/crypto/tls/conn.go:1255 +0×11c
      net/http.(
      persistConn).Read(0×40010a0000, 0×40019b0000, 0×1000, 0×1000, 0×0, 0×40002a0580, 0×4000a70280)
      /usr/local/go/src/net/http/transport.go:1758 +0×60
      bufio.(Reader).fill(0×40019820c0)
      /usr/local/go/src/bufio/bufio.go:100 +0xf8
      bufio.(
      Reader).ReadSlice(0×40019820c0, 0xa, 0×40019d5988, 0×9e1938, 0×0, 0×0, 0×0)
      /usr/local/go/src/bufio/bufio.go:359 +0×38
      net/http/internal.readChunkLine(0×40019820c0, 0×29ec637, 0×1, 0×0, 0×1f4, 0×0)
      /usr/local/go/src/net/http/internal/chunked.go:122 +0×30
      net/http/internal.(chunkedReader).beginChunk(0×4001908060)
      /usr/local/go/src/net/http/internal/chunked.go:48 +0×2c
      net/http/internal.(
      chunkedReader).Read(0×4001908060, 0×4001a70400, 0×200, 0×200, 0×40019d5a48, 0×1afcc, 0×40019d5a48)
      /usr/local/go/src/net/http/internal/chunked.go:93 +0×10c
      net/http.(body).readLocked(0×4001a08040, 0×4001a70400, 0×200, 0×200, 0×40019d5aa8, 0×198, 0xffff98af0bb8)
      /usr/local/go/src/net/http/transfer.go:847 +0×54
      net/http.(
      body).Read(0×4001a08040, 0×4001a70400, 0×200, 0×200, 0×0, 0×0, 0×0)
      /usr/local/go/src/net/http/transfer.go:839 +0xe8
      net/http.(bodyEOFSignal).Read(0×4001a08080, 0×4001a70400, 0×200, 0×200, 0×0, 0×0, 0×0)
      /usr/local/go/src/net/http/transport.go:2582 +0xcc
      encoding/json.(
      Decoder).refill(0×40007202c0, 0×8, 0×4000821458)
      /usr/local/go/src/encoding/json/stream.go:161 +0xd4
      encoding/json.(Decoder).readValue(0×40007202c0, 0×0, 0×0, 0×6126fc)
      /usr/local/go/src/encoding/json/stream.go:136 +0×1a8
      encoding/json.(
      Decoder).Decode(0×40007202c0, 0×251fba0, 0×4001a0a080, 0×0, 0×4000821598)
      /usr/local/go/src/encoding/json/stream.go:63 +0×5c
      k8s.io/apimachinery/pkg/util/framer.(jsonFrameReader).Read(0×40019080c0, 0×4002c92400, 0×400, 0×400, 0×0, 0×38, 0×38)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:150 +0×194
      k8s.io/apimachinery/pkg/runtime/serializer/streaming.(
      decoder).Decode(0×4000bb0a50, 0×0, 0×30747e0, 0×4001a08100, 0×3, 0×3, 0×3, 0×3, 0×4000821638)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0×70
      k8s.io/client-go/rest/watch.(Decoder).Decode(0×4001a0a060, 0×10, 0×40008216c8, 0×5b388, 0×4c4cec0, 0×400016e558, 0×4000820101)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0×60
      k8s.io/apimachinery/pkg/watch.(
      StreamWatcher).receive(0×4001a080c0)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:104 +0×108
      created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:71 +0xb4

      goroutine 1123 [chan receive]:
      k8s.io/client-go/tools/cache.(controller).Run.func1(0×4000055140, 0×4000a35200)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/controller.go:104 +0×2c
      created by k8s.io/client-go/tools/cache.(
      controller).Run
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0×7c

      goroutine 856 [chan receive]:
      k8s.io/client-go/tools/cache.(controller).Run.func1(0×4000055140, 0×4001d4e280)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/controller.go:104 +0×2c
      created by k8s.io/client-go/tools/cache.(
      controller).Run
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/controller.go:103 +0×7c

      goroutine 855 [chan receive]:
      k8s.io/client-go/tools/cache.(sharedProcessor).run(0×40005dc150, 0×4001cd2060)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/shared_informer.go:529 +0×38
      k8s.io/apimachinery/pkg/util/wait.(
      Group).StartWithChannel.func1()
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0×30
      k8s.io/apimachinery/pkg/util/wait.(Group).Start.func1(0×4001ad4190, 0×4001ace1a0)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0×5c
      created by k8s.io/apimachinery/pkg/util/wait.(
      Group).Start
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0×5c

      goroutine 1122 [chan receive]:
      k8s.io/client-go/tools/cache.(sharedProcessor).run(0×400069fea0, 0×4001a232c0)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/shared_informer.go:529 +0×38
      k8s.io/apimachinery/pkg/util/wait.(
      Group).StartWithChannel.func1()
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0×30
      k8s.io/apimachinery/pkg/util/wait.(Group).Start.func1(0×4003335bd4, 0×4003325fa0)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0×5c
      created by k8s.io/apimachinery/pkg/util/wait.(
      Group).Start
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0×5c

      goroutine 584 [chan receive]:
      k8s.io/client-go/tools/cache.(sharedProcessor).run(0×400069e930, 0×40014c4000)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/tools/cache/shared_informer.go:529 +0×38
      k8s.io/apimachinery/pkg/util/wait.(
      Group).StartWithChannel.func1()
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:54 +0×30
      k8s.io/apimachinery/pkg/util/wait.(Group).Start.func1(0×4002ae80b0, 0×4003000040)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0×5c
      created by k8s.io/apimachinery/pkg/util/wait.(
      Group).Start
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:69 +0×5c

      goroutine 539 [IO wait]:
      internal/poll.runtime_pollWait(0xffff990c1c98, 0×72, 0xffffffffffffffff)
      /usr/local/go/src/runtime/netpoll.go:184 +0×44
      internal/poll.(pollDesc).wait(0×4000a67118, 0×72, 0×7f00, 0×7fdc, 0xffffffffffffffff)
      /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0×38
      internal/poll.(
      pollDesc).waitRead(…)
      /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
      internal/poll.(FD).Read(0×4000a67100, 0×4001200000, 0×7fdc, 0×7fdc, 0×0, 0×0, 0×0)
      /usr/local/go/src/internal/poll/fd_unix.go:169 +0×164
      net.(
      netFD).Read(0×4000a67100, 0×4001200000, 0×7fdc, 0×7fdc, 0×2, 0×61, 0×40019a14f8)
      /usr/local/go/src/net/fd_unix.go:202 +0×44
      net.(conn).Read(0×40009b4068, 0×4001200000, 0×7fdc, 0×7fdc, 0×0, 0×0, 0×0)
      /usr/local/go/src/net/net.go:184 +0×58
      crypto/tls.(
      atLeastReader).Read(0×400312cc20, 0×4001200000, 0×7fdc, 0×7fdc, 0×0, 0×0, 0×40019a14f8)
      /usr/local/go/src/crypto/tls/conn.go:780 +0×58
      bytes.(Buffer).ReadFrom(0×40006ff058, 0×3052160, 0×400312cc20, 0×1ea41c, 0×2551940, 0×2901de0)
      /usr/local/go/src/bytes/buffer.go:204 +0xa4
      crypto/tls.(
      Conn).readFromUntil(0×40006fee00, 0×3056160, 0×40009b4068, 0×5, 0×40009b4068, 0×400057c0e0)
      /usr/local/go/src/crypto/tls/conn.go:802 +0xd0
      crypto/tls.(Conn).readRecordOrCCS(0×40006fee00, 0×0, 0×0, 0×508080)
      /usr/local/go/src/crypto/tls/conn.go:609 +0xe0
      crypto/tls.(
      Conn).readRecord(…)
      /usr/local/go/src/crypto/tls/conn.go:577
      crypto/tls.(Conn).Read(0×40006fee00, 0×4001a30000, 0×1000, 0×1000, 0×0, 0×0, 0×0)
      /usr/local/go/src/crypto/tls/conn.go:1255 +0×11c
      net/http.(
      persistConn).Read(0×4000988480, 0×4001a30000, 0×1000, 0×1000, 0×40019a17d0, 0×9f3240, 0×2b070b8)
      /usr/local/go/src/net/http/transport.go:1758 +0×60
      bufio.(Reader).fill(0×40019ee0c0)
      /usr/local/go/src/bufio/bufio.go:100 +0xf8
      bufio.(
      Reader).ReadSlice(0×40019ee0c0, 0xa, 0×40019a1908, 0×1b5b4, 0×4000b18880, 0xffff990f1342, 0×2)
      /usr/local/go/src/bufio/bufio.go:359 +0×38
      net/http/internal.readChunkLine(0×40019ee0c0, 0×16, 0×4000b6ae40, 0×1, 0×1, 0xc00d1a0e0ad653d0)
      /usr/local/go/src/net/http/internal/chunked.go:122 +0×30
      net/http/internal.(chunkedReader).beginChunk(0×400199c480)
      /usr/local/go/src/net/http/internal/chunked.go:48 +0×2c
      net/http/internal.(
      chunkedReader).Read(0×400199c480, 0×4001b2e200, 0×200, 0×200, 0×40019a1a48, 0×1afcc, 0×40019a1a48)
      /usr/local/go/src/net/http/internal/chunked.go:93 +0×10c
      net/http.(body).readLocked(0×4001a200c0, 0×4001b2e200, 0×200, 0×200, 0×4001b2e200, 0xffff988aff90, 0xffff98af2c02)
      /usr/local/go/src/net/http/transfer.go:847 +0×54
      net/http.(
      body).Read(0×4001a200c0, 0×4001b2e200, 0×200, 0×200, 0×0, 0×0, 0×0)
      /usr/local/go/src/net/http/transfer.go:839 +0xe8
      net/http.(bodyEOFSignal).Read(0×4001a20100, 0×4001b2e200, 0×200, 0×200, 0×0, 0×0, 0×0)
      /usr/local/go/src/net/http/transport.go:2582 +0xcc
      encoding/json.(
      Decoder).refill(0×4001ac5e40, 0×8, 0×40004adc58)
      /usr/local/go/src/encoding/json/stream.go:161 +0xd4
      encoding/json.(Decoder).readValue(0×4001ac5e40, 0×0, 0×0, 0×6126fc)
      /usr/local/go/src/encoding/json/stream.go:136 +0×1a8
      encoding/json.(
      Decoder).Decode(0×4001ac5e40, 0×251fba0, 0×400312cc00, 0×6, 0×40004add98)
      /usr/local/go/src/encoding/json/stream.go:63 +0×5c
      k8s.io/apimachinery/pkg/util/framer.(jsonFrameReader).Read(0×400199c4e0, 0×4001da4400, 0×400, 0×400, 0×4000bc8100, 0×38, 0×38)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/util/framer/framer.go:150 +0×194
      k8s.io/apimachinery/pkg/runtime/serializer/streaming.(
      decoder).Decode(0×400099c370, 0×0, 0×30747e0, 0×4001a20180, 0×4000f60c00, 0×0, 0×0, 0×0, 0×40004ade38)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/runtime/serializer/streaming/streaming.go:77 +0×70
      k8s.io/client-go/rest/watch.(Decoder).Decode(0×400312cbe0, 0×3051f40, 0×400164ed00, 0×0, 0×40007342a0, 0×0, 0×0)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/client-go/rest/watch/decoder.go:49 +0×60
      k8s.io/apimachinery/pkg/watch.(
      StreamWatcher).receive(0×4001a20140)
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:104 +0×108
      created by k8s.io/apimachinery/pkg/watch.NewStreamWatcher
      /go/src/kubesphere.io/kubesphere/vendor/k8s.io/apimachinery/pkg/watch/streamwatcher.go:71 +0xb4

      zhu733756 您好 在昨天时候看到问题复现时,ks-apiserver在发生internal server error时确实该pod会出现异常,日志信息已附上,能否帮忙看一下可能导致的原因

        Phoaster-wry 可以上github.com/kubesphere/kubesphere上去发布issue,描述下apiserver的images 版本

        2 个月 后