- how did you deploy it, with what parameters
安装了kubesphere v3.0 (k8s v1.7.8, centos 7.8), 使用bookinfo应用测试自建应用,测试成功,使用应用商城harbor模版创建镜像仓库,未更改任何配置,使用内置默认模版1.2.1【1.9.1】
- the running status of pods
所有pod均正常启动,正常运行


- the logs of ingress controller (kubesphere-control-system) if used
istio-proxy.log
`2020-07-21T00:57:47.181620Z info FLAG: –applicationPorts=“[80,443]”
2020-07-21T00:57:47.181821Z info FLAG: –binaryPath=“/usr/local/bin/envoy”
2020-07-21T00:57:47.181840Z info FLAG: –concurrency=“2″
2020-07-21T00:57:47.181853Z info FLAG: –configPath=“/etc/istio/proxy”
2020-07-21T00:57:47.181867Z info FLAG: –connectTimeout=“10s”
2020-07-21T00:57:47.181879Z info FLAG: –controlPlaneAuthPolicy=“NONE”
2020-07-21T00:57:47.181893Z info FLAG: –controlPlaneBootstrap=“true”
2020-07-21T00:57:47.181905Z info FLAG: –customConfigFile=""
2020-07-21T00:57:47.181915Z info FLAG: –datadogAgentAddress=""
2020-07-21T00:57:47.181926Z info FLAG: –disableInternalTelemetry=“false”
2020-07-21T00:57:47.181938Z info FLAG: –discoveryAddress=“istio-pilot.istio-system:15010”
2020-07-21T00:57:47.181948Z info FLAG: –dnsRefreshRate=“300s”
2020-07-21T00:57:47.181960Z info FLAG: –domain=“kubesphere-controls-system.svc.cluster.local”
2020-07-21T00:57:47.181971Z info FLAG: –drainDuration=“45s”
2020-07-21T00:57:47.181981Z info FLAG: –envoyAccessLogService=""
2020-07-21T00:57:47.182029Z info FLAG: –envoyMetricsService=""
2020-07-21T00:57:47.182040Z info FLAG: –help=“false”
2020-07-21T00:57:47.182050Z info FLAG: –id=""
2020-07-21T00:57:47.182060Z info FLAG: –ip=""
2020-07-21T00:57:47.182070Z info FLAG: –lightstepAccessToken=""
2020-07-21T00:57:47.182080Z info FLAG: –lightstepAddress=""
2020-07-21T00:57:47.182116Z info FLAG: –lightstepCacertPath=""
2020-07-21T00:57:47.182126Z info FLAG: –lightstepSecure=“false”
2020-07-21T00:57:47.182137Z info FLAG: –log_as_json=“false”
2020-07-21T00:57:47.182146Z info FLAG: –log_caller=""
2020-07-21T00:57:47.182157Z info FLAG: –log_output_level=“default:info”
2020-07-21T00:57:47.182167Z info FLAG: –log_rotate=""
2020-07-21T00:57:47.182177Z info FLAG: –log_rotate_max_age=“30″
2020-07-21T00:57:47.182188Z info FLAG: –log_rotate_max_backups=“1000″
2020-07-21T00:57:47.182199Z info FLAG: –log_rotate_max_size=“104857600″
2020-07-21T00:57:47.182209Z info FLAG: –log_stacktrace_level=“default:none”
2020-07-21T00:57:47.182236Z info FLAG: –log_target=“[stdout]”
2020-07-21T00:57:47.182249Z info FLAG: –mixerIdentity=""
2020-07-21T00:57:47.182261Z info FLAG: –parentShutdownDuration=“1m0s”
2020-07-21T00:57:47.182272Z info FLAG: –pilotIdentity=""
2020-07-21T00:57:47.182294Z info FLAG: –proxyAdminPort=“15000”
2020-07-21T00:57:47.182332Z info FLAG: –proxyComponentLogLevel=“misc:error”
2020-07-21T00:57:47.182343Z info FLAG: –proxyLogLevel=“warning”
2020-07-21T00:57:47.182355Z info FLAG: –serviceCluster=“kubesphere.kubesphere-controls-system”
2020-07-21T00:57:47.182365Z info FLAG: –serviceregistry=“Kubernetes”
2020-07-21T00:57:47.182375Z info FLAG: –statsdUdpAddress=""
2020-07-21T00:57:47.182387Z info FLAG: –statusPort=“15020”
2020-07-21T00:57:47.182410Z info FLAG: –templateFile=""
2020-07-21T00:57:47.182420Z info FLAG: –trust-domain=""
2020-07-21T00:57:47.182432Z info FLAG: –zipkinAddress=“jaeger-collector.istio-system.svc:9411″
2020-07-21T00:57:47.182499Z info Version 1.4.8-674e254c1685b25382282da03ec17f1cf3e0ea80-Clean
2020-07-21T00:57:47.182944Z info Obtained private IP [10.233.90.94]
2020-07-21T00:57:47.183159Z info Proxy role: &model.Proxy{ClusterID:"", Type:“sidecar”, IPAddresses:[]string{“10.233.90.94″, “10.233.90.94”}, ID:“kubesphere-router-harbor-65c77669f5-mj88j.kubesphere-controls-system”, Locality🙁envoy_api_v2_core.Locality)(nil), DNSDomain:“kubesphere-controls-system.svc.cluster.local”, ConfigNamespace:"", Metadata🙁model.NodeMetadata)(nil), SidecarScope🙁model.SidecarScope)(nil), MergedGateway🙁model.MergedGateway)(nil), ServiceInstances:[]model.ServiceInstance(nil), WorkloadLabels:labels.Collection(nil), IstioVersion🙁model.IstioVersion)(nil)}
2020-07-21T00:57:47.183208Z info PilotSAN []string(nil)
2020-07-21T00:57:47.183222Z info MixerSAN []string(nil)
2020-07-21T00:57:47.185262Z info Effective config: binaryPath: /usr/local/bin/envoy
concurrency: 2
configPath: /etc/istio/proxy
connectTimeout: 10s
discoveryAddress: istio-pilot.istio-system:15010
drainDuration: 45s
envoyAccessLogService: {}
envoyMetricsService: {}
parentShutdownDuration: 60s
proxyAdminPort: 15000
serviceCluster: kubesphere.kubesphere-controls-system
statNameLength: 189
tracing:
zipkin:
address: jaeger-collector.istio-system.svc:9411
2020-07-21T00:57:47.185391Z info PilotSAN []string(nil)
2020-07-21T00:57:47.185480Z info Starting proxy agent
2020-07-21T00:57:47.185820Z info Opening status port 15020
2020-07-21T00:57:47.186187Z info Received new config, creating new Envoy epoch 0
2020-07-21T00:57:47.188998Z info watching /etc/certs for changes
2020-07-21T00:57:47.188981Z info Epoch 0 starting
2020-07-21T00:57:47.269758Z info Envoy command: [-c /etc/istio/proxy/envoy-rev0.json –restart-epoch 0 –drain-time-s 45 –parent-shutdown-time-s 60 –service-cluster kubesphere.kubesphere-controls-system –service-node sidecar10.233.90.94kubesphere-router-harbor-65c77669f5-mj88j.kubesphere-controls-systemkubesphere-controls-system.svc.cluster.local –max-obj-name-len 189 –local-address-ip-version v4 –log-format [Envoy (Epoch 0)] [%Y-%m-%d %T.%e][%t][%l][%n] %v -l warning –component-log-level misc:error –concurrency 2]
[Envoy (Epoch 0)] [2020-07-21 00:57:47.351][23][warning][config] [bazel-out/k8-opt/bin/external/envoy/source/common/config/virtual_includes/grpc_stream_lib/common/config/grpc_stream.h:91] gRPC config stream closed: 14, no healthy upstream
[Envoy (Epoch 0)] [2020-07-21 00:57:47.352][23][warning][config] [bazel-out/k8-opt/bin/external/envoy/source/common/config/virtual_includes/grpc_stream_lib/common/config/grpc_stream.h:54] Unable to establish new stream
2020-07-21T00:57:49.541008Z info Envoy proxy is NOT ready: server is not live, current state is: INITIALIZING
2020-07-21T00:57:51.312375Z info Envoy proxy is ready
[Envoy (Epoch 0)] [2020-07-21 01:26:23.172][23][warning][config] [bazel-out/k8-opt/bin/external/envoy/source/common/config/virtual_includes/grpc_stream_lib/common/config/grpc_stream.h:91] gRPC config stream closed: 13,
[Envoy (Epoch 0)] [2020-07-21 01:54:05.765][23][warning][config] [bazel-out/k8-opt/bin/external/envoy/source/common/config/virtual_includes/grpc_stream_lib/common/config/grpc_stream.h:91] gRPC config stream closed: 13,
[Envoy (Epoch 0)] [2020-07-21 02:26:08.542][23][warning][config] [bazel-out/k8-opt/bin/external/envoy/source/common/config/_virtual_includes/grpc_stream_lib/common/config/grpc_stream.h:91] gRPC config stream closed: 13, **nginx-ingress-controller.log**
Flag –force-namespace-isolation has been deprecated, This flag doesn’t do anything.
W0721 00:57:46.837144 6 flags.go:214] SSL certificate chain completion is disabled (–enable-ssl-chain-completion=false)
NGINX Ingress controller
Release: 0.24.1
Build: git-ce418168f
nginx version: nginx/1.15.10
W0721 00:57:46.908620 6 client_config.go:549] Neither –kubeconfig nor –master was specified. Using the inClusterConfig. This might not work.
I0721 00:57:46.909419 6 main.go:205] Creating API client for https://10.233.0.1:443
W0721 00:57:51.901809 6 main.go:246] Initial connection to the Kubernetes API server was retried 3 times.
I0721 00:57:51.901862 6 main.go:249] Running in Kubernetes cluster version v1.17 (v1.17.8) - git (clean) commit 35dc4cdc26cfcb6614059c4c6e836e5f0dc61dee - platform linux/amd64
I0721 00:57:51.907153 6 main.go:102] Validated kubesphere-controls-system/default-http-backend as the default backend.
I0721 00:57:52.342049 6 main.go:124] Created fake certificate with PemFileName: /etc/ingress-controller/ssl/default-fake-certificate.pem
W0721 00:57:52.388545 6 store.go:613] Unexpected error reading configuration configmap: configmaps “kubesphere-router-harbor-nginx” not found
I0721 00:57:52.406694 6 nginx.go:265] Starting NGINX Ingress controller
I0721 00:57:53.514161 6 event.go:209] Event(v1.ObjectReference{Kind:“Ingress”, Namespace:“harbor”, Name:“harbor-harbor-ingress”, UID:“5f670ee5-a907-4c5c-ac59-8da12a8b82bc”, APIVersion:“extensions/v1beta1″, ResourceVersion:“1468401″, FieldPath:""}): type: ‘Normal’ reason: ‘CREATE’ Ingress harbor/harbor-harbor-ingress
I0721 00:57:53.520061 6 backend_ssl.go:68] Adding Secret “harbor/harbor-harbor-ingress” to the local store
I0721 00:57:53.608391 6 nginx.go:311] Starting NGINX process
I0721 00:57:53.608598 6 leaderelection.go:217] attempting to acquire leader lease kubesphere-controls-system/kubesphere-router-harbor-nginx…
W0721 00:57:53.609997 6 controller.go:366] Error getting default backend “kubesphere-controls-system/default-http-backend”: no object matching key “kubesphere-controls-system/default-http-backend” in local store
I0721 00:57:53.610445 6 controller.go:170] Configuration changes detected, backend reload required.
I0721 00:57:53.622143 6 status.go:86] new leader elected: kubesphere-router-harbor-65c77669f5-mj88j
I0721 00:57:53.622640 6 leaderelection.go:227] successfully acquired lease kubesphere-controls-system/kubesphere-router-harbor-nginx
I0721 00:57:53.640925 6 status.go:295] updating Ingress harbor/harbor-harbor-ingress status from [] to [{10.1.60.185 }]
I0721 00:57:53.648914 6 event.go:209] Event(v1.ObjectReference{Kind:“Ingress”, Namespace:“harbor”, Name:“harbor-harbor-ingress”, UID:“5f670ee5-a907-4c5c-ac59-8da12a8b82bc”, APIVersion:“extensions/v1beta1″, ResourceVersion:“1472012″, FieldPath:""}): type: ‘Normal’ reason: ‘UPDATE’ Ingress harbor/harbor-harbor-ingress
I0721 00:57:53.651239 6 backend_ssl.go:60] Updating Secret “harbor/harbor-harbor-ingress” in the local store
I0721 00:57:54.089703 6 controller.go:188] Backend successfully reloaded.
I0721 00:57:54.089862 6 controller.go:202] Initial sync, sleeping for 1 second.
[21/Jul/2020:00:57:55 +0000]TCP200000.000
W0721 00:57:57.486633 6 controller.go:366] Error getting default backend “kubesphere-controls-system/default-http-backend”: no object matching key “kubesphere-controls-system/default-http-backend” in local store
W0721 01:04:38.421342 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1471994 (1473335)
W0721 01:14:31.432847 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1473795 (1475845)
W0721 01:16:12.422552 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:152: watch of *v1.Endpoints ended with: too old resource version: 1472003 (1473870)
127.0.0.1 - [127.0.0.1] - - [21/Jul/2020:01:18:48 +0000] “GET / HTTP/1.1″ 400 658 “-” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36” 742 0.000 [] - - - - 6d5178d379d8721dc43b3bef9de2552a
127.0.0.1 - [127.0.0.1] - - [21/Jul/2020:01:18:49 +0000] “GET /favicon.ico HTTP/1.1″ 400 658 “http://10.1.60.184:30431/” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36″ 674 0.000 [] - - - - b6a2b1515e6416ed376b9760dacc49b8
127.0.0.1 - [127.0.0.1] - - [21/Jul/2020:01:19:02 +0000] “GET / HTTP/1.1” 400 658 “-” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36” 440 0.000 [] - - - - 3ea0cbe120db2adbe491ad5187fbaf7d
127.0.0.1 - [127.0.0.1] - - [21/Jul/2020:01:19:07 +0000] “GET / HTTP/1.1″ 400 658 “-” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36” 742 0.000 [] - - - - ccd554e762554a24418aee0f7c72ed81
127.0.0.1 - [127.0.0.1] - - [21/Jul/2020:01:19:07 +0000] “GET /favicon.ico HTTP/1.1” 400 658 “http://10.1.60.185:30431/” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36” 372 0.000 [] - - - - aa29692bd0d08cbdbce87274ca43fbe6
127.0.0.1 - [127.0.0.1] - - [21/Jul/2020:01:19:07 +0000] “GET /favicon.ico HTTP/1.1″ 400 658 “http://10.1.60.184:30431/” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36” 674 0.000 [] - - - - b484694196d39dec66088d8da19081e9
W0721 01:19:44.444466 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1476290 (1477108)
W0721 01:26:06.455261 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1477553 (1478752)
W0721 01:34:04.438393 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:152: watch of *v1.Endpoints ended with: too old resource version: 1476696 (1478421)
W0721 01:35:21.464849 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1479209 (1481109)
W0721 01:41:05.475765 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1481557 (1482494)
W0721 01:46:48.487578 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1483063 (1484001)
W0721 01:50:43.454261 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:152: watch of *v1.Endpoints ended with: too old resource version: 1481249 (1482554)
W0721 01:53:04.497833 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1484455 (1485642)
W0721 02:02:37.509519 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1486084 (1487959)
W0721 02:04:48.468380 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:152: watch of *v1.Endpoints ended with: too old resource version: 1485406 (1486206)
127.0.0.1 - [127.0.0.1] - - [21/Jul/2020:02:11:01 +0000] “GET / HTTP/1.1” 400 658 “-” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36″ 791 0.000 [] - - - - 0195c7ebecaef38d2f424b4f12a1987a
127.0.0.1 - [127.0.0.1] - - [21/Jul/2020:02:11:01 +0000] “GET /favicon.ico HTTP/1.1″ 400 658 “http://10.1.60.184:30431/” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36″ 723 0.000 [] - - - - 1dbc715d9d64f0f68121624913626563
W0721 02:11:49.521168 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1488529 (1490306)
W0721 02:17:01.532976 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1490869 (1491673)
W0721 02:19:57.484428 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:152: watch of *v1.Endpoints ended with: too old resource version: 1489059 (1490001)
W0721 02:25:15.545249 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1492131 (1493786)
W0721 02:31:26.570750 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1494227 (1495270)
W0721 02:35:48.512118 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:152: watch of *v1.Endpoints ended with: too old resource version: 1492840 (1494065)
W0721 02:37:11.583646 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1495829 (1496773)
W0721 02:43:20.594872 6 reflector.go:289] k8s.io/ingress-nginx/internal/ingress/controller/store/store.go:155: watch of *v1.ConfigMap ended with: too old resource version: 1497223 (1498915)
`
- the logs of harbor components (proxy, core)
应用市场harbor模版里面貌似没有叫做proxy的组件
请麻烦