部署porter后遇到的遇到的问题

tscswcn · 2020年12月3日

1，我用chart 部署了 porter LB
部署过程没问题， pod 和服务也都运行了
2，我参考样例创建了1个service

kubectl apply -f - <<EOF
kind: Service
apiVersion: v1
metadata:
name: mylbapp-svc-layer2
annotations:
lb.kubesphere.io/v1alpha1: porter
protocol.porter.kubesphere.io/v1alpha1: layer2
spec:
selector:
app: mylbapp
type: LoadBalancer
ports:
- name: http
port: 8088

targetPort: 80

apiVersion: apps/v1
kind: Deployment
metadata:
labels:
app: mylbapp
name: mylbapp
spec:
replicas: 2
selector:
matchLabels:
app: mylbapp
template:
metadata:
labels:
app: mylbapp
spec:
containers:
- image: nginx:alpine
name: nginx
ports:
- containerPort: 80
EOF
现在 kubectl get svc
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
csi-metrics-cephfsplugin ClusterIP 10.100.143.98 <none> 8080/TCP 71d
kubernetes ClusterIP 10.96.0.1 <none> 443/TCP 71d
mylbapp-svc-layer2 LoadBalancer 10.104.85.132 <pending> 8088:30400/TCP 28s

EXTERNAL-IP 那里是pending ，怎么诊断？
Pod porter-manager 里日志如下：
{“level”:“info”,“ts”:1606963638.7639797,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606963638.764023,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606963638.764045,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}
{“level”:“info”,“ts”:1606963641.3242216,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606963641.324264,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606963641.3242862,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}
{“level”:“info”,“ts”:1606963646.4444594,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606963646.4445183,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606963646.4445496,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}
{“level”:“info”,“ts”:1606963656.684741,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606963656.6847904,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606963656.6848145,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}
{“level”:“info”,“ts”:1606963677.1649976,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606963677.165046,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606963677.1650655,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}
{“level”:“info”,“ts”:1606963718.1252682,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606963718.1253111,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606963718.1253264,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}
{“level”:“info”,“ts”:1606963800.0455344,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606963800.0455859,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606963800.0456128,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}
{“level”:“info”,“ts”:1606963963.8858435,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606963963.8859074,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606963963.8859274,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}
{“level”:“info”,“ts”:1606964291.5661511,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606964291.5662215,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606964291.5662403,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}
{“level”:“info”,“ts”:1606964946.926451,“logger”:“IPAM”,“msg”:“unAssignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“peek”:true,“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:null}
{“level”:“info”,“ts”:1606964946.9265027,“logger”:“IPAM”,“msg”:“assignIP”,“args”:{“Key”:“default/mylbapp-svc-layer2”,“Addr”:"",“Eip”:"",“Protocol”:“layer2”},“result”:{“Addr”:"",“Eip”:"",“Protocol”:"",“Sp”:null},“err”:“no avliable eip”}
{“level”:“error”,“ts”:1606964946.9265192,“logger”:“controller-runtime.controller”,“msg”:“Reconciler error”,“controller”:“LBController”,“request”:“default/mylbapp-svc-layer2”,“error”:“no avliable eip”,“stacktrace”:“github.com/go-logr/zapr.(zapLogger).Error\n\t/root/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:258\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker\n\t/root/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.0/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:155\nk8s.io/apimachinery/pkg/util/wait.BackoffUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:156\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:133\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/root/go/pkg/mod/k8s.io/apimachinery@v0.18.2/pkg/util/wait/wait.go:90”}

我的环境是
k8s 1.16.3，网络插件是calico ipip
操作系统是
NAME=“Red Hat Enterprise Linux Server”
VERSION=“7.7 (Maipo)”
ID=“rhel”
ID_LIKE=“fedora”
VARIANT=“Server”
VARIANT_ID=“server”
VERSION_ID=“7.7”
PRETTY_NAME=“Red Hat Enterprise Linux Server 7.7 (Maipo)”
ANSI_COLOR=“0;31”
CPE_NAME=“cpe:/o:redhat:enterprise_linux:7.7:GA:server”
HOME_URL=“https://www.redhat.com/”
BUG_REPORT_URL=“https://bugzilla.redhat.com/”

REDHAT_BUGZILLA_PRODUCT=“Red Hat Enterprise Linux 7”
REDHAT_BUGZILLA_PRODUCT_VERSION=7.7
REDHAT_SUPPORT_PRODUCT=“Red Hat Enterprise Linux”
REDHAT_SUPPORT_PRODUCT_VERSION=“7.7”

请问我的问题怎么诊断，我还需要补充说明信息，谢谢

duanjiong · 2020年12月3日

方便执行下kubectl get eips.network.kubesphere.io -o yaml ?

tscswcn · 2020年12月3日

kubectl get eips.network.kubesphere.io -o yaml
apiVersion: v1
items: []
kind: List
metadata:
resourceVersion: ""
selfLink: ""

我没执行这个创建layer2 eip
kubectl apply -f - <<EOF
apiVersion: network.kubesphere.io/v1alpha2
kind: Eip
metadata:
name: eip-sample-layer2
spec:
address: 172.22.0.188-172.22.0.200
interface: eth0
protocol: layer2
EOF

需要执行吗

但我刚才补着执行下
kubectl apply -f - <<EOF

apiVersion: network.kubesphere.io/v1alpha2
kind: Eip
metadata:
name: eip-sample-layer2
spec:
address: 172.22.0.188-172.22.0.200
interface: eth0
protocol: layer2
EOF
Error from server (InternalError): error when creating “STDIN”: Internal error occurred: failed calling webhook “validate.eip.network.kubesphere.io”: Post https://porter-manager.porter.svc:443/validate-network-kubesphere-io-v1alpha2-eip?timeout=10s: dial tcp 10.111.158.50:443: connect: connection refused
[root@node-10-120-13-236 ~]#

duanjiong · 2020年12月3日

首先， eip这里面的内容是根据你自己的环境来设置的，我看你hostname上面是10网段，那么你可以根据你自己真实的网段调整，另外麻烦你在porter manager pod所在节点执行下netstat -nltp | grep manager ，然后再看下你kubectl get endpoints -n porter

tscswcn · 2020年12月3日

netstat -nltp | grep manager
tcp6 0 0 :::8443 :::* LISTEN 41868/manager
tcp6 0 0 :::8000 :::* LISTEN 41868/manager
tcp6 0 0 :::50051 :::* LISTEN 41868/manager
[root@node-10-120-13-236 net.d]#

[root@node-10-120-13-236 net.d]# kubectl get endpoints -n porter
NAME ENDPOINTS AGE
porter-manager 10.120.13.236:443 4h20m

另外1个问题是 10的地址都是在实际环境用的，只有 .253 .254 空余，这种情况怎么指定，就指定这这两个吗

还有网卡也是物理机实际网卡的名字吗？

duanjiong · 2020年12月3日

tscswcn 看样子你的porter的image不太对，你可以先把已经安装的porter删掉，把节点上的porter image先用docker rmi删掉，或者你修改下chart 的value把拉去镜像的策略改成Always。另外你节点上的10网段地址都用完了？你要保证你layer2模式你设置的ip地址能够路由到你的节点所在网络，然后这个物理网卡就是应答arp的网卡。

tscswcn · 2020年12月3日

恩，看见了chart 方式跟 yaml 方式 nanmespace 都不一样我都掉重新用yaml 文件重新来11遍
我的网卡是 ens192 ,那个 eip 文件是写这个ens192 吗？

ip　a
-bash: ip　a: command not found
[root@node-10-120-127-238 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.⅛ scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: ens192: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
link/ether 00:50:56:87:d4:b6 brd ff:ff:ff:ff:ff:ff
inet 10.120.127.238/24 brd 10.120.127.255 scope global ens192
valid_lft forever preferred_lft forever
inet6 fe80::250:56ff:fe87:d4b6/64 scope link
valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default
link/ether 02:42:ea:12:59:ae brd ff:ff:ff:ff:ff:ff
inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
valid_lft forever preferred_lft forever
4: calia4b5c5bafb5@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1440 qdisc noqueue state UP group default
link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0
inet6 fe80::ecee:eeff:feee:eeee/64 scope link

tscswcn · 2020年12月3日

[root@node-10-120-127-238 ~]# kubectl get eip
NAME CIDR USAGE TOTAL
eip-sample-layer2 10.120.127.253-10.120.127.254 1 2
[root@node-10-120-127-238 ~]# kubectl get svc
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
csi-metrics-cephfsplugin ClusterIP 10.100.143.98 <none> 8080/TCP 71d
kubernetes ClusterIP 10.96.0.1 <none> 443/TCP 71d
mylbapp-svc-layer2 LoadBalancer 10.104.85.132 10.120.127.253 8088:30400/TCP 6h52m
[root@node-10-120-127-238 ~]# curl http://10.120.127.253:30400
^C
[root@node-10-120-127-238 ~]#

我现在是现在这个状况，我觉得访问不了可能是我这里网络环境的问题
谢谢帮我看看

duanjiong · 2020年12月3日

30400是nodeport端口，你用curl http://10.120.127.253:8080访问

tscswcn · 2020年12月5日

我重新尝试了1下，现在可以了

[root@node131 ~]# kubectl get svc
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
kubernetes ClusterIP 10.43.0.1 <none> 443/TCP 19h
mylbapp-svc-layer2 LoadBalancer 10.43.70.164 10.10.10.150 8088:30824/TCP 11s
[root@node131 ~]# ping 10.10.10.150
PING 10.10.10.150 (10.10.10.150) 56(84) bytes of data.
From 10.10.10.132 icmp_seq=2 Redirect Host(New nexthop: 10.10.10.150)
From 10.10.10.132: icmp_seq=2 Redirect Host(New nexthop: 10.10.10.150)
From 10.10.10.132 icmp_seq=3 Redirect Host(New nexthop: 10.10.10.150)
From 10.10.10.132: icmp_seq=3 Redirect Host(New nexthop: 10.10.10.150)
From 10.10.10.132 icmp_seq=4 Redirect Host(New nexthop: 10.10.10.150)
From 10.10.10.132: icmp_seq=4 Redirect Host(New nexthop: 10.10.10.150)
^C
— 10.10.10.150 ping statistics —
5 packets transmitted, 0 received, +3 errors, 100% packet loss, time 4000ms

[root@node131 ~]# curl 10.10.10.150:8088
<!DOCTYPE html>
<html>
<head>
<title>Welcome to nginx!</title>
<style>
body {
width: 35em;
margin: 0 auto;
font-family: Tahoma, Verdana, Arial, sans-serif;
}
</style>
</head>
<body>
<h1>Welcome to nginx!</h1>
<p>If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.</p>

<p>For online documentation and support please refer to
<a href=“http://nginx.org/">nginx.org</a>.<br/>
Commercial support is available at
<a href=“http://nginx.com/">nginx.com</a>.</p>

<p><em>Thank you for using nginx.</em></p>
</body>
</html>