部署Devops报错，用户project-admin

freemankevin · 2020年11月23日

Internal Server Error
<!DOCTYPE html><html><head resURL="/static/08c0cfec" data-rooturl="" data-resurl="/static/08c0cfec"> <title>Jenkins</title><link rel="stylesheet" href="/static/08c0cfec/css/layout-common.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/css/style.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/css/color.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/css/responsive-grid.css" type="text/css" /><link rel="shortcut icon" href="/static/08c0cfec/favicon.ico" type="image/vnd.microsoft.icon" /><link color="black" rel="mask-icon" href="/images/mask-icon.svg" /><script>var isRunAsTest=false; var rootURL=""; var resURL="/static/08c0cfec";</script><script src="/static/08c0cfec/scripts/prototype.js" type="text/javascript"></script><script src="/static/08c0cfec/scripts/behavior.js" type="text/javascript"></script><script src='/adjuncts/08c0cfec/org/kohsuke/stapler/bind.js' type='text/javascript'></script><script src="/static/08c0cfec/scripts/yui/yahoo/yahoo-min.js"></script><script src="/static/08c0cfec/scripts/yui/dom/dom-min.js"></script><script src="/static/08c0cfec/scripts/yui/event/event-min.js"></script><script src="/static/08c0cfec/scripts/yui/animation/animation-min.js"></script><script src="/static/08c0cfec/scripts/yui/dragdrop/dragdrop-min.js"></script><script src="/static/08c0cfec/scripts/yui/container/container-min.js"></script><script src="/static/08c0cfec/scripts/yui/connection/connection-min.js"></script><script src="/static/08c0cfec/scripts/yui/datasource/datasource-min.js"></script><script src="/static/08c0cfec/scripts/yui/autocomplete/autocomplete-min.js"></script><script src="/static/08c0cfec/scripts/yui/menu/menu-min.js"></script><script src="/static/08c0cfec/scripts/yui/element/element-min.js"></script><script src="/static/...

freemankevin · 2020年11月23日

freemankevin

freemankevin · 2020年11月23日

下午使用还是正常的，夜晚我给所有的用户和工作空间删了重过一边部署流程就报这个

freemankevin · 2020年11月23日

Internal Server Error
<!DOCTYPE html><html><head resURL="/static/08c0cfec" data-rooturl="" data-resurl="/static/08c0cfec"> <title>Jenkins</title><link rel="stylesheet" href="/static/08c0cfec/css/layout-common.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/css/style.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/css/color.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/css/responsive-grid.css" type="text/css" /><link rel="shortcut icon" href="/static/08c0cfec/favicon.ico" type="image/vnd.microsoft.icon" /><link color="black" rel="mask-icon" href="/images/mask-icon.svg" /><script>var isRunAsTest=false; var rootURL=""; var resURL="/static/08c0cfec";</script><script src="/static/08c0cfec/scripts/prototype.js" type="text/javascript"></script><script src="/static/08c0cfec/scripts/behavior.js" type="text/javascript"></script><script src='/adjuncts/08c0cfec/org/kohsuke/stapler/bind.js' type='text/javascript'></script><script src="/static/08c0cfec/scripts/yui/yahoo/yahoo-min.js"></script><script src="/static/08c0cfec/scripts/yui/dom/dom-min.js"></script><script src="/static/08c0cfec/scripts/yui/event/event-min.js"></script><script src="/static/08c0cfec/scripts/yui/animation/animation-min.js"></script><script src="/static/08c0cfec/scripts/yui/dragdrop/dragdrop-min.js"></script><script src="/static/08c0cfec/scripts/yui/container/container-min.js"></script><script src="/static/08c0cfec/scripts/yui/connection/connection-min.js"></script><script src="/static/08c0cfec/scripts/yui/datasource/datasource-min.js"></script><script src="/static/08c0cfec/scripts/yui/autocomplete/autocomplete-min.js"></script><script src="/static/08c0cfec/scripts/yui/menu/menu-min.js"></script><script src="/static/08c0cfec/scripts/yui/element/element-min.js"></script><script src="/static/08c0cfec/scripts/yui/button/button-min.js"></script><script src="/static/08c0cfec/scripts/yui/storage/storage-min.js"></script><script src="/static/08c0cfec/scripts/hudson-behavior.js" type="text/javascript"></script><script src="/static/08c0cfec/scripts/sortable.js" type="text/javascript"></script><script>crumb.init("Jenkins-Crumb", "bf9258c57f1bec5c28ec9c5a5f2a55a3");</script><link rel="stylesheet" href="/static/08c0cfec/scripts/yui/container/assets/container.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/scripts/yui/assets/skins/sam/skin.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/scripts/yui/container/assets/skins/sam/container.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/scripts/yui/button/assets/skins/sam/button.css" type="text/css" /><link rel="stylesheet" href="/static/08c0cfec/scripts/yui/menu/assets/skins/sam/menu.css" type="text/css" /><link rel="search" href="/opensearch.xml" type="application/opensearchdescription+xml" title="Jenkins" /><meta name="ROBOTS" content="INDEX,NOFOLLOW" /><meta name="viewport" content="width=device-width, initial-scale=1" /><script src="/adjuncts/08c0cfec/org/kohsuke/stapler/jquery/jquery.full.js" type="text/javascript"></script><script>var Q=jQuery.noConflict()</script><link rel="stylesheet" href="/plugin/jquery-ui/css/jquery-ui-1.8.9.custom.css" type="text/css" /><script src="/plugin/jquery-ui/js/jquery-ui-1.8.9.custom.min.js"></script><script src="/static/08c0cfec/jsbundles/page-init.js" type="text/javascript"></script></head><body data-model-type="hudson.util.DoubleLaunchChecker" id="jenkins" class="yui-skin-sam two-column jenkins-2.176.2" data-version="2.176.2"><a href="#skip2content" class="skiplink">Skip to content</a><div id="page-head"><div id="header"><div class="logo"><a id="jenkins-home-link" href="/"><img src="/static/08c0cfec/images/headshot.png" alt="[Jenkins]" id="jenkins-head-icon" /><img src="/static/08c0cfec/images/title.png" alt="Jenkins" width="139" id="jenkins-name-icon" height="34" /></a></div><div class="login"></div><div class="searchbox hidden-xs"><form role="search" method="get" name="search" style="position:relative;" class="no-json"><div id="search-box-minWidth"></div><div id="search-box-sizer"></div><div id="searchform"><input role="searchbox" name="q" placeholder="查找" id="search-box" class="has-default-text" value="type:pipeline;organization:jenkins;pipeline:blade-auth-devjfhxx/*;excludedFromFlattening:jenkins.branch.MultiBranchProject,hudson.matrix.MatrixProject&amp;filter=no-folders" /> <a href="https://jenkins.io/redirect/search-box"><img src="/static/08c0cfec/images/16x16/help.png" style="width: 16px; height: 16px; " class="icon-help icon-sm" /></a><div id="search-box-completion"></div><script>createSearchBox("");</script></div></form></div></div><div id="breadcrumbBar"><tr id="top-nav"><td id="left-top-nav" colspan="2"><link rel='stylesheet' href='/adjuncts/08c0cfec/lib/layout/breadcrumbs.css' type='text/css' /><script src='/adjuncts/08c0cfec/lib/layout/breadcrumbs.js' type='text/javascript'></script><div class="top-sticker noedge"><div class="top-sticker-inner"><div id="right-top-nav"><div id="right-top-nav"><div class="smallfont"><a href="?auto_refresh=true">允许自动刷新</a></div></div></div><ul id="breadcrumbs"></ul><div id="breadcrumb-menu-target"></div></div></div></td></tr></div></div><div id="page-body" class="clear"><div id="side-panel"></div><div id="main-panel"><a name="skip2content"></a><h1>Error</h1><p>Jenkins detected that you appear to be running more than one instance of Jenkins that share the same home directory '/var/jenkins_home’. This greatly confuses Jenkins and you will likely experience strange behaviors, so please correct the situation.</p><table><tr><td>This Jenkins:</td><td>1027265031 contextPath="" at 8@ks-jenkins-654b66b6-vgbkq</td></tr><tr><td>Other Jenkins:</td><td>1669478508 contextPath="" at 8@ks-jenkins-654b66b6-drcz7</td></tr></table><div><form method="post" action="/ignore"><input name="Submit" type="submit" value="Ignore this problem and keep using Jenkins anyway" class="submit-button primary" /></form></div></div></div><footer><div class="container-fluid"><div class="row"><div class="col-md-6" id="footer"></div><div class="col-md-18"><span class="page_generated">生成页面: 2020-11-23 下午01时20分37秒</span><span class="jenkins_ver"><a href="https://jenkins.io/">Jenkins ver. 2.176.2</a></span><div class="page-footer__links jenkins-zh"><a href="/chinese">Jenkins 中文社区</a></div><script type="text/javascript"> var defaultUpdateSiteId = 'default'; var setupWizardExtensions = []; var onSetupWizardInitialized = function(extension) { setupWizardExtensions.push(extension); }; </script><script src="/static/08c0cfec/jsbundles/pluginSetupWizard.js" type="text/javascript"></script><link rel="stylesheet" href="/static/08c0cfec/jsbundles/pluginSetupWizard.css" type="text/css" /><link rel='stylesheet' href='/adjuncts/08c0cfec/jenkins/management/AdministrativeMonitorsDecorator/resources.css' type='text/css' /><script src='/adjuncts/08c0cfec/jenkins/management/AdministrativeMonitorsDecorator/resources.js' type='text/javascript'></script><div id="visible-am-container"><a onclick="toggleVisibleAmList(event)" id="visible-am-button" href="#" title="有 2 项激活的管理员检查项">2</a><div id="visible-am-list"><div class="am-message"><div class="alert alert-info"> 新版本的 Jenkins (2.267) 可以<a href="https://updates.jenkins.io/download/war/2.267/jenkins.war">下载</a> (<a href="https://jenkins.io/changelog-stable">变更记录</a>)。 <form method="post" action="/updateCenter/upgrade"><input name="Submit" type="submit" value="或自动升级" class="submit-button primary" /></form></div></div><div class="am-message"><div class="alert alert-danger" role="alert"><form method="post" action="/administrativeMonitor/jenkins.security.UpdateSiteWarningsMonitor/forward"><input name="fix" type="submit" value="返回插件管理" class="submit-button primary" /><input name="configure" type="submit" value="配置显示哪些警告" class="submit-button primary" /></form>当前安装的下列组件已有警告发布。<dl><dt>Jenkins 2.176.2 核心及其库</dt><dd><a href="https://jenkins.io/security/advisory/2020-03-25/" target="_blank">Multiple security vulnerabilities in Jenkins 2.227 and earlier, LTS 2.204.5 and earlier</a></dd><dd><a href="https://jenkins.io/security/advisory/2020-07-15/" target="_blank">Multiple security vulnerabilities in Jenkins 2.244 and earlier, LTS 2.235.1 and earlier</a></dd><dd><a href="https://jenkins.io/security/advisory/2019-08-28/" target="_blank">Multiple security vulnerabilities in Jenkins 2.191 and earlier, and LTS 2.176.2 and earlier</a></dd><dd><a href="https://jenkins.io/security/advisory/2019-09-25/" target="_blank">Multiple security vulnerabilities in Jenkins 2.196 and earlier, and LTS 2.176.3 and earlier</a></dd><dd><a href="https://jenkins.io/security/advisory/2020-08-12/" target="_blank">Multiple security vulnerabilities in Jenkins 2.251 and earlier, LTS 2.235.3 and earlier</a></dd><dd><a href="https://jenkins.io/security/advisory/2020-01-29/" target="_blank">Multiple vulnerabilities in Jenkins 2.218 and earlier, LTS 2.204.1 and earlier</a></dd></dl><dl><dt><a href="http://wiki.jenkins-ci.org/display/JENKINS/PAM+Authentication+Plugin" target="_blank">PAM Authentication plugin 1.1</a></dt><dd><a href="https://jenkins.io/security/advisory/20

hongming · 2020年11月23日

freemankevin 看看ks-apiserver 和 ks-controller-manager 中的错误日志

hongming · 2020年11月23日

freemankevin 看看kubesphere-devops-system 这个ns 下的pod 都正常running 吗

freemankevin · 2020年11月23日

hongming 是的，没有什么异常的pod和日志

hongming · 2020年11月23日

freemankevin 不应该， ks-apiserver 应该有详细的错误信息

kubectl get devopsprojects <devops project name> -o yaml

看看这个返回结果

freemankevin · 2020年11月23日

hongming

和这个网关地址有关系吗？我这里没有文档里那个网关ip

freemankevin · 2020年11月23日

hongming
不清楚你这个是要看什么，没有这样看过

freemankevin · 2020年11月23日

hongming

可以了，是jenkins服务崩溃，但pod状态正常的，还有就是jenkins几乎都是闪退的，除非保持登陆状态。是否需要做什么特殊的设置吗？

freemankevin · 2020年11月23日

挂的时候

Jjusda_hm · 2020年11月24日

hongming ks-contrller-manager用途是什么，部署后一直在报错，不断的重启。
I1124 08:41:05.416742 1 event.go:281] Event(v1.ObjectReference{Kind:“ClusterRoleBinding”, Namespace:"", Name:“admin-cluster-admin”, UID:“823ebca3-78fb-402d-a8f1-4f3361c355dc”, APIVersion:“rbac.authorization.k8s.io/v1”, ResourceVersion:“14712”, FieldPath:""}): type: ‘Normal’ reason: ‘Synced’ ClusterRoleBinding synced successfully

I1124 08:41:05.429757 1 workspacetemplate_controller.go:200] Successfully synced key:system-workspace

I1124 08:41:05.430659 1 event.go:281] Event(v1.ObjectReference{Kind:“WorkspaceTemplate”, Namespace:"", Name:“system-workspace”, UID:“b848f765-f032-452d-aea7-61d185fbbf1f”, APIVersion:“tenant.kubesphere.io/v1alpha2”, ResourceVersion:“12027”, FieldPath:""}): type: ‘Normal’ reason: ‘Synced’ WorkspaceTemplate synced successfully

I1124 08:41:05.459128 1 workspacetemplate_controller.go:200] Successfully synced key:middleware-workspace

I1124 08:41:05.459174 1 event.go:281] Event(v1.ObjectReference{Kind:“WorkspaceTemplate”, Namespace:"", Name:“middleware-workspace”, UID:“d3b02c89-f145-4184-b986-b117fb0cd15f”, APIVersion:“tenant.kubesphere.io/v1alpha2”, ResourceVersion:“2527516”, FieldPath:""}): type: ‘Normal’ reason: ‘Synced’ WorkspaceTemplate synced successfully

E1124 08:41:05.480520 1 runtime.go:78] Observed a panic: “invalid memory address or nil pointer dereference” (runtime error: invalid memory address or nil pointer dereference)

goroutine 1143 [running]:

k8s.io/apimachinery/pkg/util/runtime.logPanic(0×1f0b740, 0×393d920)

/home/runner/go/pkg/mod/k8s.io/apimachinery@v0.17.3/pkg/util/runtime/runtime.go:74 +0xa3

k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0×0, 0×0, 0×0)

/home/runner/go/pkg/mod/k8s.io/apimachinery@v0.17.3/pkg/util/runtime/runtime.go:48 +0×82

panic(0×1f0b740, 0×393d920)

/opt/hostedtoolcache/go/1.13.15/x64/src/runtime/panic.go:679 +0×1b2

github.com/beevik/etree.(*Element).Text(0×0, 0×2278b22, 0xa)

/home/runner/go/pkg/mod/github.com/beevik/etree@v1.1.0/etree.go:426 +0×26

kubesphere.io/kubesphere/pkg/simple/client/devops/jenkins.parseMultiBranchPipelineConfigXml(0xc001342000, 0xf2c, 0xf2c, 0×0, 0×0)

/home/runner/work/kubesphere/kubesphere/pkg/simple/client/devops/jenkins/pipeline_internal.go:884 +0×28b

kubesphere.io/kubesphere/pkg/simple/client/devops/jenkins.(*Jenkins).GetProjectPipelineConfig(0xc000333050, 0xc000a83410, 0×14, 0xc0009ffd00, 0×13, 0×1, 0×0, 0×1)

/home/runner/work/kubesphere/kubesphere/pkg/simple/client/devops/jenkins/project_pipeline.go:171 +0×39f

kubesphere.io/kubesphere/pkg/controller/pipeline.(*Controller).syncHandler(0xc0003e4dc0, 0xc000a83410, 0×28, 0xc000dfcf30, 0xc002d4bcf0)

/home/runner/work/kubesphere/kubesphere/pkg/controller/pipeline/pipeline_controller.go:234 +0×707

kubesphere.io/kubesphere/pkg/controller/pipeline.(*Controller).processNextWorkItem.func1(0xc0003e4dc0, 0×1e39320, 0xc000f0c020, 0×0, 0×0)

/home/runner/work/kubesphere/kubesphere/pkg/controller/pipeline/pipeline_controller.go:143 +0xf3

kubesphere.io/kubesphere/pkg/controller/pipeline.(*Controller).processNextWorkItem(0xc0003e4dc0, 0×0)

/home/runner/work/kubesphere/kubesphere/pkg/controller/pipeline/pipeline_controller.go:150 +0×51

kubesphere.io/kubesphere/pkg/controller/pipeline.(*Controller).worker(0xc0003e4dc0)

/home/runner/work/kubesphere/kubesphere/pkg/controller/pipeline/pipeline_controller.go:163 +0×2b

k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1(0xc000e1a6b0)

/home/runner/go/pkg/mod/k8s.io/apimachinery@v0.17.3/pkg/util/wait/wait.go:152 +0×5e

k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000e1a6b0, 0×3b9aca00, 0×0, 0×225c6c6f636f7401, 0xc00009c360)

/home/runner/go/pkg/mod/k8s.io/apimachinery@v0.17.3/pkg/util/wait/wait.go:153 +0xf8

k8s.io/apimachinery/pkg/util/wait.Until(0xc000e1a6b0, 0×3b9aca00, 0xc00009c360)

/home/runner/go/pkg/mod/k8s.io/apimachinery@v0.17.3/pkg/util/wait/wait.go:88 +0×4d

created by kubesphere.io/kubesphere/pkg/controller/pipeline.(*Controller).Run

/home/runner/work/kubesphere/kubesphere/pkg/controller/pipeline/pipeline_controller.go:183 +0×23f

panic: runtime error: invalid memory address or nil pointer dereference [recovered]

panic: runtime error: invalid memory address or nil pointer dereference

[signal SIGSEGV: segmentation violation code=0×1 addr=0×40 pc=0×1bd39d6]

goroutine 1143 [running]:

k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0×0, 0×0, 0×0)

/home/runner/go/pkg/mod/k8s.io/apimachinery@v0.17.3/pkg/util/runtime/runtime.go:55 +0×105