操作系统信息
Centos7.5,8C/16G

Kubernetes版本信息

Client Version: version.Info{Major:“1”, Minor:“19”, GitVersion:“v1.19.8”, GitCommit:“fd5d41537aee486160ad9b5356a9d82363273721”, GitTreeState:“clean”, BuildDate:“2021-02-17T12:41:51Z”, GoVersion:“go1.15.8”, Compiler:“gc”, Platform:“linux/amd64”}

Server Version: version.Info{Major:“1”, Minor:“20”, GitVersion:“v1.20.5”, GitCommit:“6b1d87acf3c8253c123756b9e61dac642678305f”, GitTreeState:“clean”, BuildDate:“2021-03-18T01:02:01Z”, GoVersion:“go1.15.8”, Compiler:“gc”, Platform:“linux/amd64”}

容器运行时
[root@master1 ~]# docker version

Client: Docker Engine - Community

Version: 20.10.9

API version: 1.41

Go version: go1.16.8

Git commit: c2ea9bc

Built: Mon Oct 4 16:08:14 2021

OS/Arch: linux/amd64

Context: default

Experimental: true

Server: Docker Engine - Community

Engine:

Version: 20.10.9

API version: 1.41 (minimum version 1.12)

Go version: go1.16.8

Git commit: 79ea9d3

Built: Mon Oct 4 16:06:37 2021

OS/Arch: linux/amd64

Experimental: false

containerd:

Version: 1.4.11

GitCommit: 5b46e404f6b9f661a205e28d59c982d3634148f8

runc:

Version: 1.0.2

GitCommit: v1.0.2-0-g52b36a2

docker-init:

Version: 0.19.0

GitCommit: de40ad0

[root@master1 ~]# crictl version

Version: 0.1.0

RuntimeName: docker

RuntimeVersion: 20.10.9

RuntimeApiVersion: 1.41.0

[root@master1 ~]#

KubeSphere版本信息
v3.2.0。在线安装。在已有K8s上安装。

问题是什么
Prometheus cpu 使用率一直比较高

改了几个值,对比了一下 cpu 使用率的变化【sum(rate(container_cpu_usage_seconds_total{container =~“prometheus”,container !="",container!=“POD”}[2m])) by (container) 】如下图所示:

大家也有类似 cpu 高的问题吗,目前来看 evaluationInterval 对 cpu 的影响较大,还是说因为 PrometheusRule 配置很多,所以 cpu 高是正常的?

很想知道最佳实践一般配置多少,但看了一些文章,有的建议这两个值最好配置成一样的。

在这篇文章(https://www.robustperception.io/keep-it-simple-scrape_interval-id)中,scrapeInterval 建议 10s ~ 60s。