• 监控日志

  • 安装loki+grafana插件以后，怎么采集日志呢

这个地址是集群内访问的，你的grafana和loki装在同一个集群才行，如果不在一个集群，就需要把loki的gateway用nodePort暴露出来，然后这里填上nodePort地址

    wanjunlei

    这个地址是可以访问的，但是loki的不行，是应该访问loki的哪个svc呢

      你 telnet 一下 loki gateway 的 ip 和 port 看看是否能访问，看下 gateway 的日志

        benjaminhuo 那用咋们的WhizardTelemetry 日志插件也可以吧，默认保留多少天的日志呢，在哪里可以配置

          7 个月 后

          在同一个集群安装 Grafana Loki for WhizardTelemetry 和 Grafana for WhizardTelemetry ，有安装后成功采集到日志的吗？

          上面这个图里说自动添加数据源，结果并没有生效。

          然后在grafana手动加添加 loki 数据源 http://loki-agent-gateway.loki.svc, 配置 Header X-Scope-OrgID 并将值设置为

          whizard-logs-ks ，可以添加成功。 然后按下图的步骤修改了配置后，还是没有看到日志。

          检查vector日志并看一下kubesphere-logging-system下有没有loki字样的secret

            NullFox 没有 loki 的 secret

            loki-backend 的日志有报错：

            2025-04-30T14:25:42.479436915+08:00 level=warn ts=2025-04-30T06:25:42.382801139Z caller=cache.go:52 component=bloomstore msg="failed to walk directory" path=/var/loki/blooms dirEntry=null err="lstat /var/loki/blooms: no such file or directory"

            loki-write 也有错误

            2025-04-30T14:24:26.817091446+08:00 ts=2025-04-30T06:24:26.81339025Z caller=memberlist_logger.go:74 level=warn msg="Failed to resolve loki-memberlist: lookup loki-memberlist on 10.43.0.10:53: no such host"

2025-04-30T14:24:26.817109065+08:00 level=warn ts=2025-04-30T06:24:26.813425443Z caller=memberlist_client.go:561 msg="memberlist fast-join finished" joined_nodes=0 elapsed_time=4.402654ms

2025-04-30T14:24:26.817111925+08:00 ts=2025-04-30T06:24:26.814304094Z caller=memberlist_logger.go:74 level=warn msg="Failed to resolve loki-memberlist: lookup loki-memberlist on 10.43.0.10:53: no such host"

2025-04-30T14:24:26.817114895+08:00 level=warn ts=2025-04-30T06:24:26.814340877Z caller=memberlist_client.go:607 phase=startup msg="joining memberlist cluster" attempts=1 max_attempts=10 err="1 error occurred:\n\t* Failed to resolve loki-memberlist: lookup loki-memberlist on 10.43.0.10:53: no such host\n\n"

2025-04-30T14:24:26.817117660+08:00 level=error ts=2025-04-30T06:24:26.816122164Z caller=ratestore.go:109 msg="error getting ingester clients" err="empty ring"

2025-04-30T14:24:28.700076687+08:00 ts=2025-04-30T06:24:28.642915262Z caller=memberlist_logger.go:74 level=warn msg="Failed to resolve loki-memberlist: lookup loki-memberlist on 10.43.0.10:53: no such host"

2025-04-30T14:24:28.700094080+08:00 level=warn ts=2025-04-30T06:24:28.642943492Z caller=memberlist_client.go:607 phase=startup msg="joining memberlist cluster" attempts=2 max_attempts=10 err="1 error occurred:\n\t* Failed to resolve loki-memberlist: lookup loki-memberlist on 10.43.0.10:53: no such host\n\n"

            loki-read 也有错误

            2025-04-30T14:25:32.898611359+08:00 level=error ts=2025-04-30T06:25:32.812329539Z caller=ring_watcher.go:56 component=querier component=querier-scheduler-worker msg="error getting addresses from ring" err="empty ring"

2025-04-30T14:25:35.898312048+08:00 level=error ts=2025-04-30T06:25:35.813034209Z caller=ring_watcher.go:56 component=querier component=querier-scheduler-worker msg="error getting addresses from ring" err="empty ring"

2025-04-30T14:25:36.899075220+08:00 level=error ts=2025-04-30T06:25:36.806694511Z caller=resolver.go:87 index-store=tsdb-2024-04-01 msg="failed to lookup IP addresses" host=loki-backend-headless.loki.svc.cluster.local err="lookup loki-backend-headless.loki.svc.cluster.local on 10.43.0.10:53: no such host"

2025-04-30T14:25:36.899088482+08:00 level=warn ts=2025-04-30T06:25:36.806719692Z caller=resolver.go:134 index-store=tsdb-2024-04-01 msg="IP address lookup yielded no results. No host found or no addresses found" host=loki-backend-headless.loki.svc.cluster.local

2025-04-30T14:25:36.899091463+08:00 level=error ts=2025-04-30T06:25:36.812578246Z caller=ring_watcher.go:56 component=frontend-scheduler-worker msg="error getting addresses from ring" err="empty ring"

2025-04-30T14:25:38.898845548+08:00 level=error ts=2025-04-30T06:25:38.812578405Z caller=ring_watcher.go:56 component=querier component=querier-scheduler-worker msg="error getting addresses from ring" err="empty ring"

2025-04-30T14:25:44.898577205+08:00 level=error ts=2025-04-30T06:25:44.813194813Z caller=scheduler_processor.go:110 component=querier msg="error processing requests from scheduler" err="rpc error: code = Canceled desc = context canceled" addr=10.42.2.161:9095

2025-04-30T14:25:44.898598160+08:00 level=warn ts=2025-04-30T06:25:44.813111209Z caller=worker.go:254 component=querier msg="max concurrency is not evenly divisible across targets, adding an extra connection" addr=10.42.2.161:9095

2025-04-30T14:25:44.898601335+08:00 level=error ts=2025-04-30T06:25:44.813221443Z caller=scheduler_processor.go:110 component=querier msg="error processing requests from scheduler" err="rpc error: code = Canceled desc = context canceled" addr=10.42.2.161:9095

2025-04-30T14:25:44.898604186+08:00 level=warn ts=2025-04-30T06:25:44.813273932Z caller=scheduler_processor.go:102 component=querier msg="error contacting scheduler" err="rpc error: code = Canceled desc = context canceled" addr=10.42.0.202:9095

2025-04-30T14:25:44.898606784+08:00 level=error ts=2025-04-30T06:25:44.815377025Z caller=scheduler_processor.go:110 component=querier msg="error processing requests from scheduler" err="rpc error: code = Canceled desc = context canceled" addr=10.42.2.161:9095

2025-04-30T14:25:44.898609198+08:00 level=error ts=2025-04-30T06:25:44.815380201Z caller=scheduler_processor.go:110 component=querier msg="error processing requests from scheduler" err="rpc error: code = Canceled desc = context canceled" addr=10.42.2.161:9095

              正常来讲日志插件配置loki之后会有loki相关的secret，你这插件装的有问题吧，重新装一下吧

                NullFox 感谢，重装“WhizardTelemetry 日志”插件以后就可以了。