Questions tagged [prometheus]

The Prometheus monitoring system.

117 questions
0
votes
0 answers

Prometheus query to identify active series if a datapoint is sent in the last 15-30mins

I am trying to identify my Prometheus active series if a datapoint is sent in the last 15-30mins. As I understand it, this query prometheus_tsdb_head_series gives me active series if a datapoint is sent in the last 1-3 hours. Can anyone help with…
qu_001
  • 1
0
votes
0 answers

GKE metrics about CPU usage of `kube-apiserver`

I'm trying to benchmark the load on the Kubernetes API that two different deployments cause. I have tried the two following ways of accomplishing this: Evaluate the Prometheus metric apiserver_request_total. Unfortunately, this does not take into…
0
votes
0 answers

servicemonitor doesnot add to prometheus-operator targets

I have deployed a Prometheus-operator on the k8s cluster. Everything works well, but I want to monitor MySQL pods in another namespace. I create mysqld-exporter pod and svc for it in MariaDB namespace and a servicemonitor for it in the monitoring…
0
votes
1 answer

Grafana pod is not running, how to fix that?

I have deployed grafana in eks using the steps provided in this link After deployment of grafana, the pod is not in running state. kubectl get po -n grafana NAME READY STATUS RESTARTS AGE grafana-6db7758575-pfqdg 0/1 …
0
votes
0 answers

PromQL range vector, but only if there's data from the start of the range? (for a new metric)

Prometheus can return all values for a time (e.g. api_counter[1h] for all values in the last hour). When the metric is new, there will not be 1 hour of data points. Is it possible to write a promql query which only returns data if there is data from…
Amandasaurus
  • 30,211
  • 62
  • 184
  • 246
0
votes
0 answers

Resource utilisation split in virtualisation platforms

I'm having a Hyper-V hypervisor and am running a CentOS 7 VM on top of it. The VM houses certain microbenchmarks (sysbench, stream, iozone and netperf) and I'm trying to study the effects (utilisation) of resources (CPU, memory, disk, network…
0
votes
1 answer

prometheus field remote_write not found in type config.plain

I need help using prometheus remote_write and remote_read to/from influxdb. I got error below: # promtool check config /etc/prometheus/prometheus.yml Checking /etc/prometheus/prometheus.yml FAILED: parsing YAML file /etc/prometheus/prometheus.yml:…
sajr
  • 1
0
votes
0 answers

How to get Kafka consumer metrics with JMX exporter for Prometheus?

Kafka version: 3.1 I didn't find a way to get Kafka consumer metrics as described in Kafka documentation from my Kafka servers. Even if I leave the "rules" section empty in the config of the JMX exporter there are no "kafka_consumer_*" metrics…
0
votes
1 answer

Disabling email for Prometheus Alertmanager based on severity

We are monitoring a HPC computing cluster using a combination of Prometheus, Alertmanager and Grafana. On our machines, things like SWAP memory filling up to essentially the limit happen frequently, and while it is useful to see the corresponding…
ml4294
  • 101
  • 2
0
votes
1 answer

Alertmanager telegram config chat_id and cannot unmarshal errror

I am trying to configure alertmanager to send alerts to my telegram group. Following the configuration I have: global: resolve_timeout: 5m route: group_by: - job group_interval: 5m group_wait: 30s receiver: "telegram" repeat_interval:…
Jose
  • 11
  • 2
0
votes
0 answers

prometheus alert for Kubernetes misfiring

On a K8s cluster I have Prometheus Operator and AlertManager running. I have this alert to catch incidents when a critical pod is down: - alert: KubernetesContainerMission-gslNotRunning expr: kube_pod_status_ready{condition="false",…
GI D
  • 1
0
votes
0 answers

Change retention time on prometheus

So I am running Prometheus on an Ubuntu server and started running it a while ago by just running sudo ./prometheus However, I wanted to append --storage.tsdb.retention.time=1y to the end of this command. How can I change the storage retention…
0
votes
0 answers

Secure kubernetes monitoring in Prometheus using service discovery

I'm currently using Prometheus to scrape metrics from a /metrics endpoint on my pods. In order to identify the pods I'm using kubernetes service discovery which discovers the pods and targets them through their internal IP. The problem is I want to…
0
votes
1 answer

webhook MS Teams integration with Prometheus - request failed

I'm struggling with Microsoft Teams/Prometheus integration on K8s cluster. I used helm to start all components. I have correctly working Prometheus and Alertmanager. It seems that all works fine. Prometheus communicate with Alertmanager. Then…
RedBluff
  • 1
  • 2
0
votes
1 answer

Nginx reverse proxy when port is already in use?

i am trying to close port with basic authentication (for pushgateway of prometheus), so not a big specialist in nginx, so could someone please give me and advice where i am is wrong? I have 9091 port, that should be closed from outside in front of…
Nigrimmist
  • 103
  • 3