What is the Prometheus alert rule for "Jenkins node offline"?

At least one Jenkins node offline: `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}}) PromQL expression: jenkins_node_offline_value > 0. Severity: critical. Duration: 5m.

What is the Prometheus alert rule for "Jenkins no node online"?

No Jenkins nodes are online: `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}}) PromQL expression: jenkins_node_online_value == 0. Severity: critical.

What is the Prometheus alert rule for "Jenkins outdated plugins"?

{{ $value }} plugins need update PromQL expression: sum(jenkins_plugins_withUpdate) by (instance) > 3. Severity: warning. Duration: 1d.

What is the Prometheus alert rule for "Jenkins builds health score"?

Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}}) PromQL expression: default_jenkins_builds_health_score < 1. Severity: critical.

What is the Prometheus alert rule for "Jenkins build tests failing"?

Last build tests failed: {{$labels.jenkins_job}}. Failed build Tests for job `{{$labels.jenkins_job}}` on {{$labels.instance}}/{{$labels.env}} ({{$labels.region}}) PromQL expression: default_jenkins_builds_last_build_tests_failing > 0. Severity: warning.

What is the Prometheus alert rule for "Jenkins last build failed"?

Last build failed: {{$labels.jenkins_job}}. Failed build for job `{{$labels.jenkins_job}}` on {{$labels.instance}}/{{$labels.env}} ({{$labels.region}}) PromQL expression: default_jenkins_builds_last_build_result_ordinal == 2. Severity: warning.

⚠️

Alert thresholds depend on the nature of your applications. Some queries may have arbitrary tolerance thresholds. Building an efficient monitoring platform takes time. 😉

Jenkins Prometheus Alert Rules

8 Prometheus alerting rules for Jenkins. Exported via Metric plugin. These rules cover critical and warning conditions — copy and paste the YAML into your Prometheus configuration.

groups:
- name: MetricPlugin
  rules:
    - alert: JenkinsNodeOffline
      expr: jenkins_node_offline_value > 0
      for: 5m
      labels:
        severity: critical
      annotations:
        summary: Jenkins node offline (instance {{ $labels.instance }})
        description: "At least one Jenkins node offline: `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"
    
    - alert: JenkinsNoNodeOnline
      expr: jenkins_node_online_value == 0
      for: 0m
      labels:
        severity: critical
      annotations:
        summary: Jenkins no node online (instance {{ $labels.instance }})
        description: "No Jenkins nodes are online: `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"
    
    - alert: JenkinsHealthcheck
      expr: jenkins_health_check_score < 1
      for: 0m
      labels:
        severity: critical
      annotations:
        summary: Jenkins healthcheck (instance {{ $labels.instance }})
        description: "Jenkins healthcheck score: {{$value}}. Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"
    
    - alert: JenkinsOutdatedPlugins
      expr: sum(jenkins_plugins_withUpdate) by (instance) > 3
      for: 1d
      labels:
        severity: warning
      annotations:
        summary: Jenkins outdated plugins (instance {{ $labels.instance }})
        description: "{{ $value }} plugins need update\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"
    
    - alert: JenkinsBuildsHealthScore
      expr: default_jenkins_builds_health_score < 1
      for: 0m
      labels:
        severity: critical
      annotations:
        summary: Jenkins builds health score (instance {{ $labels.instance }})
        description: "Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"
    
    - alert: JenkinsRunFailureTotal
      expr: increase(jenkins_runs_failure_total[1h]) > 100
      for: 0m
      labels:
        severity: warning
      annotations:
        summary: Jenkins run failure total (instance {{ $labels.instance }})
        description: "Job run failures: ({{$value}}) {{$labels.jenkins_job}}. Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"
    
    - alert: JenkinsBuildTestsFailing
      expr: default_jenkins_builds_last_build_tests_failing > 0
      for: 0m
      labels:
        severity: warning
      annotations:
        summary: Jenkins build tests failing (instance {{ $labels.instance }})
        description: "Last build tests failed: {{$labels.jenkins_job}}. Failed build Tests for job `{{$labels.jenkins_job}}` on {{$labels.instance}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"
    
      # * RUNNING  -1 true  - The build had no errors.
      # * SUCCESS   0 true  - The build had no errors.
      # * UNSTABLE  1 true  - The build had some errors but they were not fatal. For example, some tests failed.
      # * FAILURE   2 false - The build had a fatal error.
      # * NOT_BUILT 3 false - The module was not built.
      # * ABORTED   4 false - The build was manually aborted.
    - alert: JenkinsLastBuildFailed
      expr: default_jenkins_builds_last_build_result_ordinal == 2
      for: 0m
      labels:
        severity: warning
      annotations:
        summary: Jenkins last build failed (instance {{ $labels.instance }})
        description: "Last build failed: {{$labels.jenkins_job}}. Failed build for job `{{$labels.jenkins_job}}` on {{$labels.instance}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"

8.1. Metric plugin (8 rules)

wget https://raw.githubusercontent.com/samber/awesome-prometheus-alerts/refs/heads/master/dist/rules/jenkins/metric-plugin.yml

critical

8.1.1. Jenkins node offline

At least one Jenkins node offline: `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})

- alert: JenkinsNodeOffline
  expr: jenkins_node_offline_value > 0
  for: 5m
  labels:
    severity: critical
  annotations:
    summary: Jenkins node offline (instance {{ $labels.instance }})
    description: "At least one Jenkins node offline: `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"

critical

8.1.2. Jenkins no node online

No Jenkins nodes are online: `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})

- alert: JenkinsNoNodeOnline
  expr: jenkins_node_online_value == 0
  for: 0m
  labels:
    severity: critical
  annotations:
    summary: Jenkins no node online (instance {{ $labels.instance }})
    description: "No Jenkins nodes are online: `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"

critical

8.1.3. Jenkins healthcheck

Jenkins healthcheck score: {{$value}}. Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})

- alert: JenkinsHealthcheck
  expr: jenkins_health_check_score < 1
  for: 0m
  labels:
    severity: critical
  annotations:
    summary: Jenkins healthcheck (instance {{ $labels.instance }})
    description: "Jenkins healthcheck score: {{$value}}. Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"

warning

8.1.4. Jenkins outdated plugins

{{ $value }} plugins need update

- alert: JenkinsOutdatedPlugins
  expr: sum(jenkins_plugins_withUpdate) by (instance) > 3
  for: 1d
  labels:
    severity: warning
  annotations:
    summary: Jenkins outdated plugins (instance {{ $labels.instance }})
    description: "{{ $value }} plugins need update\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"

critical

8.1.5. Jenkins builds health score

Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})

- alert: JenkinsBuildsHealthScore
  expr: default_jenkins_builds_health_score < 1
  for: 0m
  labels:
    severity: critical
  annotations:
    summary: Jenkins builds health score (instance {{ $labels.instance }})
    description: "Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"

warning

8.1.6. Jenkins run failure total

Job run failures: ({{$value}}) {{$labels.jenkins_job}}. Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})

- alert: JenkinsRunFailureTotal
  expr: increase(jenkins_runs_failure_total[1h]) > 100
  for: 0m
  labels:
    severity: warning
  annotations:
    summary: Jenkins run failure total (instance {{ $labels.instance }})
    description: "Job run failures: ({{$value}}) {{$labels.jenkins_job}}. Healthcheck failure for `{{$labels.instance}}` in realm {{$labels.realm}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"

warning

8.1.7. Jenkins build tests failing

Last build tests failed: {{$labels.jenkins_job}}. Failed build Tests for job `{{$labels.jenkins_job}}` on {{$labels.instance}}/{{$labels.env}} ({{$labels.region}})

- alert: JenkinsBuildTestsFailing
  expr: default_jenkins_builds_last_build_tests_failing > 0
  for: 0m
  labels:
    severity: warning
  annotations:
    summary: Jenkins build tests failing (instance {{ $labels.instance }})
    description: "Last build tests failed: {{$labels.jenkins_job}}. Failed build Tests for job `{{$labels.jenkins_job}}` on {{$labels.instance}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"

warning

8.1.8. Jenkins last build failed

Last build failed: {{$labels.jenkins_job}}. Failed build for job `{{$labels.jenkins_job}}` on {{$labels.instance}}/{{$labels.env}} ({{$labels.region}})

  # * RUNNING  -1 true  - The build had no errors.
  # * SUCCESS   0 true  - The build had no errors.
  # * UNSTABLE  1 true  - The build had some errors but they were not fatal. For example, some tests failed.
  # * FAILURE   2 false - The build had a fatal error.
  # * NOT_BUILT 3 false - The module was not built.
  # * ABORTED   4 false - The build was manually aborted.
- alert: JenkinsLastBuildFailed
  expr: default_jenkins_builds_last_build_result_ordinal == 2
  for: 0m
  labels:
    severity: warning
  annotations:
    summary: Jenkins last build failed (instance {{ $labels.instance }})
    description: "Last build failed: {{$labels.jenkins_job}}. Failed build for job `{{$labels.jenkins_job}}` on {{$labels.instance}}/{{$labels.env}} ({{$labels.region}})\n  VALUE = {{ $value }}\n  LABELS = {{ $labels }}"

More in CI/CD

ArgoCD FluxCD GitLab CI Spinnaker