critical
2.15.1.CouchDB node down
CouchDB node is not responding (node_up metric is 0) for more than 2 minutes
- alert: CouchDBNodeDown
expr: couchdb_httpd_node_up == 0 or couchdb_httpd_up == 0
for: 2m
labels:
severity: critical
annotations:
summary: CouchDB node down (instance {{ $labels.instance }})
description: "CouchDB node is not responding (node_up metric is 0) for more than 2 minutes\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.2.CouchDB atom memory usage critical
Atom memory usage is above 90% of limit
- alert: CouchDBAtomMemoryUsageCritical
expr: couchdb_erlang_memory_atom_used > 0.9 * couchdb_erlang_memory_atom
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB atom memory usage critical (instance {{ $labels.instance }})
description: "Atom memory usage is above 90% of limit\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.3.CouchDB open OS files critical
CouchDB is using more than 90% of allowed OS file descriptors, may fail to open new files
# Adjust 65535 to match your system's file descriptor limit (ulimit -n).
- alert: CouchDBOpenOSFilesCritical
expr: couchdb_httpd_open_os_files > 0.9 * 65535
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB open OS files critical (instance {{ $labels.instance }})
description: "CouchDB is using more than 90% of allowed OS file descriptors, may fail to open new files\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.4.CouchDB file descriptors high
Process is using more than 85% of allowed file descriptors
- alert: CouchDBFileDescriptorsHigh
expr: process_open_fds / process_max_fds > 0.85 and process_max_fds > 0
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB file descriptors high (instance {{ $labels.instance }})
description: "Process is using more than 85% of allowed file descriptors\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.5.CouchDB open databases critical
Number of open databases exceeds 90% of node capacity
# The default max_dbs_open is 500. Adjust the threshold (currently 0.9 * 1000) to match your max_dbs_open setting.
- alert: CouchDBOpenDatabasesCritical
expr: couchdb_httpd_open_databases > 0.9 * 1000
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB open databases critical (instance {{ $labels.instance }})
description: "Number of open databases exceeds 90% of node capacity\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.6.CouchDB 5xx error ratio high
More than 5% of HTTP requests are returning 5xx errors
- alert: CouchDB5xxErrorRatioHigh
expr: rate(couchdb_httpd_status_codes{code=~"5.."}[5m]) / rate(couchdb_httpd_requests[5m]) > 0.05 and rate(couchdb_httpd_requests[5m]) > 0
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB 5xx error ratio high (instance {{ $labels.instance }})
description: "More than 5% of HTTP requests are returning 5xx errors\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.7.CouchDB temporary view read rate critical
Temporary view read rate exceeds 100 reads/sec, high risk of performance degradation
# 100 reads/s is a rough default; depends on your application's query patterns — adjust based on your workload. Note temporary views are inherently inefficient in CouchDB regardless of rate; consider replacing them with permanent views.
- alert: CouchDBTemporaryViewReadRateCritical
expr: rate(couchdb_httpd_temporary_view_reads[5m]) > 100
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB temporary view read rate critical (instance {{ $labels.instance }})
description: "Temporary view read rate exceeds 100 reads/sec, high risk of performance degradation\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.8.CouchDB Replicator manager died
Replication manager process has crashed
- alert: CouchDBReplicatorManagerDied
expr: increase(couchdb_replicator_changes_manager_deaths[5m]) > 0
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator manager died (instance {{ $labels.instance }})
description: "Replication manager process has crashed\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.9.CouchDB Replicator queue process died
Replication queue process has crashed
- alert: CouchDBReplicatorQueueProcessDied
expr: increase(couchdb_replicator_changes_queue_deaths[5m]) > 0
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator queue process died (instance {{ $labels.instance }})
description: "Replication queue process has crashed\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.10.CouchDB Replicator reader process died
Replication reader process has crashed
- alert: CouchDBReplicatorReaderProcessDied
expr: increase(couchdb_replicator_changes_reader_deaths[5m]) > 0
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator reader process died (instance {{ $labels.instance }})
description: "Replication reader process has crashed\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.11.CouchDB Replicator failed to start
One or more replication tasks failed to start
- alert: CouchDBReplicatorFailedToStart
expr: increase(couchdb_replicator_failed_starts[5m]) > 0
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator failed to start (instance {{ $labels.instance }})
description: "One or more replication tasks failed to start\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.12.CouchDB replication cluster unstable
The replication cluster is unstable, replication may be interrupted
- alert: CouchDBReplicationClusterUnstable
expr: couchdb_replicator_cluster_is_stable == 0
for: 2m
labels:
severity: critical
annotations:
summary: CouchDB replication cluster unstable (instance {{ $labels.instance }})
description: "The replication cluster is unstable, replication may be interrupted\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.13.CouchDB critical log entries
Critical or error log entries detected in the last 5 minutes
- alert: CouchDBCriticalLogEntries
expr: increase(couchdb_server_couch_log{level=~"error|critical"}[5m]) > 5
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB critical log entries (instance {{ $labels.instance }})
description: "Critical or error log entries detected in the last 5 minutes\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.14.CouchDB Replicator jobs crashing
Replicator jobs are crashing, indicating replication tasks are failing unexpectedly.
- alert: CouchDBReplicatorJobsCrashing
expr: increase(couchdb_replicator_jobs{metric="crashes"}[5m]) > 0
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator jobs crashing (instance {{ $labels.instance }})
description: "Replicator jobs are crashing, indicating replication tasks are failing unexpectedly.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.15.CouchDB Replicator connection owner crashing
Replicator HTTP connection owner processes are crashing, which can disrupt replication.
- alert: CouchDBReplicatorConnectionOwnerCrashing
expr: increase(couchdb_replicator_connections{metric="owner_crashes"}[5m]) > 0
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator connection owner crashing (instance {{ $labels.instance }})
description: "Replicator HTTP connection owner processes are crashing, which can disrupt replication.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.16.CouchDB Replicator connection worker crashing
Replicator HTTP connection worker processes are crashing, which can disrupt replication.
- alert: CouchDBReplicatorConnectionWorkerCrashing
expr: increase(couchdb_replicator_connections{metric="worker_crashes"}[5m]) > 0
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator connection worker crashing (instance {{ $labels.instance }})
description: "Replicator HTTP connection worker processes are crashing, which can disrupt replication.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.17.CouchDB request latency critical
Average CouchDB request time is above 1000ms, indicating severe performance degradation.
# 1000ms threshold is a rough default; normal request latency depends on your query complexity and dataset size — adjust based on your baseline.
- alert: CouchDBRequestLatencyCritical
expr: couchdb_httpd_request_time{metric="ArithmeticMean"} > 1000
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB request latency critical (instance {{ $labels.instance }})
description: "Average CouchDB request time is above 1000ms, indicating severe performance degradation.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.18.CouchDB Mango queries scanning too many docs
Some Mango queries are scanning too many documents, consider adding indexes
# 50/s is a rough default; depends on your query patterns and dataset size — adjust based on your workload, or add indexes to reduce full scans.
- alert: CouchDBMangoQueriesScanningTooManyDocs
expr: rate(couchdb_mango_too_many_docs_scanned[5m]) > 50
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB Mango queries scanning too many docs (instance {{ $labels.instance }})
description: "Some Mango queries are scanning too many documents, consider adding indexes\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.19.CouchDB Mango queries failed due to invalid index
Some Mango queries failed to execute because the index was missing or invalid
- alert: CouchDBMangoQueriesFailedDueToInvalidIndex
expr: rate(couchdb_mango_query_invalid_index[5m]) > 5
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB Mango queries failed due to invalid index (instance {{ $labels.instance }})
description: "Some Mango queries failed to execute because the index was missing or invalid\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.20.CouchDB Mango docs examined high
High number of documents examined per Mango queries, consider indexing
# 1000/s is a rough default; depends on your query patterns and dataset size — adjust based on your workload, or add indexes.
- alert: CouchDBMangoDocsExaminedHigh
expr: rate(couchdb_mango_docs_examined[5m]) > 1000
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB Mango docs examined high (instance {{ $labels.instance }})
description: "High number of documents examined per Mango queries, consider indexing\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.21.CouchDB replication read failures
Replication changes feed has failed reads more than 5 times in 5 minutes
- alert: CouchDBReplicationReadFailures
expr: increase(couchdb_replicator_changes_read_failures[5m]) > 5
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB replication read failures (instance {{ $labels.instance }})
description: "Replication changes feed has failed reads more than 5 times in 5 minutes\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.22.CouchDB 4xx error rate high
CouchDB returned more than 5 4xx HTTP responses in the last 5 minutes, which may indicate client-side issues such as bad requests, authentication failures, or document conflicts.
- alert: CouchDB4xxErrorRateHigh
expr: increase(couchdb_httpd_status_codes{code=~"4.."}[5m]) > 5
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB 4xx error rate high (instance {{ $labels.instance }})
description: "CouchDB returned more than 5 4xx HTTP responses in the last 5 minutes, which may indicate client-side issues such as bad requests, authentication failures, or document conflicts.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.23.CouchDB Replicator jobs pending
More than 10 replicator jobs are pending, which may mean replication is falling behind.
# 10 is a rough default; replication backlog scales with your replication workload and network — adjust based on your baseline.
- alert: CouchDBReplicatorJobsPending
expr: couchdb_replicator_jobs{metric="pending"} > 10
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB Replicator jobs pending (instance {{ $labels.instance }})
description: "More than 10 replicator jobs are pending, which may mean replication is falling behind.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.24.CouchDB request latency high
Average CouchDB request time is above 500ms, indicating degraded performance.
# 500ms threshold is a rough default; normal request latency depends on your query complexity and dataset size — adjust based on your baseline.
- alert: CouchDBRequestLatencyHigh
expr: couchdb_httpd_request_time{metric="ArithmeticMean"} > 500
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB request latency high (instance {{ $labels.instance }})
description: "Average CouchDB request time is above 500ms, indicating degraded performance.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"