critical
2.15.1.CouchDB node down
CouchDB node is not responding (node_up metric is 0) for more than 2 minutes
- alert: CouchdbNodeDown
expr: 'couchdb_httpd_node_up == 0 or couchdb_httpd_up == 0'
for: 2m
labels:
severity: critical
annotations:
summary: CouchDB node down (instance {{ $labels.instance }})
description: "CouchDB node is not responding (node_up metric is 0) for more than 2 minutes\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.2.CouchDB atom memory usage critical
Atom memory usage is above 90% of limit
- alert: CouchdbAtomMemoryUsageCritical
expr: 'couchdb_erlang_memory_atom_used > 0.9 * couchdb_erlang_memory_atom'
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB atom memory usage critical (instance {{ $labels.instance }})
description: "Atom memory usage is above 90% of limit\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.3.CouchDB open OS files critical
CouchDB is using more than 90% of allowed OS file descriptors, may fail to open new files
# Adjust 65535 to match your system's file descriptor limit (ulimit -n).
- alert: CouchdbOpenOsFilesCritical
expr: 'couchdb_httpd_open_os_files > 0.9 * 65535'
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB open OS files critical (instance {{ $labels.instance }})
description: "CouchDB is using more than 90% of allowed OS file descriptors, may fail to open new files\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.4.CouchDB file descriptors high
Process is using more than 85% of allowed file descriptors
- alert: CouchdbFileDescriptorsHigh
expr: 'process_open_fds / process_max_fds > 0.85 and process_max_fds > 0'
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB file descriptors high (instance {{ $labels.instance }})
description: "Process is using more than 85% of allowed file descriptors\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.5.CouchDB open databases critical
Number of open databases exceeds 90% of node capacity
# The default max_dbs_open is 500. Adjust the threshold (currently 0.9 * 1000) to match your max_dbs_open setting.
- alert: CouchdbOpenDatabasesCritical
expr: 'couchdb_httpd_open_databases > 0.9 * 1000'
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB open databases critical (instance {{ $labels.instance }})
description: "Number of open databases exceeds 90% of node capacity\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.6.CouchDB 5xx error ratio high
More than 5% of HTTP requests are returning 5xx errors
- alert: Couchdb5xxErrorRatioHigh
expr: 'rate(couchdb_httpd_status_codes{code=~"5.."}[5m]) / rate(couchdb_httpd_requests[5m]) > 0.05 and rate(couchdb_httpd_requests[5m]) > 0'
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB 5xx error ratio high (instance {{ $labels.instance }})
description: "More than 5% of HTTP requests are returning 5xx errors\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.7.CouchDB temporary view read rate critical
Temporary view read rate exceeds 100 reads/sec, high risk of performance degradation
# 100 reads/s is a rough default; depends on your application's query patterns — adjust based on your workload. Note temporary views are inherently inefficient in CouchDB regardless of rate; consider replacing them with permanent views.
- alert: CouchdbTemporaryViewReadRateCritical
expr: 'rate(couchdb_httpd_temporary_view_reads[5m]) > 100'
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB temporary view read rate critical (instance {{ $labels.instance }})
description: "Temporary view read rate exceeds 100 reads/sec, high risk of performance degradation\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.8.CouchDB Replicator manager died
Replication manager process has crashed
- alert: CouchdbReplicatorManagerDied
expr: 'increase(couchdb_replicator_changes_manager_deaths[5m]) > 0'
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator manager died (instance {{ $labels.instance }})
description: "Replication manager process has crashed\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.9.CouchDB Replicator queue process died
Replication queue process has crashed
- alert: CouchdbReplicatorQueueProcessDied
expr: 'increase(couchdb_replicator_changes_queue_deaths[5m]) > 0'
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator queue process died (instance {{ $labels.instance }})
description: "Replication queue process has crashed\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.10.CouchDB Replicator reader process died
Replication reader process has crashed
- alert: CouchdbReplicatorReaderProcessDied
expr: 'increase(couchdb_replicator_changes_reader_deaths[5m]) > 0'
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator reader process died (instance {{ $labels.instance }})
description: "Replication reader process has crashed\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.11.CouchDB Replicator failed to start
One or more replication tasks failed to start
- alert: CouchdbReplicatorFailedToStart
expr: 'increase(couchdb_replicator_failed_starts[5m]) > 0'
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator failed to start (instance {{ $labels.instance }})
description: "One or more replication tasks failed to start\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.12.CouchDB replication cluster unstable
The replication cluster is unstable, replication may be interrupted
- alert: CouchdbReplicationClusterUnstable
expr: 'couchdb_replicator_cluster_is_stable == 0'
for: 2m
labels:
severity: critical
annotations:
summary: CouchDB replication cluster unstable (instance {{ $labels.instance }})
description: "The replication cluster is unstable, replication may be interrupted\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.13.CouchDB critical log entries
Critical or error log entries detected in the last 5 minutes
- alert: CouchdbCriticalLogEntries
expr: 'increase(couchdb_server_couch_log{level=~"error|critical"}[5m]) > 5'
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB critical log entries (instance {{ $labels.instance }})
description: "Critical or error log entries detected in the last 5 minutes\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.14.CouchDB Replicator jobs crashing
Replicator jobs are crashing, indicating replication tasks are failing unexpectedly.
- alert: CouchdbReplicatorJobsCrashing
expr: 'increase(couchdb_replicator_jobs{metric="crashes"}[5m]) > 0'
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator jobs crashing (instance {{ $labels.instance }})
description: "Replicator jobs are crashing, indicating replication tasks are failing unexpectedly.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.15.CouchDB Replicator connection owner crashing
Replicator HTTP connection owner processes are crashing, which can disrupt replication.
- alert: CouchdbReplicatorConnectionOwnerCrashing
expr: 'increase(couchdb_replicator_connections{metric="owner_crashes"}[5m]) > 0'
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator connection owner crashing (instance {{ $labels.instance }})
description: "Replicator HTTP connection owner processes are crashing, which can disrupt replication.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.16.CouchDB Replicator connection worker crashing
Replicator HTTP connection worker processes are crashing, which can disrupt replication.
- alert: CouchdbReplicatorConnectionWorkerCrashing
expr: 'increase(couchdb_replicator_connections{metric="worker_crashes"}[5m]) > 0'
for: 1m
labels:
severity: critical
annotations:
summary: CouchDB Replicator connection worker crashing (instance {{ $labels.instance }})
description: "Replicator HTTP connection worker processes are crashing, which can disrupt replication.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"critical
2.15.17.CouchDB request latency critical
Average CouchDB request time is above 1000ms, indicating severe performance degradation.
# 1000ms threshold is a rough default; normal request latency depends on your query complexity and dataset size — adjust based on your baseline.
- alert: CouchdbRequestLatencyCritical
expr: 'couchdb_httpd_request_time{metric="ArithmeticMean"} > 1000'
for: 5m
labels:
severity: critical
annotations:
summary: CouchDB request latency critical (instance {{ $labels.instance }})
description: "Average CouchDB request time is above 1000ms, indicating severe performance degradation.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.18.CouchDB Mango queries scanning too many docs
Some Mango queries are scanning too many documents, consider adding indexes
# 50/s is a rough default; depends on your query patterns and dataset size — adjust based on your workload, or add indexes to reduce full scans.
- alert: CouchdbMangoQueriesScanningTooManyDocs
expr: 'rate(couchdb_mango_too_many_docs_scanned[5m]) > 50'
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB Mango queries scanning too many docs (instance {{ $labels.instance }})
description: "Some Mango queries are scanning too many documents, consider adding indexes\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.19.CouchDB Mango queries failed due to invalid index
Some Mango queries failed to execute because the index was missing or invalid
- alert: CouchdbMangoQueriesFailedDueToInvalidIndex
expr: 'rate(couchdb_mango_query_invalid_index[5m]) > 5'
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB Mango queries failed due to invalid index (instance {{ $labels.instance }})
description: "Some Mango queries failed to execute because the index was missing or invalid\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.20.CouchDB Mango docs examined high
High number of documents examined per Mango queries, consider indexing
# 1000/s is a rough default; depends on your query patterns and dataset size — adjust based on your workload, or add indexes.
- alert: CouchdbMangoDocsExaminedHigh
expr: 'rate(couchdb_mango_docs_examined[5m]) > 1000'
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB Mango docs examined high (instance {{ $labels.instance }})
description: "High number of documents examined per Mango queries, consider indexing\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.21.CouchDB replication read failures
Replication changes feed has failed reads more than 5 times in 5 minutes
- alert: CouchdbReplicationReadFailures
expr: 'increase(couchdb_replicator_changes_read_failures[5m]) > 5'
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB replication read failures (instance {{ $labels.instance }})
description: "Replication changes feed has failed reads more than 5 times in 5 minutes\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.22.CouchDB 4xx error rate high
CouchDB returned more than 5 4xx HTTP responses in the last 5 minutes, which may indicate client-side issues such as bad requests, authentication failures, or document conflicts.
- alert: Couchdb4xxErrorRateHigh
expr: 'increase(couchdb_httpd_status_codes{code=~"4.."}[5m]) > 5'
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB 4xx error rate high (instance {{ $labels.instance }})
description: "CouchDB returned more than 5 4xx HTTP responses in the last 5 minutes, which may indicate client-side issues such as bad requests, authentication failures, or document conflicts.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.23.CouchDB Replicator jobs pending
More than 10 replicator jobs are pending, which may mean replication is falling behind.
# 10 is a rough default; replication backlog scales with your replication workload and network — adjust based on your baseline.
- alert: CouchdbReplicatorJobsPending
expr: 'couchdb_replicator_jobs{metric="pending"} > 10'
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB Replicator jobs pending (instance {{ $labels.instance }})
description: "More than 10 replicator jobs are pending, which may mean replication is falling behind.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"warning
2.15.24.CouchDB request latency high
Average CouchDB request time is above 500ms, indicating degraded performance.
# 500ms threshold is a rough default; normal request latency depends on your query complexity and dataset size — adjust based on your baseline.
- alert: CouchdbRequestLatencyHigh
expr: 'couchdb_httpd_request_time{metric="ArithmeticMean"} > 500'
for: 5m
labels:
severity: warning
annotations:
summary: CouchDB request latency high (instance {{ $labels.instance }})
description: "Average CouchDB request time is above 500ms, indicating degraded performance.\n VALUE = {{ $value }}\n LABELS = {{ $labels }}"