Monitoring a Kafka cluster

Last update: October 05 2026Open in Markdown

In Kafka Managed Databases, you can track the status of the cluster.

To assess the overall state of the cluster, check its status.

For a more detailed analysis, you can:

• view cluster node status — as graphs in the control panel;
• export cluster node metrics in Prometheus format.

When analyzing charts, note that the time in the Control Panel corresponds to the time on your device and does not depend on the region where the cluster is located.

note

For example, you have created a cluster in Tashkent, in the uz-1 pool. The device from which you logged into the control panel has the Moscow time zone set. The time on the metrics charts will be displayed in the Moscow time zone.

View cluster status

1. In the control panel, in the top menu, click Products and select Managed Databases.

2. Open the Active tab.

3. View the status in the cluster row.

   ACTIVE	Cluster is available
   CREATING	Cluster is being created
   UPDATING	Cluster is being updated
   RESIZING	Cluster is scaling
   ERROR	An error occurred, create a ticket
   DISK FULL	The disk is full, the cluster is read-only. For the cluster to work in read-write mode, free up disk space or scale the cluster and select a configuration with a larger disk size
   DEGRADED	Some cluster nodes are unavailable
   DELETING	Cluster is being deleted

View cluster node status

1. In the control panel, in the top menu, click Products and select Managed Databases.
2. Open the Active tab.
3. Open the cluster page → Monitoring tab.
4. In the Cluster monitoring section, view the available cluster node metrics.

Cluster node metrics in the control panel

Memory	Memory used excluding operating system cache and buffers, in percent or gigabytes
vCPU	Percentage of cluster node core utilization
CPU iowait	Percentage of time the processor spent waiting for I/O operations
Disk	Used disk space as a percentage or in gigabytes. Includes the part of disk space reserved for system needs and unavailable for databases. Learn more about disk space reservation in the Disk space usage in Kafka cluster instructions
Load Average	Average system load over a period of time. It shows how many processes are being processed by the cluster cores. The indicator is presented as three values — for one minute, five minutes, and 15 minutes. These values should not exceed the number of cores on a node
OOM	Number of processes that terminated with an Out of Memory error due to lack of RAM
Disk load	Read and write speed in KB/s or number of read/write operations per second
Network load	Number of bits or packets sent and received via the network interface

Export metrics in Prometheus format

Historical information is not available for clusters — metrics are queried in real time only. The list of all metrics supported in managed databases and their descriptions can be found in the Prometheus format metrics table.

1. Get a token.
2. Get metrics in Prometheus format.

1. Get a token

The token provides access to metrics of all clusters of the project in one pool.

1. In the control panel, in the top menu, click Products and select Managed Databases.

2. Open the Active tab.

3. Open the cluster page → Monitoring tab.

4. In the Prometheus tokens section, click Create token. The token will be generated automatically.

5. Copy the token. To do this, in the token row, click .

2. Get metrics in Prometheus format

Configuration file

1. Add to the Prometheus configuration file:

   scrape_configs:
     - job_name: get-metrics-from-dbaas
       scrape_interval: 1m
       static_configs:
         - targets:
           - '<domain>'
       scheme: https
       authorization:
         type: Bearer
         credentials: <token>

   Specify:

   • <domain> — Managed Databases API domain. This is the part of the URL for accessing the API without https:// and /v1, for example ru-3.dbaas.selcloud.ru . The URL depends on the region and pool, which can be found in the Managed Databases subsection of the List of URLs instructions;
   • <token> — token that you copied when getting a token in step 5.

2. Open the page in your browser where Prometheus-format metrics will be available:

   http://<ip_address>:9090/targets

   Specify <ip_address> — the IP address where Prometheus is installed.

3. Set up monitoring and alerts for database clusters yourself.

CLI

1. Open the CLI.

2. To get metrics, send a request:

   curl -L "https://<domain>/metrics" -H "Authorization: Bearer <token>"

   Specify:

   • <domain> — Managed Databases API domain. This is the part of the URL for accessing the API without https:// and /v1, for example ru-3.dbaas.selcloud.ru . The URL depends on the region and pool, which can be found in the Managed Databases subsection of the List of URLs instructions;
   • <token> — token that you copied when getting a token in step 5.

   The available metrics in Prometheus format will appear in the response.

3. Set up monitoring and alerts for database clusters yourself.

Metrics in Prometheus format

Metrics in Prometheus format are provided for all clusters. A specific cluster can be found by the database cluster ID in the ds_id label.

dbaas_memory_percent	Memory used excluding operating system cache and buffers (RAM), in percent
dbaas_memory_bytes	Memory used excluding operating system cache and buffers (RAM), in bytes
dbaas_oom_count	Number of processes that terminated with an Out of Memory error due to lack of RAM
dbaas_cpu	vCPU usage on database cluster nodes, in percent
dbaas_cpu_iowait	I/O wait time, in percent
dbaas_disk_percent	Used disk space as a percentage. Includes the part of disk space reserved for system needs and unavailable for databases. Learn more about disk space reservation in the Disk space usage in Kafka cluster instructions
dbaas_disk_bytes	Used disk space in bytes. Includes the part of disk space reserved for system needs and unavailable for databases. Learn more about disk space reservation in the Disk space usage in Kafka cluster instructions
dbaas_disk_read_iops	Number of read operations per second
dbaas_disk_write_iops	Number of write operations per second
dbaas_disk_read_bytes	Disk read speed, in bytes per second
dbaas_disk_write_bytes	Disk write speed, in bytes per second
dbaas_node_load1	Average system load over one minute. Shows how many processes are being handled by cluster cores
dbaas_node_load5	Average system load over five minutes. Shows how many processes are being handled by cluster cores
dbaas_node_load15	Average system load over 15 minutes. Shows how many processes are being handled by cluster cores
dbaas_network_receive_bytes	Number of bytes received via the network interface
dbaas_network_transmit_bytes	Number of bytes sent via the network interface
dbaas_network_receive_packets	Number of packets received via the network interface per second
dbaas_network_transmit_packets	Number of packets sent via the network interface per second
dbaas_role	Node role: 0 — role is unknown; 1 — master; 2 — replica