Monitoring a Kafka cluster

Last update: July 01 2026

In Kafka Managed Databases, you can track the status of the cluster.

To evaluate the overall status of the cluster, view its status.

For a more detailed analysis, you can:

• view the status of cluster nodes — as charts in the control panel;
• export cluster node metrics in Prometheus format.

When analyzing charts, note that the time in the Control Panel corresponds to the time on your device and does not depend on the region where the cluster is located.

note

For example, you have created a cluster in Tashkent, in the uz-1 pool. On the device from which you logged into the control panel, the Moscow time zone is set. The time on metrics charts will be displayed in the Moscow time zone.

View cluster status

1. In the control panel, on the top menu click Products and select Managed Databases.

2. Open the Active tab.

3. View the status in the cluster row.

   ACTIVE	Cluster is available
   CREATING	Cluster is being created
   UPDATING	Cluster is being updated
   RESIZING	Cluster is scaling
   ERROR	An error occurred, create a ticket
   DISK FULL	The disk is full, and the cluster is in read-only mode. To switch the cluster to read-write mode, free up disk space or scale the cluster and choose a configuration with a larger disk size
   DEGRADED	Some cluster nodes are unavailable
   DELETING	Cluster is being deleted

View cluster node status

1. In the control panel, on the top menu click Products and select Managed Databases.
2. Open the Active tab.
3. Open the cluster page → Monitoring tab.
4. In the Cluster monitoring block, view the available cluster node metrics.

Cluster node metrics in the control panel

Memory	Memory used excluding operating system cache and buffers, in percent or gigabytes
vCPU	Percentage of cluster node core utilization
CPU iowait	Percentage of time the processor spent waiting for I/O operations
Disk	Occupied disk space in percent or gigabytes. This accounts for a portion of disk space that is reserved for service needs and is unavailable for database placement. For more information about disk space reservation, see the Using disk space in a Kafka cluster instructions
Load Average	The average system load over a period of time. It shows the number of processes being processed by the cluster cores. The indicator is presented as three values — for one minute, five minutes, and 15 minutes. These values must not exceed the number of cores on the node
OOM	number of processes that finished with an Out of Memory error due to lack of RAM
Disk load	Read and write speed in KB/s or number of read/write operations per second
Network load	Number of bits or packets sent and received via the network interface

Export metrics in Prometheus format

Historical information is unavailable for clusters — metrics are requested only in real-time. A list of all metrics that are supported in managed databases and their description can be viewed in the Metrics in Prometheus format table.

1. Get a token.
2. Get metrics in Prometheus format.

1. Get a token

The token provides access to metrics for all clusters in a project in a single pool.

1. In the control panel, on the top menu click Products and select Managed Databases.

2. Open the Active tab.

3. Open the cluster page → Monitoring tab.

4. In the Prometheus tokens block, click Create token. The token will be generated automatically.

5. Copy the token. To do this, in the token row, click .

2. Get metrics in Prometheus format

Configuration file

1. Add to the Prometheus configuration file:

   scrape_configs:
     - job_name: get-metrics-from-dbaas
       scrape_interval: 1m
       static_configs:
         - targets:
           - '<domain>'
       scheme: https
       authorization:
         type: Bearer
         credentials: <token>

   Specify:

   • <domain> is the Managed Databases API domain. This is the part of the URL used to access the API without https:// and /v1, for example ru-3.dbaas.selcloud.ru. The URL depends on the region and pool, and can be found in the list of URLs;
   • <token> — the token you copied when getting the token in step 5.

2. Open the page in your browser where Prometheus-format metrics will be available:

   http://<ip_address>:9090/targets

   Specify <ip_address> — the IP address where Prometheus is installed.

3. Set up monitoring and alerts for database clusters yourself.

CLI

1. Open the CLI.

2. To get metrics, send a request:

   curl -L "https://<domain>/metrics" -H "Authorization: Bearer <token>"

   Specify:

   • <domain> is the Managed Databases API domain. This is the part of the URL used to access the API without https:// and /v1, for example ru-3.dbaas.selcloud.ru. The URL depends on the region and pool, and can be found in the list of URLs;
   • <token> — the token you copied when getting the token in step 5.

   The available metrics in Prometheus format will appear in the response.

3. Set up monitoring and alerts for database clusters yourself.

Metrics in Prometheus format

metrics in Prometheus format are provided for all clusters. A specific cluster can be found by the database cluster ID in the ds_id label.

dbaas_memory_percent	Memory used excluding operating system cache and buffers (RAM), in percent
dbaas_memory_bytes	Memory used excluding operating system cache and buffers (RAM), in bytes
dbaas_oom_count	number of processes that finished with an Out of Memory error due to lack of RAM
dbaas_cpu	vCPU usage on database cluster nodes, in percent
dbaas_cpu_iowait	I/O wait time, in percent
dbaas_disk_percent	Occupied disk space in percent. This accounts for a portion of disk space that is reserved for service needs and is unavailable for database placement. For more information about disk space reservation, see the Using disk space in a Kafka cluster instruction
dbaas_disk_bytes	Occupied disk space in bytes. This accounts for a portion of disk space that is reserved for service needs and is unavailable for database placement. For more information about disk space reservation, see the Using disk space in a Kafka cluster instruction
dbaas_disk_read_iops	Number of read operations per second
dbaas_disk_write_iops	Number of write operations per second
dbaas_disk_read_bytes	Disk read speed, in bytes per second
dbaas_disk_write_bytes	Disk write speed, in bytes per second
dbaas_node_load1	Average system load over one minute. Shows how many processes are being handled by cluster cores
dbaas_node_load5	Average system load over five minutes. Shows how many processes are being handled by cluster cores
dbaas_node_load15	Average system load over 15 minutes. Shows how many processes are being handled by cluster cores
dbaas_network_receive_bytes	Number of bytes received via the network interface
dbaas_network_transmit_bytes	Number of bytes sent via the network interface
dbaas_network_receive_packets	Number of packets received via the network interface per second
dbaas_network_transmit_packets	Number of packets sent via the network interface per second
dbaas_role	Node role: 0 — role unknown; ; 1 — master; ; 2 — replica