Skip to main content

Kafka cluster logs

Last update:

The Logi service is used for logging. For more information about the principle of operation and cost of the service, please refer to the instruction General information about the Logi service.To see the availability of the Logi service in the regions, please refer to the Logi availability matrix .

For the Kafka cloud database cluster, events are logged in the Kafka Controller and Kafka Broker components.

To collect cluster logs in the Logs service, enable logging. You can only get logs through the API.If you no longer need to collect logs, you can turn logging off.

Logs are stored for 14 days.

Enable logging

You can enable logging through the API or in the control panel:

Enable logging in an existing cluster

Logging uses a portion of the cluster's computational resources. To control the amount of resources consumed, monitor the cluster node metrics. Learn more about how to view metrics in the props.ArticleName instruction.

  1. In the Dashboard, on the top menu, click Products and select Cloud Databases.
  2. Open the Active tab.
  3. Open the cluster page → Settings tab.
  4. In the Logging block, in the Logging Service field, click Connect.
  5. Select a log group or create a new group.
  6. If you have selected a new group, enter its name.
  7. Click Save.

Get the logs

Use the Get Logs instructions in the Logs section.

Event streams kafka-controller.log-<instance_id> and kafka-broker.log-<instance_id>, where <instance _id > is the node ID of the Kafka cluster, have been created for the Kafka cloud database cluster.

See the description of the log fields for the Kafka cluster.

Log fields

_HOSTNAMECluster node name in dbaas format-<instance_id>, where <instance_id> is the identifier of the Kafka cluster node..
SYSLOG_IDENTIFIERLog source name
SYSLOG_TIMESTAMPEvent time in the log
MESSAGEDescription of the event that the log source transmitted

Disable logging

  1. In the Dashboard, on the top menu, click Products and select Cloud Databases.
  2. Open the Active tab.
  3. Open the cluster page → Settings tab.
  4. In the Logging block, in the Logging Service field, click .
  5. Uncheck the Collect cluster technical logs to log service checkbox.
  6. Click Save.