Disk space utilization
The Kafka cluster disks store the topic data and system files needed to run the cluster.Approximately 4% of the disk space is reserved by the file system, with another 5 GB or so dedicated to the operating system, service components, and logs.The remaining space is available for Kafka data storage.
You can monitor disk occupancy using metrics.For more information about metrics, see the Kafka Cluster and Node Monitoring instructions. You can find out if you are about to run out of disk space by using a disk occupancy notification.You can free up disk space.
Disk fullness notifications
If the cluster disk is 80% full, a notification will appear in the dashboard and will be sent to the Account Owner's email and those users subscribed to the "Services and Services" notification category.
If the cluster disk is 95% full or more, the cluster will enter DISK_FULL
status and will be read-only.To make the cluster read-write, free up disk space or scale the cluster and select a configuration with a larger disk size.
Free up disk space
To free up disk space, you can:
Delete topic
- In the Dashboard, on the top menu, click Products and select Cloud Databases.
- Open the Active tab.
- Open the cluster page → Topics tab.
- From the menu of the topic, select Delete.
- Enter the name of the topic to confirm deletion.
- Click Delete.
Customize the data cleansing policy
After changing the log.retention.minutes
and log.retention.hours
parameters in the DBMS settings, the cluster will be restarted and will become unavailable for the restart time.
To speed up disk cleanup, change the storage policy in the cluster settings.Kafka will automatically delete data according to the new rules.
- In the Dashboard, on the top menu, click Products and select Cloud Databases.
- Open the Active tab.
- Open the cluster page → Settings tab.
- In the DBMS Settings block, click Edit.
- Specify new parameter values to customize the data cleansing policy.
- Click Save.