Metrics Reference
This instruction describes the product metrics collected by the service.
The list of products that support metrics will be expanded.
Dedicated Servers
The dedicated servers namespace is dedicated.
Monitoring is supported by servers with a KVM console, which is available for every dedicated server, except servers of the Chipcore product line and servers in a dedicated rack — for details, see the Servers in a dedicated rack page on selectel.ru.
The set of IPMI metrics may differ depending on the server model.
Each metric includes a timestamp — the metric collection time. You can convert the value using online services, for example, on the unixtimestamp.com website.
| Metric name Type, unit of measurement | Description | Labels |
|---|---|---|
| ipmi_bmc_info Gauge, UNIT | BMC (Baseboard Management Controller) metadata — firmware, manufacturer, and more. The metric value is always 1 |
|
| up Gauge, bool | Check metric source availability:
|
|
| ipmi_up Gauge, bool | Check IPMI availability:
|
|
| ipmi_scrape_duration_seconds Gauge, seconds | Time taken to collect IPMI exporter metrics |
|
| ipmi_sel_events_count_by_state Gauge, count | Number of events from the SEL (System Event Log) journal, grouped by event severity level |
|
| ipmi_chassis_cooling_fault_state Gauge, bool | Server cooling system state:
|
|
| ipmi_chassis_drive_fault_state Gauge, bool | Drive state:
|
|
| ipmi_chassis_power_state Gauge, bool | Server power state:
|
|
| ipmi_fan_speed_state Gauge, enum | Fan state:
|
|
| ipmi_power_state Gauge, enum | Server component power state:
|
|
| ipmi_temperature_state Gauge, enum | Server component temperature state:
|
|
| ipmi_voltage_state Gauge, enum | Voltage state:
|
|
| ipmi_sensor_state Gauge, enum | Server component state:
|
|
| ipmi_fan_speed_rpm Gauge, RPM | Fan rotation speed |
|
| ipmi_power_watts Gauge, watts | Power consumption |
|
| ipmi_temperature_celsius Gauge, degrees °C | Server component temperature |
|
| ipmi_voltage_volts Gauge, volts | Voltage |
|
| ipmi_sensor_value Gauge | Data from the IPMI sensor. The unit of measurement depends on the sensor type |
|
Cloud servers
The cloud servers namespace is compute.
Metrics are collected at the hypervisor level. Metrics from the hypervisor side and metrics inside the cloud server OS may differ in values:
- hypervisor metrics reflect the physical state of cloud servers and their resources — CPU, memory, disks, and network, including disk and network operation maintenance work and virtual machine service operations;
- in-OS metrics reflect only computations seen by the OS kernel and do not take background work into account.
Under high disk or network load, metric values may differ — this is expected behavior for a virtualized environment, not a metric collection error.
Metric collection does not depend on the OS state. Metrics are collected even if the cloud server is booting, is under heavy load, or is not responding over the network. Metrics are not collected only when the cloud server is powered off.
| Metric name Type, unit of measurement | Description | Labels |
|---|---|---|
| server_meta_info Gauge, UNIT | Cloud server metadata |
|
| server_state_info Gauge, UNIT | Current cloud server status:
|
|
| cpu_count Gauge, count | Number of cloud server vCPUs |
|
| vcpu_usage_ratio Gauge, % | Utilization of each cloud server vCPU in % |
|
| cpu_usage_ratio Gauge, % | Cloud server CPU utilization in % |
|
| memory_total_bytes Gauge, bytes | Cloud server memory size |
|
| memory_usage_bytes Gauge, bytes | Memory size used by the cloud server |
|
| memory_usage_ratio Gauge, % | percentage of RAM used by the cloud server |
|
| memory_major_faults_total Counter, count | Number of major page faults (major page faults) that have occurred on the cloud server since its last startup |
|
| disk_meta_info Gauge, UNIT | Cloud server disk metadata |
|
| disk_write_requests_rate Gauge, operations/s | Number of write operations per second on the cloud server disk |
|
| disk_read_requests_rate Gauge, operations/s | Number of read operations per second from the cloud server disk |
|
| disk_read_requests_limit Gauge, operations/s | Maximum number of read operations for the cloud server disk |
|
| disk_write_requests_limit Gauge, operations/s | Maximum number of write operations for the cloud server disk |
|
| disk_flush_requests_rate Gauge, ops/s | Number of disk cache flush operations for the cloud server disk |
|
| disk_read_bytes_rate Gauge, bytes/s | Number of bytes per second read from the cloud server disk |
|
| disk_write_bytes_rate Gauge, bytes/s | Number of bytes per second written to the cloud server disk |
|
| network_meta_info Gauge, UNIT | Cloud server network interface metadata |
|
| network_receive_packets_rate Gauge, packets/s | Number of packets per second received on the cloud server network interface |
|
| network_transmit_packets_rate Gauge, packets/s | Number of packets per second transmitted through the cloud server network interface |
|
| network_receive_bits_rate Gauge, bits/s | Number of bits per second received on the cloud server network interface |
|
| network_transmit_bits_rate Gauge, bits/s | Number of bits per second sent through the cloud server network interface |
|
Dedicated Inference
Dedicated Inference namespace — inference.
| Metric name Type, unit of measurement | Description | Labels |
|---|---|---|
| info Gauge, UNIT | Inference service metadata. The metric value is always 1 |
|
| config_info Gauge, UNIT | Configuration of the inference service. The metric value is always 1 |
|
| autoscaling_config_info Gauge, UNIT | Autoscaling settings of the inference service. The metric value is always 1 |
|
| model_config_info Gauge, UNIT | Inference service model configuration. The metric value is always 1 |
|
| vllm_cache_config_info Gauge, UNIT | vLLM engine KV cache settings. The metric value is always 1 |
|
| vllm_kv_cache_usage_perc Gauge, fraction | Fraction of used KV cache blocks (from 0 to 1) |
|
| vllm_prefix_cache_hits_total Gauge, pcs | Number of prefix cache hits |
|
| vllm_prefix_cache_queries_total Gauge, pcs | Number of queries to the prefix cache |
|
| vllm_prompt_tokens_total Gauge, tokens | Total number of prompt tokens processed by the model |
|
| vllm_generation_tokens_total Gauge, tokens | Total number of generated tokens |
|
| vllm_num_requests_running Gauge, pcs | Number of requests currently being processed by the model |
|
| vllm_num_requests_waiting Gauge, pcs | Number of requests waiting in the queue |
|
| vllm_request_success_total Gauge, pcs | Number of successfully processed requests |
|
| vllm_engine_sleep_state Gauge, bool | Inference instance load state. The metric exports three lines at once — one line for each value of the
|
|
| vllm_e2e_request_latency_seconds Histogram, seconds | Request processing latency from receiving the prompt to full completion of the response (end-to-end) |
|
| vllm_request_queue_time_seconds Histogram, seconds | Request wait time in the queue |
|
| vllm_request_prefill_time_seconds Histogram, seconds | Processing time of the input prompt |
|
| vllm_request_decode_time_seconds Histogram, seconds | Response generation time for a request |
|
| vllm_request_inference_time_seconds Histogram, seconds | Total prompt processing and response generation time |
|
| vllm_request_time_per_output_token_seconds Histogram, seconds | Average time to generate each token |
|
| vllm_time_to_first_token_seconds Histogram, seconds | Time from receiving the request to generating the first token |
|
| vllm_inter_token_latency_seconds Histogram, seconds | Inter-token latency |
|
| vllm_request_prompt_tokens Histogram, tokens | Number of input tokens per request |
|
| vllm_request_generation_tokens Histogram, tokens | Number of generated tokens per request |
|
| vllm_iteration_tokens_total Histogram, tokens | Number of tokens processed by the model per iteration across all active requests |
|
| cpu_usage_cores Gauge, cores | Current CPU consumption by the inference instance |
|
| cpu_limit_cores Gauge, cores | Configured CPU limit for the inference instance |
|
| memory_usage_bytes Gauge, bytes | Current memory consumption by the inference instance |
|
| memory_limit_bytes Gauge, bytes | Configured memory limit for the inference instance |
|
| http_requests_total Gauge, pcs | Total number of HTTP requests to the inference service |
|
| http_requests_bytes_total Gauge, bytes | Total size of HTTP requests |
|
| http_responses_bytes_total Gauge, bytes | Total size of HTTP responses |
|
| network_receive_bytes_total Gauge, bytes/s | Number of bytes per second received by the inference instance |
|
| network_receive_packets_total Gauge, packets/s | Number of packets per second received by the inference instance |
|
| network_receive_packets_dropped_total Gauge, packets/s | Number of packets per second dropped on receive by the inference instance |
|
| network_transmit_bytes_total Gauge, bytes/s | Number of bytes per second transmitted by the inference instance |
|
| network_transmit_packets_total Gauge, packets/s | Number of packets per second transmitted by the inference instance |
|
| network_transmit_packets_dropped_total Gauge, packets/s | Number of packets per second dropped on transmit by the inference instance |
|