Scale inference service

Last update: October 13 2026Open in Markdown

To make optimal use of inference service resources, you can scale it depending on the workload:

• set a fixed number of inference instances — deployed model instances. For example, increase the number of inference instances when the number of requests grows or decrease it if the number of requests drops;

• or configure autoscaling. The number of inference instances will automatically adjust within the specified range depending on the number of requests and their processing time.

To scale an inference service, change the number of inference instances.

Change the number of inference instances

You can use a fixed number of inference instances or configure autoscaling.

Fixed number

1. In the control panel in the top menu, click Products and select Inference Services.

2. Open the inference service page → Service tab.

3. In the Service autoscaling block, click Edit.

4. Open the Fixed tab and specify the number of inference instances.

5. Click Save. Changing the scaling settings may take more than 10 minutes. During this time, the inference service will be unavailable.

Autoscaling

1. In the control panel in the top menu, click Products and select Inference Services.

2. Open the inference service page → Service tab.

3. In the Service autoscaling block, click Edit.

4. Open the With autoscaling tab and set the minimum and maximum number of inference instances. The number of inference instances will automatically change within the specified range depending on the number of requests to the model and their processing time.

5. Click Save. Changing the scaling settings may take more than 10 minutes. During this time, the inference service will be unavailable.