Scale inference service

Last update: May 10 2026

To optimally utilize the resources of the inference service, you can scale it depending on the load:

• configure a fixed number of inference-instances - deployed instances of models.For example, increase the number of inference-instances when the number of queries increases or decrease if the number of queries decreases;

• or configure autoscaling.The number of inference-instances will automatically change in the specified range depending on the number of requests and their processing time.

To scale the inference service, change the number of inference instances.

Change the number of inference instances

You can use a fixed number of inference instances or set up autoscaling.

Fixed quantity

1. In the control panel, on the top menu, click Products and select Inference Services.

2. Open the inference service page → Service tab.

3. In the Service Auto Scaling block, click Edit.

4. Open the Fixed tab and specify the number of inference instances.

5. Click Save.Changing the zoom settings may take more than 10 minutes.During this time, the inference service will not be available.

Auto Scaling

1. In the control panel, on the top menu, click Products and select Inference Services.

2. Open the inference service page → Service tab.

3. In the Service Auto Scaling block, click Edit.

4. Open the Auto Scaling tab and set the minimum and maximum number of inference instances.The number of inference instances will automatically change within the specified range depending on the number of requests to the model and their processing time.

5. Click Save.Changing the zoom settings may take more than 10 minutes.During this time, the inference service will not be available.