Create inference service

Last update: April 21 2026

1. Select a model.
2. Set up the infrastructure.
3. Set up an inference service.
4. Confirm the configuration.

1. Select a model

1. In the Control Panel, on the top menu, click Products and select Foundation Models Catalog.

2. In the model card, click Create.

3. Enter the name of the inference service.

4. To filter the inference services in the list, add tags. A tag with the model name is automatically added. To add a new tag, in the Tags field, type a tag and press Enter.

5. Optional: enter a description of the inference service. For example, specify its purpose.

6. Click Continue.

2. Set up the infrastructure

1. Set the parameters of the model.

   1.1 Select the data type of the model parameters.

   1.2 Select the data type for the KV cache.

   1.3 Select the maximum length of the context.

2. Select the inference service configuration. When selecting, consider the expected performance metrics of the model.

   Once an inference service has been created, the configuration cannot be changed.

3. Click Continue.

3. Configure the inference service

1. Configure the number of inference instances.

   1.1 To have a fixed number of instances in the service, open the Fixed tab and specify the number of instances.

   1.2 To use autoscaling in the service, open the With autoscaling tab and set the minimum and maximum number of instances. The number of instances will change automatically only within the specified range depending on the load on the inference service.

   You can change the number of inference instances after creating an inference service. For more information, see the Scaling an inference service instruction.

2. Select the type of disk for the inference-instance.

3. Click Continue.

4. Confirm configuration

1. Check the final configuration of the inference service.

2. Check the price of inference service.

3. Click Create Inference Service. Creating an inference service can take about 15 minutes.