Create an inference service

Last update: July 21 2026

1. Select a model.
2. Configure the infrastructure.
3. Configure the inference service.
4. Confirm the configuration.

1. Select a model

1. In the control panel, in the top menu, click Products and select Foundation Models Catalog.

2. In the model card, click Create.

3. Enter an inference service name.

4. To filter inference services in the list, add tags. A tag with the model name is added automatically. To add a new tag, enter the tag in the Tags field and press Enter.

5. Optional: enter an inference service description. For example, specify its purpose.

6. Click Continue.

2. Configure the infrastructure

1. Set the model parameters.

   1.1. Select the data type for model parameters.

   1.2. Select the data type for the KV cache.

   1.3. Select the maximum context length.

2. Select an inference service configuration. When choosing, consider the expected model performance metrics.

   The configuration cannot be changed after the inference service is created.

3. Click Continue.

3. Configure the inference service

1. Configure the number of inference instances.

   1.1. To have a fixed number of instances in the service, open the Fixed tab and specify the number of instances.

   1.2. To use autoscaling in the service, open the Autoscaling tab and set the minimum and maximum number of instances. The number of instances will change automatically only within the specified range depending on the load on the inference service.

   You can change the number of inference instances after the inference service is created. For more information, see the Scaling an inference service.

2. Select the disk type for the inference instance.

3. Click Continue.

4. Confirm the configuration

1. Review the final inference service configuration.

2. Check the price of the inference service.

3. Click Create Inference Service. Creating an inference service may take approximately 15 minutes.