Data Science Virtual Machine
Data Science Virtual Machine (DSVM) is a preconfigured cloud server with an operating system and pre-installed tools for machine learning (ML) developers and data analysts.
The image from which the server is deployed contains:
-
drivers required for working with graphics processors (GPU).
Before creating a server, please read the software license agreements included in the image.
Pre-installed tools
- Python (version 3.10);
- pip;
- PyTorch;
- TensorFlow;
- JupyterLab;
- Jupyter Notebook;
- Keras;
- scikit-learn;
- NumPy;
- SciPy;
- pandas;
- NLTK;
- OpenCV;
- CatBoost;
- XGBoost;
- LightGBM.
Functional capabilities
- developing applications for chatbots, recommendation services, object recognition in photos and videos, speech synthesis and recognition, and forecasting services;
- training ML models;
- performing data experiments.
Minimum resource requirements
Getting started with DSVM
1. Create a cloud server with DSVM
-
In the Control panel, on the top menu, click Products and select AI Marketplace.
-
Click Create server.
-
Fill in the blocks:
- Name and placement;
- Source;
- GPU;
- Configuration;
- Disks;
- Network;
- optional: Access;
- optional: Additional settings;
- optional: Automation.
-
Check the server price.
-
Click Create server.
Name and placement
-
Enter the server name.
-
Select a location where the server will be created. The available GPU list depends on the location. You cannot change the location after the server is created.
Source
Select an image Data Science VM (Ubuntu 22.04 LTS 64-bit).
GPU
-
Click Add GPU.
-
Select the GPU type. When choosing a GPU, consider the minimum resource requirements for the image. GPU specifications and descriptions can be found in the Graphics Processors (GPU).
-
Specify the number of GPUs.
After the server is created, you will be able to change the GPU type and quantity or delete the GPU. Learn more in the Change Cloud Server Configuration.
Configuration
-
Specify the number of vCPUs.
-
Specify the RAM size.
After the server is created, you will be able to change the configuration.
Disks
-
Select the boot disk type. GPUs are not available when using a local disk as a boot disk.
-
Specify the disk size in GB or TB. The maximum size for all network volumes is 10 240 GB (10 TB), for a local disk — 1 256 GB (1 TB).
-
If you selected the SSD Universal v2 or SSD Fast v2 disk type, specify the total number of read and write operations in IOPS. After the volume is created, you can change the IOPS value by increasing or decreasing it. The number of IOPS changes is unlimited.
-
Optional: to add additional disks:
4.1. Click Add volume.
4.2. Select the volume type.
4.3. Specify the disk size in GB or TB. The maximum size for all network volumes is 10 240 GB (10 TB), for a local disk — 1 256 GB (1 TB).
4.4. If you selected the SSD Universal v2 or SSD Fast v2 disk type, specify the total number of read and write operations in IOPS. After the volume is created, you can change the IOPS value — decrease or increase it. The number of IOPS changes is unlimited.
After the server is created, you will be able to detach additional volumes from it or attach new ones.
Network
You can add the server to a new or existing subnet. The subnet can be:
- private without internet access. You will not be able to connect to the server from the internet, including via SSH or RDP;
- private with a single public IP address. A static public IP address connects to the private server address via a cloud router. The server will be accessible from the internet via this public IP address;
- public, where all addresses are accessible from the internet.
Private subnetwork without internet access
Private subnetwork with a public IP address
Public subnetwork
-
To add a server to an existing private subnet:
1.1. In the Subnet field, select an existing subnet.
1.2. Optional: change the default private IP address of the server.
-
To create a new private subnet:
2.1. In the Subnet field, select the Private subnet type.
2.2. Optional: change the subnetwork CIDR.
2.3. Optional: enable the DHCP toggle. Learn more about the DHCP protocol in the Selectel blog article Principles of the DHCP Protocol.
2.4. Optional: change the default gateway IP address.
2.5. Optional: change the network in which the subnet will be created — you can select an existing network or create a new one. If you are creating a new network, enter the network name.
Optional: Access
-
In the Password for «root» field:
1.1. Copy the password for the
rootuser — the user with unrestricted system privileges.1.2. Save the password in a secure place and do not share it in plain text.
-
Add an SSH key for the project to the server for secure connection:
2.1. Если SSH-ключ не добавлен in облачную платформу, нажмите, введите имя ключа, вставьте публичный ключ in формате OpenSSH and нажмите Добавить.
2.2. Если SSH-ключ добавлен in облачную платформу, in поле SSH-ключ выберите существующий ключ.
Optional: Additional settings
-
Чтобы создать прерываемый сервер, отметьте чекбокс Прерываемый сервер.
-
If you are planning to create multiple servers and want to increase infrastructure fault tolerance, add the server to a placement group:
2.1. Чтобы создать новую группу, нажмите, введите имя группы and выберите политику размещения on разных хостах:
-
preferred — the system will try to place servers on different hosts. If there is no suitable host available when creating a server, it will be created on the same host;
-
mandatory — servers in the group must be located on different hosts. If there is no suitable host available when creating a server, the server will not be created.
2.2. Если группа создана, in поле Группа размещения выберите группу размещения.
-
-
To add additional information or filter servers in the list, add server tags. An image name tag is added automatically. To add a new tag, in the Tags field, enter the tag.
Optional: Automation
-
Чтобы добавить скрипт, который выполнится with помощью агента cloud-init при первом запуске операционной системы, in поле User data:
- open the Text tab and paste the script as text;
- or open the File tab and upload the script file.
Примеры скриптов and поддерживаемые форматы можно посмотреть in инструкции User data
2. Launch JupyterLab
-
Open the page
http://<ip_address>in your browser.Specify
<ip_address>— the public IP address of the cloud server. You can view it in the control panel: from the top menu, click Products → AI Marketplace → server page → Ports tab → in the port card, click next to the public IP address. -
Enter the password — the server UUID. It can be copied in the control panel: from the top menu, click Products → AI Marketplace → in the server menu, select Copy UUID.