Data Analytics Virtual Machine
Data Analytics Virtual Machine (DAVM) is a preconfigured cloud server with an operating system and pre-installed tools for data analysis and machine learning (ML).
The image from which the server is deployed contains:
-
Docker, a platform for running containerized applications;
-
Docker Compose — a tool for running multi-container applications in Docker;
-
drivers required for working with graphics processing units (GPU).
After creating a DAVM, detailed instructions for working with JupyterLab, Prefect, Apache Superset, Keycloak, PyTorch, TensorFlow, and code examples will be available in Jupyter Notebooks.
Before creating a server, review the software license agreements included in the image.
Preinstalled tools
- JupyterLab (version 3.6.3) — a unified development environment for working with Jupyter Notebooks, programming code, and data;
- Prefect (version 2.10.16) — software for managing data collection, monitoring, and batch processing tasks;
- Apache Superset (version 3.0.0) — a web application for visualization, reporting, and dashboard creation;
- PostgreSQL — an object-relational database management system;
- a set of machine learning libraries: TensorFlow, PyTorch and others. You can view them in the Library versions table.
Use cases
- development and training of ML models;
- building data processing workflows (ETL/ELT);
- data visualization (BI).
Minimum resource requirements
Getting started with DAVM
1. Create a cloud server with DAVM
-
In the Control panel, on the top menu, click Products and select AI Marketplace.
-
Click Create server.
-
Fill in the blocks:
- Name and placement;
- Source;
- GPU;
- Configuration;
- Disks;
- Network;
- optional: Access;
- optional: Additional settings;
- optional: Automation.
-
Check the server price.
-
Click Create server.
Name and placement
-
Enter the server name.
-
Select a location where the server will be created. The available GPU options depend on the location. You cannot change the location after the server is created.
Source
Select an image Data Analytics VM (Ubuntu 22.04 LTS 64-bit).
GPU
-
Click Add GPU.
-
Select a GPU type. When choosing a GPU, consider the minimum resource requirements for the image to run. GPU specifications and descriptions can be found in the Graphics Processing Units (GPU) guide.
-
Specify the number of GPUs.
After the server is created, you will be able to change the GPU type and quantity or remove the GPU. Read more in the Change Cloud Server Configuration guide.
Configuration
-
Specify the number of vCPUs.
-
Specify the RAM size.
After the server is created, you will be able to change the configuration.
Disks
-
Select a boot disk type. GPUs are not available when using a local disk as a boot disk.
-
Specify the disk size in GB or TB. The maximum size for all network volumes is 10 240 GB (10 TB), for a local disk — 1 256 GB (1 TB).
-
If you have selected SSD Universal v2 or SSD Fast v2 as the disk type, specify the total number of read and write operations in IOPS. After the disk is created, you can change the number of IOPS — decrease or increase them. There is no limit on the number of IOPS changes.
-
Optional: to add additional disks:
4.1. Click Add volume.
4.2. Select the volume type.
4.3. Specify the disk size in GB or TB. The maximum size for all network volumes is 10 240 GB (10 TB), for a local disk — 1 256 GB (1 TB).
4.4. If you have selected SSD Universal v2 or SSD Fast v2 as the disk type, specify the total number of read and write operations in IOPS. After the disk is created, you can change the number of IOPS — decrease or increase it. The number of IOPS changes is unlimited.
After the server is created, you will be able to detach additional volumes from it or attach new ones.
Network
You can add a server to a new or existing subnet. The subnet can be:
- private, without internet access. You will not be able to connect to the server from the internet, including via SSH or RDP;
- private with one public IP address. A static public IP address connects to the server’s private address via a cloud router. The server will be accessible from the internet via this public IP address;
- public, where all addresses are accessible from the internet.
Private subnetwork without internet access
Private subnetwork with a public IP address
Public subnetwork
-
To add an existing private subnetwork:
1.1. In the Subnet field, select an existing subnet.
1.2. Optional: change the default private IP address of the server.
-
To add a new private subnetwork:
2.1. In the Subnet field, select the Private subnet type.
2.2. Optional: change the subnetwork CIDR.
2.3. Optional: enable the DHCP toggle. Read more about the DHCP protocol in the Selectel blog article Principles of the DHCP Protocol.
2.4. Optional: change the default gateway IP address.
2.5. Optional: change the network in which the subnet will be created — you can select an existing network or create a new one. If you are creating a new network, enter a network name.
Optional: Access
-
In the Password for «root» field:
1.1. Copy the password for the
rootuser — the user with unrestricted system privileges.1.2. Save the password in a secure place and do not share it in plain text.
-
Add an SSH key for the project to the server for secure connection:
2.1. If the SSH key is not added to the cloud platform, click , enter the key name, paste the public key in OpenSSH format, and click Add.
2.2. If the SSH key is added to the cloud platform, in the SSH key field, select an existing key.
Optional: Additional settings
-
To create a preemptible server, check the Preemptible server checkbox.
-
If you are planning to create several servers and want to increase infrastructure fault tolerance, add the server to a placement group:
2.1. To create a new group, click , enter the group name and select a placement policy for different hosts:
-
preferred — the system will try to place servers on different hosts. If no suitable host is available when creating a server, it will be created on the same host;
-
mandatory — servers in the group are required to be located on different hosts. If no suitable host is available when creating a server, the server will not be created.
2.2. If the group is created, in the Placement group field, select a placement group.
-
-
To add additional information or filter servers in the list, add server tags. A tag with the image name is added automatically. To add a new tag, in the Tags field, enter the tag.
Optional: Automation
-
To add a script to be executed by the cloud-init agent during the first system boot, in the User data field:
- open the Text tab and paste the script as text;
- or open the File tab and upload the script file.
For examples of scripts and supported formats, see the User data guide.
2. Launch DAVM
-
Ensure that more than seven minutes have passed since the server was created — this time is required to deploy additional services and create DNS records.
-
Open the DAVM page in your browser. Use the link:
-
home-<ip_address>.pl.davm.selcloud.ruSpecify
<ip_address>— the public IP address of the cloud server; you can view it in the control panel: from the top menu, click Products → AI-marketplace → server page → Ports tab → in the port card, click next to the public IP address. In the IP address, replace the periods . with-, for example203-0-113-10; -
or the link from the operating system message that appears when connecting to the cloud server via the console in the control panel.
-
-
Log in to Keycloak. Use:
- login —
admin; - password — the server UUID. You can copy it in the Control Panel: in the top menu, click Products → AI Marketplace → in the server menu, select Copy UUID.
- login —
-
Enter a new password. Save it — if you lose the password, we will not be able to reset it.