S3 Product Description
S3 — Selectel service for storing and distributing unlimited amounts of unstructured and semi-structured data in one of the pools.
S3 is governed by terms of use and defaults to 152-FZ.
S3 can be connected in one of the pools.
User types and roles and projects are supported in the product.
How to work with S3
It is possible to work with S3:
- via S3 API, Swift API and Selectel Storage API. You can use various tools (Rclone, AWS CLI, s3cmd and others) to work through the API;
- via the FTP protocol. It uses Swift API to translate requests to S3;
- through the Selectel Control Panel, which makes requests to S3 via the Swift API and Selectel Storage API. The control panel has limitations for working with a large number of objects and with objects of large size;
- using Terraform.
Tasks to be solved
S3 is a versatile storage, it can be used for:
- static data distribution (site and application data), data streaming, etc. You can connect a CDN to speed up data distribution;
- to store backups and archives. You can set up scheduled server backups to migrate important data to S3;
- big data storage for machine learning and analytics;
- hosting static sites.
Principle of operation
S3 is based on a software-defined distributed storage system.Data is stored as objects and replicated to three independent servers that are located in different racks.
Objects are stored in buckets and inherit their settings.
S3 has a flat address structure — there are no folders or hierarchy in the repository, so you can quickly access objects over HTTP.
Each object in the repository contains:
- data;
- a unique identifier that is used by the hash function to determine the location of the object;
- metadata. You can add your own metadata to realize your own data storage and processing system.