Skip to main content

Cloud for Hive Metastore Product Overview

For your information

The product is currently in public preview. During the public preview period:

  • the product is provided free of charge;
  • no SLA applies;
  • service availability is not guaranteed;
  • financial compensation for downtime or failures is not provided.

We will notify you of any changes in terms in advance.

Cloud for Hive Metastore is a service for deploying and managing clusters with Hive Metastore on the Selectel Cloud Platform. Hive Metastore allows you to store and manage metadata about schemas, tables, and data locations across various sources. Learn more about Hive Metastore in the official Apache Hive documentation.

The locations where you can create Hive Metastore clusters are listed in the Cloud for Hive Metastore location availability instructions.

To work with Hive Metastore clusters, user roles and types, projects, and project limits and quotas are supported.

Versions

Hive Metastore clusters support version 4.2.0.

Use cases

  • centralized storage of metadata about schemas, tables, and data locations in storages;
  • providing a single catalog for analytics and compute tools: Trino, Spark, Flink, Doris, and others;
  • data schema management: creating, modifying, and deleting tables, views, and partitions;
  • storing metadata about tables in lakehouse formats: Iceberg, Delta Lake, Hudi;
  • use in data platforms alongside Managed Databases, S3, Cloud for Trino, Cloud for Redash.

How it works

A Hive Metastore cluster consists of:

  • Hive Metastore, which provides an API for working with metadata;

  • a PostgreSQL database where metadata is stored.

To get started, create a cluster in the control panel.

When creating a cluster, you select Hive Metastore and PostgreSQL configurations. Fixed configurations with a balanced vCPU:RAM resource allocation are available. If these configurations do not fit your needs, you can order a custom configuration. To do this, submit a ticket and specify the resource ratio.

S3-compatible storage is used to store data described by Hive Metastore. You can use Selectel S3. Bucket connection is only available with the vHosted addressing type.

A Hive Metastore cluster can only be connected to a private subnet — without internet access. From the cluster, you can connect to data storages both in a private subnet and over the internet. The Thrift and REST protocols are supported for connection. Learn more in the Connect to a Hive Metastore cluster instructions.

How to work with a Hive Metastore cluster

After creating a cluster, you can:

Areas of responsibility

Selectel provides

  • selecting hardware for high performance of Hive Metastore clusters;
  • installation and standard configuration of Hive Metastore;
  • updating and maintaining the operating system and service software;
  • configuring and maintaining the service network in the cluster;
  • availability of resources for scaling the cluster if you initiated scaling;
  • technical support.

Selectel is not responsible for

  • the availability and performance of external data sources;
  • having the required access permissions for data sources;
  • the efficiency of written SQL queries;
  • the content and correctness of data in visualizations, dashboards, and reports;
  • changing the Hive Metastore cluster configuration in accordance with the workload profile;
  • initiating cluster scaling.

Pricing

During the public preview period, Cloud for Hive Metastore is provided free of charge. In the future, the service will become paid — we will notify you of the changes in terms in advance.

Limitations

Selectel sets an account limit and a project limit, as well as resource quotas. Learn more in the Quotas and limits instructions.

In Hive Metastore clusters, you can only select fixed configurations; custom selection of vCPU and RAM is not available. If these configurations do not fit your needs, you can order a custom configuration. To do this, submit a ticket and specify the resource ratio.