Creating a Hive Metastore cluster
Note
This feature is in the Preview stage.
To learn more about Metastore clusters in Yandex MetaData Hub, see Hive Metastore clusters.
Getting started:
Next, create a cluster.
Configure a network
Set up a NAT gateway in the subnet the cluster will connect to. It is needed for the cluster to interact with Yandex Cloud services.
Configure security groups
If the cloud network uses security groups, they can hinder the cluster's operation. Set up the default security group to work with Metastore. To do this, add the following rules to it:
-
For incoming client traffic:
- Port range:
30000-32767
- Protocol:
Any
(Any
) - Source:
CIDR
- CIDR blocks:
0.0.0.0/0
- Port range:
-
For incoming load balancer traffic:
- Port range:
10256
- Protocol:
Any
(Any
) - Source:
Load balancer healthchecks
- Port range:
If you plan to use multiple security groups for a cluster, enable all traffic between these groups.
Note
You can specify more detailed rules for your security groups, e.g., to allow traffic only in specific subnets.
(Optional) Prepare a static access key
To enable a Metastore cluster to work with Yandex Object Storage, prepare a static access key:
-
Assign the required roles to the service account.
The roles you need depend on your use case scenario. You can view the service roles in the Metastore section and all the available roles in this reference.
-
Create a static access key for the service account.
-
Save the ID and secret key. You will not be able to access them later.
Create a cluster
-
In the management console
, select the folder where you want to create a server. -
Select Yandex MetaData Hub.
-
In the left-hand panel, select the
Metastore page. -
Click Create cluster.
-
Enter a name for the cluster. It must be unique within the folder.
-
(Optional) Enter a cluster description.
-
(Optional) Add Yandex Cloud labels to break resources into logical groups.
-
Select the service account on behalf of which the Metastore cluster will interact with other Yandex Cloud services or create new.
-
Under Network settings, select the network and subnet to host the Metastore cluster. Specify the security group you configured previously.
-
(Optional) Under Logging enable logging, set minimum logging level and specify a folder or a log group.
-
If required, enable protection of the cluster from accidental deletion by a user.
Cluster deletion protection will not prevent a manual connection to a cluster to delete data.
-
Click Create.