Connecting to a Yandex Object Storage bucket with a bucket policy
Written by
Updated at December 16, 2024
In Hive Metastore, you can work with an Yandex Object Storage bucket with bucket policies configured. You access the bucket from a separate DNS zone through an internal load balancer used to distribute traffic among NAT instances. The described connection is shown below. A Metastore cluster will be used in place of the test-s3-vm
VM.
Getting started
- Create a network infrastructure to access the Object Storage bucket as shown on the picture above. For information on how to create such an infrastructure, see this tutorial.
- Test the new infrastructure.
Prepare the Metastore cluster
- Create a service account named
my-account
with thestorage.uploader
andmanaged-metastore.integrationProvider
roles. - Grant the
READ and WRITE
permission to themy-account
service account for the bucket you created earlier. - Configure the network and create a Metastore cluster. When creating it, specify the
my-account
service account.
Test the connection
To test the Object Storage bucket connection, export the Metastore cluster data to that bucket.