Configuring access to Object Storage from a Elasticsearch cluster

Managed Service for Elasticsearch supports using Yandex Object Storage as an Elasticsearch snapshot repository. This allows you to use Object Storage for:

• Migrating data from a third-party Elasticsearch cluster to Managed Service for Elasticsearch.

• Adding user extensions.

• Storing backups.

For more information about snapshots, see the Elasticsearch documentation.

To access Object Storage bucket data from a cluster:

1. Connect a service account to a cluster.
2. Configure access rights.
3. Connect a snapshot repository.

Connecting a service account to a clusterConnecting a service account to a cluster

1. When creating or updating a cluster, either select an existing service account or create a new one.

2. Make sure to assign the storage.editor role or higher to this account.

Setting up access rightsSetting up access rights

Connecting a snapshot repositoryConnecting a snapshot repository

1. Connect to the cluster.

2. Install the repository-s3 plugin:

   sudo bin/elasticsearch-plugin install repository-s3
   

3. Register the bucket as a snapshot repository using the public Elasticsearch API:

   PUT --cacert ~/.elasticsearch/root.crt https://admin:<password>@<host_FQDN>:9200/_snapshot/<repository>
   

   In the request parameters, specify the bucket associated with the cluster service account:

   curl --request PUT \
        "https://admin:<password>@<host_FQDN>:9200/_snapshot/<repository>" \
        --cacert ~/.elasticsearch/root.crt \
        --header "Content-Type: application/json" \
        --data '{
          "type": "s3",
          "settings": {
            "endpoint": "storage.yandexcloud.net",
            "bucket": "<bucket_name>",
            "base_path": "<path_to_snapshot_directory>",
            "canned_acl": "bucket-owner-full-control"
          }
        }'
   

   To learn more about managing repositories, see the Elasticsearch documentation.