Getting started with Managed Service for Elasticsearch

To get started with the service:

1. Create a cluster.
2. Configure security groups.
3. Connect to the cluster.
4. Connect to Kibana.

Getting startedGetting started

1. Log in to the management console or sign up if you do not have an account yet.

2. If you do not have a folder yet, create one:

   1. In the management console, select the appropriate cloud from the list on the left.

   2. At the top right, click Create folder.

   3. Give your folder a name. The naming requirements are as follows:

      • It must be from 2 to 63 characters long.
      • It may contain lowercase Latin letters, numbers, and hyphens.
      • It must start with a letter and cannot end with a hyphen.

   4. Optionally, specify the description for your folder.

   5. Select Create a default network. This will create a network with subnets in each availability zone. Within this network, you will also have a default security group, inside which all network traffic will be allowed.

   6. Click Create.

3. You can connect to an Elasticsearch cluster from both inside and outside Yandex Cloud:

   • To connect from inside Yandex Cloud, create a Linux-based VM in the same network as the cluster.

   • To connect to a cluster from the internet, request public access to hosts with the Data node role when creating the cluster.

Create a clusterCreate a cluster

1. In the management console, select the folder where you want to create a cluster.

2. Select Managed Service for Elasticsearch.

3. Click Create cluster. For more information, see Creating clusters.

4. Set the cluster parameters.

   To access the Kibana web interface, request public access:

   1. Under Hosts, change the settings of the host with the Data node role by clicking for the host.
   2. Select Public access.
   3. Click Save.

   Public access can be requested for one or more hosts with the role Data node. After creating the cluster, you can connect to Kibana on those hosts. You may need to additionally set up security groups to be able connect to the cluster.

   Tip

   You can use Kibana even if you can't request public access to the hosts (for example, for security reasons). To do this, proxy the connections via the virtual machine in Yandex Compute Cloud that is hosted in the same network as the cluster. For more information, see Connecting to a cluster.

5. Click Create.

6. Wait until the cluster is ready: its status on the Managed Service for Elasticsearch dashboard changes to Creating and then to Alive. This may take some time.

Configure security groupsConfigure security groups

Configure security groups for the cloud network to enable all the relevant traffic between the cluster and the connecting host.

Connect to the clusterConnect to the cluster

It is assumed that all the steps below are performed on Linux.

To connect to a cluster:

1. Install an SSL certificate:

   Linux (Bash)/macOS (Zsh)

   Windows (PowerShell)

   mkdir -p ~/.elasticsearch && \
   wget "https://storage.yandexcloud.net/cloud-certs/CA.pem" \
        --output-document ~/.elasticsearch/root.crt && \
   chmod 0600 ~/.elasticsearch/root.crt
   

   The certificate is saved to the ~/.elasticsearch/root.crt file.

   mkdir $HOME\.elasticsearch; curl.exe -o $HOME\.elasticsearch\root.crt https://storage.yandexcloud.net/cloud-certs/CA.pem
   

   The certificate is saved to the $HOME\.elasticsearch\root.crt file.

2. Connect to the cluster using cURL:

   curl \
       --user <username>:<password> \
       --cacert ~/.elasticsearch/root.crt \
       --request GET 'https://c-<Elasticsearch_cluster_ID>.rw.mdb.yandexcloud.net:9200/'
   

   To connect, enter the username and password used when creating a cluster.

   A message like this is displayed if the connection is successful:

   {
     "name" : "....mdb.yandexcloud.net",
     "cluster_name" : "...",
     "cluster_uuid" : "...",
     ...
     "tagline" : "You Know, for Search"
   }
   

Connect to KibanaConnect to Kibana

1. Use your browser to connect to the Kibana web interface.

   To connect:

   1. Install the SSL certificate in your browser's trusted root certificate store (instructions for Mozilla Firefox).

   2. In your browser, go to https://<FQDN_of_publicly_available_Elasticsearch_host_with_Data_node_role>.

      To learn how to get a host FQDN, see this guide.

   3. Enter the username and password that you set when creating a cluster.

2. Upload one or more test datasets to Elasticsearch using Kibana:

   1. On the Kibana welcome screen, click Try our sample data.
   2. Add data from one or more datasets by clicking Add data for the selected dataset.

3. Explore the data with Kibana and Elasticsearch by clicking View data for a dataset.

Learn more about working with Kibana, in the Elasticsearch documentation.

What's nextWhat's next

• Read about service concepts.
• Learn more about creating a cluster and connecting to a cluster.