Host roles in Managed Service for OpenSearch
Each Managed Service for OpenSearch cluster consists of one or more host groups of the OpenSearch and Dashboards (optional) types:
-
The
OpenSearchhost group may contain hosts with the DATA, MANAGER, WARM, or INGEST roles.The cluster must include hosts with the
DATAandMANAGERroles. If a cluster has a singleOpenSearchgroup, its hosts will have both roles. -
A
Dashboardshost group may only contain hosts with the DASHBOARDS role.
Hosts with the DATA role
Hosts with this role store one or more indexes and handle search, write, and analysis queries.
For a cluster to be highly available and covered by a service level agreement (SLA), it must have two or more hosts with the DATA role.
More on high-availability of clusters.
Use cases
- Migrating data from Elasticsearch
- Configuring an index policy in Managed Service for OpenSearch
- Configuring a cold storage policy in Managed Service for OpenSearch
- Loading data from Yandex Managed Service for OpenSearch to Yandex Object Storage using Yandex Data Transfer
- Using the yandex-lemmer plugin in Managed Service for OpenSearch
Hosts with the MANAGER role
Hosts with this role monitor the state of the cluster and manage its configuration, ensuring the performance of all OpenSearch components.
If you are using hosts with the MANAGER role, a group containing three such hosts will be added to the cluster.
If no hosts with the MANAGER role are used, make sure to assign this role to the hosts with the DATA role. However, having dedicated hosts with the MANAGER role allows you to increase the overall cluster reliability and reduce the load on hosts with the DATA role.
Warning
If you add a host group with the MANAGER role to a cluster where this role is assigned to hosts with the DATA role, you will be unable to delete that group. The only way to restore the previous host configuration is to restore the cluster from a backup.
Hosts with the WARM role
Hosts with this role provide access to searchable snapshots stored in S3 warm storage. Hosts with the WARM role also store a cache of frequently used data segments.
This warm storage feature is at the Preview stage. To activate it, contact support.
Read more about searchable snapshots in the relevant OpenSearch guide.
Hosts with the INGEST role
Hosts with this role preprocess data before saving it to an index. Dedicated hosts with the INGEST role can come in handy if you use resource-intensive data ingestion pipelines prior to uploading data into OpenSearch. If the cluster contains no hosts with the INGEST role, it is hosts with the DATA role that perform this role.
Learn more about data ingestion pipelines in the relevant OpenSearch guide.
Hosts with the DASHBOARDS role
Hosts with this role run OpenSearch Dashboards, a data visualization tool to use in such scenarios as real-time application monitoring, threat detection, incident management, or personalized search.