Monitoring the state of Yandex Data Processing clusters and hosts
You can track the state of a Yandex Data Processing cluster and its individual hosts with the monitoring tools in the management console. These tools display diagnostic information as charts.
To get started with Monitoring metrics, dashboards, or alerts, click Open in Monitoring in the top panel.
Chart update rate:
- Standard hosts and hosts with an increased RAM to vCPU ratio (
memory-optimized
): 15 seconds. - Hosts with a guaranteed vCPU share under 100% (
burstable
): 150 seconds.
Note
The most appropriate multiple units (MB, GB, and more) are automatically used in charts.
Monitoring cluster state
To view detailed information about the Yandex Data Processing cluster state:
- Go to the folder page
and select Yandex Data Processing. - Click the cluster name and open the Monitoring tab.
The tab displays the following charts:
- Active nodes: Number of running hosts (other than master hosts).
- Apps failed: Number of applications with runtime errors.
- Available RAM: Amount of free RAM (in bytes) available in YARN for hosts in data storage and processing subclusters.
- Available virtual cores: Number of cores available in YARN.
- Containers pending: Number of containers waiting to be launched by the YARN Resource Manager.
- Decommissioned nodes: Number of hosts that have been decommissioned.
Monitoring the state of hosts
To view detailed information about the state of individual Yandex Data Processing hosts:
- Go to the folder page
and select Yandex Data Processing. - Click the cluster name and open the Hosts tab.
- Open the VM of the host you want to monitor and select the Monitoring tab.
The tab displays charts with information on VM resource usage:
- CPU Utilization: Processor core workload.
- Connections quota utilization: Percentage of the available host connections utilized.
- Disk bytes: Storage read and write speed (bytes per second).
- Disk operations: Disk activity (ops per second).
- Network bytes: Speed of data exchange over the network, in bytes per second.
- Network packets: Number of packets exchanged over the network, per second.
Integration with Yandex Monitoring
To configure cluster and host state metric alerts:
- In the management console
, select the folder with the cluster you want to configure alerts for. - In the list of services, select
Monitoring. - Under Service dashboards, select Yandex Data Processing.
- In the chart with metrics, click
and select Create alert. - If the chart shows multiple metrics, select a data query to generate a metric and click Continue. For more information about the query language, see the Yandex Monitoring documentation.
- Set the
Alarm
andWarning
thresholds for notifications. - Click Create.
To have other cluster health indicators monitored automatically:
- Create an alert.
- Add a status metric.
- In the alert parameters, set up your alert thresholds.
For a complete list of supported metrics, see the Monitoring documentation.
Cluster state and status
The State of a cluster shows the health of its hosts, while the Status shows whether the cluster is started, stopped, or is at an intermediate stage.
To view a cluster's state and status:
- Go to the folder page
and select Yandex Data Processing. - Hover over the indicator in the Availability column in the required cluster row.
Cluster states
State | Description | Suggested actions |
---|---|---|
ALIVE | Cluster is operating normally. | No action is required. |
DEGRADED | Cluster is not running at its full capacity: the state of at least one of the hosts is other than ALIVE . |
Run the diagnostics:
|
DEAD | The cluster is down: none of its hosts are running. | Make a support request
|
UNKNOWN | Cluster state is unknown. | Make a support request
|
Cluster statuses
Status | Description | Suggested actions |
---|---|---|
CREATING | Preparing for the first launch | Wait a while and get started. The time it takes to create a cluster depends on the host class. |
RUNNING | Cluster is operating normally | No action is required. |
STOPPING | Stopping cluster | After a while, the cluster status will change to STOPPED and the cluster will be disabled. No action is required. |
STOPPED | Cluster stopped | Start the cluster to get it running again. |
STARTING | Starting the cluster that was stopped earlier | After a while, the cluster status will change to RUNNING . Wait a while and get started. |
UPDATING | Updating the cluster status | After the update is completed, the cluster status will change to RUNNING . Wait a while and get started. |
ERROR | An error occurred that does not allow the cluster to continue working | Run the initial diagnostics:
|
STATUS_UNKNOWN | Cluster is unable to determine its own status | Run the initial diagnostics:
|