Contact UsTry it for free
© 2026 Direct Cursus Technology L.L.C.

Monitoring the state of Yandex Data Processing clusters and hosts

Written by
Updated at January 29, 2026

You can track the state of a Yandex Data Processing cluster and its individual hosts using the monitoring tools in the management console. These tools display diagnostic information as charts.

To get started with Monitoring metrics, dashboards, or alerts, click Open in Monitoring in the top panel.

Chart update rate:

  • Standard hosts and hosts with an increased RAM to vCPU ratio (memory-optimized): 15 seconds.
  • Hosts with a guaranteed vCPU share under 100% (burstable): 150 seconds.

Note

The most appropriate multiple units (MB, GB, and more) are automatically used in charts.

Cluster state monitoring

To view detailed information on the state of a Yandex Data Processing cluster:

  1. Open the folder dashboard.
  2. Go to Yandex Data Processing.
  3. Click the name of your cluster and select the Monitoring tab.

The tab displays the following charts:

  • Active nodes: Number of running hosts (other than master hosts).
  • Apps failed: Number of applications with runtime errors.
  • Available RAM: Amount of free RAM (in bytes) available in YARN for hosts in data storage and processing subclusters.
  • Available virtual cores: Number of cores available in YARN.
  • Containers pending: Number of containers waiting for the YARN Resource Manager to run them.
  • Decommissioned nodes: Number of hosts that have been decommissioned.

Monitoring the state of hosts

To view detailed information on the state of individual Yandex Data Processing hosts:

  1. Open the folder dashboard.
  2. Go to Yandex Data Processing.
  3. Click the name of your cluster and select the Hosts tab.
  4. Open the VM of the host you want to monitor and select the Monitoring tab.

The tab displays charts with information on VM resource usage:

  • CPU Utilization: Processor core workload.
  • Connections quota utilization: Percentage of available host connections being used.
  • Disk bytes: Storage read and write speed (bytes per second).
  • Disk operations: Disk activity (ops per second).
  • Network bytes: Network data exchange rate, in bytes per second.
  • Network packets: Network packet exchange rate, in packets per second.

Integration with Yandex Monitoring

To configure state indicator alerts for the cluster and hosts:

  1. In the management console, select the folder with the cluster for which you want to configure alerts.
  2. Go to Monitoring.
  3. Under Service dashboards, select Yandex Data Processing.
  4. In the indicator chart, click and select Create alert.
  5. If the chart shows multiple indicators, select a data query to generate a metric and click Continue. For more information about the query language, see this Yandex Monitoring guide.
  6. Set the Alarm and Warning thresholds for notifications.
  7. Click Create.

To have other cluster health indicators monitored automatically:

  1. Create an alert.
  2. Add a status metric.
  3. In the alert parameters, set the alert thresholds.

For a complete list of supported metrics, see this Monitoring guide.

Cluster state and status

The State of a cluster shows the health of its hosts, while the Status shows whether the cluster is started, stopped, or is at an intermediate stage.

To view the state and status of a cluster:

  1. Open the folder dashboard.
  2. Go to Yandex Data Processing.
  3. Hover over the indicator in the cluster row of the Availability column.

Cluster states

State Description Suggested actions
ALIVE Cluster is operating normally. No action is required.
DEGRADED Cluster is not running at its full capacity: the state of at least one of the hosts is other than ALIVE. Run the diagnostics:
  • Go to the Hosts tab and see which hosts are not working.
  • Go to the Operations tab and make sure all operations are completed.
  • Make sure the cluster is not under maintenance.
If you cannot find the cause yourself, contact support.
DEAD The cluster is down: none of its hosts are running. Make a support request stating the following:
  • Cluster ID.
  • IDs of the last operations performed on it.
  • Time the cluster entered the DEAD state according to the availability charts.
UNKNOWN Cluster state is unknown. Make a support request stating the following:
  • Cluster ID.
  • IDs of the last operations performed on it.
  • Time the cluster entered the UNKNOWN state according to the availability charts.

Cluster statuses

Status Description Suggested actions
CREATING Preparing for the first start Wait a while and get started. The time it takes to create a cluster depends on the host class.
RUNNING The cluster is operating normally No action is required.
STOPPING The cluster is stopping After a while, the cluster status will switch to STOPPED and the cluster will be disabled. No action is required.
STOPPED The cluster is stopped Start the cluster to get it running again.
STARTING Starting the cluster that was stopped earlier After a while, the cluster status will switch to RUNNING. Wait a while and get started.
UPDATING Updating the cluster's configuration Once the update is complete, the cluster will get the status it had prior to the update: RUNNING or STOPPED.
ERROR Error when performing an operation with the cluster or during a maintenance window If the cluster remains in this status for a long time, contact support. You can see whether a cluster is available by its status.
STATUS_UNKNOWN The cluster is unable to determine its status If the cluster remains in this status for a long time, contact support.
Previous
Working with logs
Next
Spark application status monitoring