Contact UsGet started
© 2024 Direct Cursus Technology L.L.C.

Information about existing Yandex Data Processing clusters

Written by
Updated at November 26, 2024

You can get detailed information about each Yandex Data Processing cluster.

Getting a list of clusters in a folder

Go to the folder page and select Yandex Data Processing.

If you do not have the Yandex Cloud command line interface yet, install and initialize it.

The folder specified in the CLI profile is used by default. You can specify a different folder using the --folder-name or --folder-id parameter.

To request a list of Yandex Data Processing clusters in the default folder, run the command:

yc dataproc cluster list

Use the list API method.

Getting detailed information about a cluster

  1. Go to the folder page and select Yandex Data Processing.
  2. Click the cluster name.

If you do not have the Yandex Cloud command line interface yet, install and initialize it.

The folder specified in the CLI profile is used by default. You can specify a different folder using the --folder-name or --folder-id parameter.

To get Yandex Data Processing cluster details, run the command:

yc dataproc cluster get <cluster_name_or_ID>

You can get the cluster ID and name with a list of clusters in the folder.

Use the get API method and provide the cluster ID in the clusterId request parameter.

You can get the cluster ID with a list of clusters in the folder.

Viewing operations with clusters

All actions with Yandex Data Processing clusters are logged as a list of operations. Each operation is assigned a unique ID.

Getting a list of operations

To view operations with all Yandex Data Processing clusters, in the left-hand panel, select Operations. The list that opens also includes operations with the clusters that were deleted.

You can get a list of operations for a specific resource. The steps below describe how you can do this for a Yandex Data Processing cluster.

  1. In the management console, open the folder with the cluster.

  2. Select Yandex Data Processing.

  3. Select the cluster you need.

  4. Go to the Operations panel for the selected cluster.

    You will see a list of operations with the selected cluster.

If you do not have the Yandex Cloud command line interface yet, install and initialize it.

The folder specified in the CLI profile is used by default. You can specify a different folder using the --folder-name or --folder-id parameter.

To get a list of operations for a Yandex Data Processing cluster, run this command:

yc dataproc cluster list-operations <cluster_name_or_ID>

Result:

+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
|          ID          |     CREATED AT      |      CREATED BY      |     MODIFIED AT     | STATUS |          DESCRIPTION           |
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
| c9q2n4s13p5v******** | 2024-08-06 06:19:47 | ajej2i98kcjd******** | 2024-08-06 06:21:36 | DONE   | Create Data Processing cluster |
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+

You can get the cluster ID and name with a list of clusters in the folder.

By default, information about operations is provided as text. To get detailed information, specify the yaml or json output data format using the --format flag:

yc dataproc cluster list-operations epdplu8jn7sr******** --format yaml

Result:

- id: c9q2n4s13p5v********
  description: Create Data Processing cluster
  created_at: "2024-08-06T06:19:47.755364Z"
  created_by: ajej2i98kcjd********
  modified_at: "2024-08-06T06:21:36.095300Z"
  done: true
  metadata:
    '@type': type.googleapis.com/yandex.cloud.dataproc.v1.CreateClusterMetadata
    cluster_id: c9q77tr1aq3g********
  response:
    '@type': type.googleapis.com/yandex.cloud.dataproc.v1.Cluster
...

Use the listOperations REST API method for the Cluster resource or the ClusterService/ListOperations gRPC API call and provide the cluster ID in the request.

You can get the cluster ID with a list of clusters in the folder.

Getting detailed information about an operation

  1. Get a list of operations for a cluster.

  2. Copy the operation ID.

  3. Get detailed information about the operation:

    If you do not have the Yandex Cloud command line interface yet, install and initialize it.

    The folder specified in the CLI profile is used by default. You can specify a different folder using the --folder-name or --folder-id parameter.

    Run this command:

    yc operation get <operation_ID>

    Result:

    id: c9q2n4s13p5v********
description: Create Data Processing cluster
created_at: "2024-08-06T06:19:47.755364Z"
created_by: ajej2i98kcjd********
modified_at: "2024-08-06T06:21:36.095300Z"
done: true
metadata:
  '@type': type.googleapis.com/yandex.cloud.dataproc.v1.CreateClusterMetadata
  cluster_id: c9q77tr1aq3g********
response:
  '@type': type.googleapis.com/yandex.cloud.dataproc.v1.Cluster
...

    Use the OperationService/Get gRPC API call and provide the operation ID in the request.

See also

Previous
All guides
Next
Creating a cluster