Information about existing Yandex Data Processing clusters
You can get detailed information about each Yandex Data Processing cluster.
Getting a list of clusters in a folder
Go to the folder page and select Yandex Data Processing.
If you do not have the Yandex Cloud CLI yet, install and initialize it.
The folder specified when creating the CLI profile is used by default. To change the default folder, use the yc config set folder-id <folder_ID> command. You can specify a different folder using the --folder-name or --folder-id parameter.
To request a list of Yandex Data Processing clusters in the default folder, run the command:
yc dataproc cluster list
Use the list API method.
Getting detailed information about a cluster
- Go to the folder page and select Yandex Data Processing.
- Click the cluster name.
If you do not have the Yandex Cloud CLI yet, install and initialize it.
The folder specified when creating the CLI profile is used by default. To change the default folder, use the yc config set folder-id <folder_ID> command. You can specify a different folder using the --folder-name or --folder-id parameter.
To get Yandex Data Processing cluster details, run the command:
yc dataproc cluster get <cluster_name_or_ID>
You can get the cluster ID and name with a list of clusters in the folder.
Use the get API method and provide the cluster ID in the clusterId request parameter.
You can get the cluster ID with a list of clusters in the folder.
Viewing operations with clusters
All actions with Yandex Data Processing clusters are logged as a list of operations. Each operation is assigned a unique ID.
Getting a list of operations
To view operations with all Yandex Data Processing clusters, in the left-hand panel, select Operations. The list that opens also includes operations with the clusters that were deleted.
You can get a list of operations for a specific resource. The steps below describe how you can do this for a Yandex Data Processing cluster.
-
In the management console, open the folder with the cluster.
-
Select Yandex Data Processing.
-
Select the cluster you need.
-
Go to the Operations panel for the selected cluster.
You will see a list of operations with the selected cluster.
If you do not have the Yandex Cloud CLI yet, install and initialize it.
The folder specified when creating the CLI profile is used by default. To change the default folder, use the yc config set folder-id <folder_ID> command. You can specify a different folder using the --folder-name or --folder-id parameter.
To get a list of operations for a Yandex Data Processing cluster, run this command:
yc dataproc cluster list-operations <cluster_name_or_ID>
Result:
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
| ID | CREATED AT | CREATED BY | MODIFIED AT | STATUS | DESCRIPTION |
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
| c9q2n4s13p5v******** | 2024-08-06 06:19:47 | ajej2i98kcjd******** | 2024-08-06 06:21:36 | DONE | Create Data Processing cluster |
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
You can get the cluster ID and name with a list of clusters in the folder.
By default, information about operations is provided as text. To get detailed information, specify the yaml or json output data format using the --format flag:
yc dataproc cluster list-operations epdplu8jn7sr******** --format yaml
Result:
- id: c9q2n4s13p5v********
description: Create Data Processing cluster
created_at: "2024-08-06T06:19:47.755364Z"
created_by: ajej2i98kcjd********
modified_at: "2024-08-06T06:21:36.095300Z"
done: true
metadata:
'@type': type.googleapis.com/yandex.cloud.dataproc.v1.CreateClusterMetadata
cluster_id: c9q77tr1aq3g********
response:
'@type': type.googleapis.com/yandex.cloud.dataproc.v1.Cluster
...
Use the listOperations REST API method for the Cluster resource or the ClusterService/ListOperations gRPC API call and provide the cluster ID in the request.
You can get the cluster ID with a list of clusters in the folder.
Getting detailed information about an operation
-
Get a list of operations for a cluster.
-
Copy the operation ID.
-
Get detailed information about the operation:
CLIAPIIf you do not have the Yandex Cloud CLI yet, install and initialize it.
The folder specified when creating the CLI profile is used by default. To change the default folder, use the
yc config set folder-id <folder_ID>command. You can specify a different folder using the--folder-nameor--folder-idparameter.Run this command:
yc operation get <operation_ID>Result:
id: c9q2n4s13p5v******** description: Create Data Processing cluster created_at: "2024-08-06T06:19:47.755364Z" created_by: ajej2i98kcjd******** modified_at: "2024-08-06T06:21:36.095300Z" done: true metadata: '@type': type.googleapis.com/yandex.cloud.dataproc.v1.CreateClusterMetadata cluster_id: c9q77tr1aq3g******** response: '@type': type.googleapis.com/yandex.cloud.dataproc.v1.Cluster ...Use the OperationService/Get gRPC API call and provide the operation ID in the request.