Information about existing Yandex Data Processing clusters
You can get details about each Yandex Data Processing cluster.
Getting a list of clusters in a folder
- Open the folder dashboard.
- Go to Yandex Data Processing.
If you do not have the Yandex Cloud CLI yet, install and initialize it.
The folder used by default is the one specified when creating the CLI profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id options.
To get a list of Yandex Data Processing clusters in the default folder, run this command:
yc dataproc cluster list
Use the list API method.
Getting cluster details
- Open the folder dashboard.
- Go to Yandex Data Processing.
- Click the cluster name.
If you do not have the Yandex Cloud CLI yet, install and initialize it.
The folder used by default is the one specified when creating the CLI profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id options.
To get Yandex Data Processing cluster details, run this command:
yc dataproc cluster get <cluster_name_or_ID>
You can get the cluster ID and name with the list of clusters in the folder.
Call the get API method, providing the cluster ID in the clusterId request parameter.
You can get the cluster ID with the list of clusters in the folder.
Viewing operations with clusters
All actions with Yandex Data Processing clusters are logged as a list of operations. Each operation gets its own unique ID.
Getting a list of operations
To view operations with all Yandex Data Processing clusters, select Operations in the left-hand panel. In the list that opens, you will also see operations for the deleted clusters.
You can get a list of operations for a specific resource. The steps below describe how you can do this for a Yandex Data Processing cluster.
-
In the management console, open the folder containing your cluster.
-
Go to Yandex Data Processing.
-
Select the cluster and open the Operations tab.
You will see the list of operations with the cluster.
If you do not have the Yandex Cloud CLI yet, install and initialize it.
The folder used by default is the one specified when creating the CLI profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id options.
To get a list of operations for a Yandex Data Processing cluster, run this command:
yc dataproc cluster list-operations <cluster_name_or_ID>
Result:
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
| ID | CREATED AT | CREATED BY | MODIFIED AT | STATUS | DESCRIPTION |
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
| c9q2n4s13p5v******** | 2024-08-06 06:19:47 | ajej2i98kcjd******** | 2024-08-06 06:21:36 | DONE | Create Data Processing cluster |
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
You can get the cluster ID and name with the list of clusters in the folder.
By default, information about transactions is displayed in text format. To get more details, specify yaml or json for the output data using the --format argument:
yc dataproc cluster list-operations epdplu8jn7sr******** --format yaml
Result:
- id: c9q2n4s13p5v********
description: Create Data Processing cluster
created_at: "2024-08-06T06:19:47.755364Z"
created_by: ajej2i98kcjd********
modified_at: "2024-08-06T06:21:36.095300Z"
done: true
metadata:
'@type': type.googleapis.com/yandex.cloud.dataproc.v1.CreateClusterMetadata
cluster_id: c9q77tr1aq3g********
response:
'@type': type.googleapis.com/yandex.cloud.dataproc.v1.Cluster
...
Use the listOperations REST API method for the Cluster resource or the ClusterService/ListOperations gRPC API call and provide the cluster ID in the request.
You can get the cluster ID with the list of clusters in the folder.
Getting operation details
-
Get the list of operations for the cluster.
-
Copy the ID of the operation you need.
-
Get operation details:
CLIAPIIf you do not have the Yandex Cloud CLI yet, install and initialize it.
The folder used by default is the one specified when creating the CLI profile. To change the default folder, use the
yc config set folder-id <folder_ID>command. You can also set a different folder for any specific command using the--folder-nameor--folder-idoptions.Run this command:
yc operation get <operation_ID>Result:
id: c9q2n4s13p5v******** description: Create Data Processing cluster created_at: "2024-08-06T06:19:47.755364Z" created_by: ajej2i98kcjd******** modified_at: "2024-08-06T06:21:36.095300Z" done: true metadata: '@type': type.googleapis.com/yandex.cloud.dataproc.v1.CreateClusterMetadata cluster_id: c9q77tr1aq3g******** response: '@type': type.googleapis.com/yandex.cloud.dataproc.v1.Cluster ...Use the OperationService/Get gRPC API call and provide the operation ID in the request.