Information about existing Yandex Data Processing clusters
You can get detailed information about each Yandex Data Processing cluster.
Getting a list of clusters in a folder
Navigate to the folder dashboard
If you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id parameter.
To request a list of Yandex Data Processing clusters in the default folder, run the command:
yc dataproc cluster list
Use the list API method.
Getting detailed information about a cluster
- Navigate to the folder dashboard
and select Yandex Data Processing. - Click the cluster name.
If you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id parameter.
To get Yandex Data Processing cluster details, run the command:
yc dataproc cluster get <cluster_name_or_ID>
You can get the cluster ID and name with the list of clusters in the folder.
Use the get API method and provide the cluster ID in the clusterId request parameter.
You can get the cluster ID with the list of clusters in the folder.
Viewing operations with clusters
All actions with Yandex Data Processing clusters are logged as a list of operations. Each operation gets its own unique ID.
Getting a list of operations
To view operations with all Yandex Data Processing clusters, in the left-hand panel, select
You can get a list of operations for a specific resource. The steps below describe how you can do this for a Yandex Data Processing cluster.
-
In the management console
, open the folder with the cluster. -
Select Yandex Data Processing.
-
Select the cluster.
-
Go to the
Operations panel for the selected cluster.You will see a list of operations with the selected cluster.
If you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id parameter.
To get a list of operations for a Yandex Data Processing cluster, run this command:
yc dataproc cluster list-operations <cluster_name_or_ID>
Result:
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
| ID | CREATED AT | CREATED BY | MODIFIED AT | STATUS | DESCRIPTION |
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
| c9q2n4s13p5v******** | 2024-08-06 06:19:47 | ajej2i98kcjd******** | 2024-08-06 06:21:36 | DONE | Create Data Processing cluster |
+----------------------+---------------------+----------------------+---------------------+--------+--------------------------------+
You can get the cluster ID and name with the list of clusters in the folder.
By default, operation information is displayed as text. To get more detailed information, specify the yaml or json output data format using the --format parameter:
yc dataproc cluster list-operations epdplu8jn7sr******** --format yaml
Result:
- id: c9q2n4s13p5v********
description: Create Data Processing cluster
created_at: "2024-08-06T06:19:47.755364Z"
created_by: ajej2i98kcjd********
modified_at: "2024-08-06T06:21:36.095300Z"
done: true
metadata:
'@type': type.googleapis.com/yandex.cloud.dataproc.v1.CreateClusterMetadata
cluster_id: c9q77tr1aq3g********
response:
'@type': type.googleapis.com/yandex.cloud.dataproc.v1.Cluster
...
Use the listOperations REST API method for the Cluster resource or the ClusterService/ListOperations gRPC API call and provide the cluster ID in the request.
You can get the cluster ID with the list of clusters in the folder.
Getting operation details
-
Get a list of operations for a cluster.
-
Copy the operation ID.
-
Get operation details:
CLIAPIIf you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the
yc config set folder-id <folder_ID>command. You can also set a different folder for any specific command using the--folder-nameor--folder-idparameter.Run this command:
yc operation get <operation_ID>Result:
id: c9q2n4s13p5v******** description: Create Data Processing cluster created_at: "2024-08-06T06:19:47.755364Z" created_by: ajej2i98kcjd******** modified_at: "2024-08-06T06:21:36.095300Z" done: true metadata: '@type': type.googleapis.com/yandex.cloud.dataproc.v1.CreateClusterMetadata cluster_id: c9q77tr1aq3g******** response: '@type': type.googleapis.com/yandex.cloud.dataproc.v1.Cluster ...Use the OperationService/Get gRPC API call and provide the operation ID in the request.