Information about existing clusters
You can get detailed information about each Apache Spark™ cluster you created.
Getting a list of clusters in a folder
- In the management console
, navigate to the relevant folder. - Go to Managed Service for Apache Spark™.
If you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id parameter.
To get a list of Apache Spark™ clusters in the default folder, run this command:
yc managed-spark cluster list
Result:
+----------------------+----------+---------------------+--------+---------+
| ID | NAME | CREATED AT | HEALTH | STATUS |
+----------------------+----------+---------------------+--------+---------+
| c9qmm2mrse2g******** | my-spark | 2026-01-22 13:23:32 | ALIVE | RUNNING |
+----------------------+----------+---------------------+--------+---------+
-
Get an IAM token for API authentication and place it in an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/List method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "folder_id": "<folder_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.List ``` You can get the folder ID with the [list of folders in the cloud](../../resource-manager/operations/folder/get-id.md). -
Check the server response to make sure your request was successful.
Getting detailed information about a cluster
- In the management console
, navigate to the relevant folder. - Go to Managed Service for Apache Spark™.
- Click the name of your cluster.
If you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id parameter.
To get Apache Spark™ cluster details, run the following command:
yc managed-spark cluster get <cluster_name_or_ID>
You can get the cluster name and ID with the list of clusters in the folder.
-
Get an IAM token for API authentication and place it in an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/Get method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.GetYou can get the cluster ID from the list of clusters in your folder.
-
Check the server response to make sure your request was successful.
Viewing operations with clusters
All actions with Apache Spark™ clusters are logged as a list of operations. Each operation gets its own unique ID.
Getting a list of operations
To get a list of operations for a Apache Spark™ cluster:
-
In the management console
, open the folder containing your cluster. -
Go to Managed Service for Apache Spark™.
-
In the left-hand panel, select
Clusters. -
Select the cluster.
-
Navigate to the
Operations panel for the cluster you selected.You will see the list of operations with this cluster.
If you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id parameter.
To get a list of operations for an Apache Spark™ cluster, run this command:
yc managed-spark cluster list-operations <cluster_name_or_ID>
Result:
+----------------------+---------------------+----------------------+---------------------+--------+-----------------------------+
| ID | CREATED AT | CREATED BY | MODIFIED AT | STATUS | DESCRIPTION |
+----------------------+---------------------+----------------------+---------------------+--------+-----------------------------+
| msc53bmphhmc******** | 2026-01-22 13:23:32 | ajegrmkclceh******** | 2026-01-22 13:27:22 | DONE | Create Apache Spark cluster |
+----------------------+---------------------+----------------------+---------------------+--------+-----------------------------+
You can get the cluster name and ID with the list of clusters in the folder.
By default, information about operations is output as text. To get more detailed information, specify the yaml or json output data format using the --format parameter. For example:
yc managed-spark cluster list-operations <cluster_name_or_ID> --format yaml
Result:
- id: msc53bmphhmc********
description: Create Apache Spark cluster
created_at: "2026-01-22T13:23:32.748783Z"
created_by: ajegrmkclceh********
modified_at: "2026-01-22T13:27:22.336712Z"
done: true
metadata:
'@type': type.googleapis.com/yandex.cloud.spark.v1.CreateClusterMetadata
cluster_id: c9qmm2mrse2g********
...
-
Get an IAM token for API authentication and place it in an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/ListOperations method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.ListOperationsYou can get the cluster ID from the list of clusters in your folder.
-
Check the server response to make sure your request was successful.