Information about existing clusters
You can get detailed information about each Apache Spark™ cluster you created.
Getting a list of clusters in a folder
- In the management console, navigate to the relevant folder.
- In the list of services, select Managed Service for Apache Spark™.
-
Get an IAM token for API authentication and save it as an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi repository:
cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume the repository contents are stored in the
~/cloudapi/directory. -
Use the ClusterService/List call and send the following request, e.g., via gRPCurl:
grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "folder_id": "<folder_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.List ``` You can get the folder ID with the [list of folders in the cloud](../../resource-manager/operations/folder/get-id.md). -
View the server response to make sure your request was successful.
Getting detailed information about a cluster
- In the management console, navigate to the relevant folder.
- In the list of services, select Managed Service for Apache Spark™.
- Click the cluster name.
-
Get an IAM token for API authentication and save it as an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi repository:
cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume the repository contents are stored in the
~/cloudapi/directory. -
Use the ClusterService/Get call and send the following request, e.g., via gRPCurl:
grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.GetYou can get the cluster ID with the list of clusters in the folder.
-
View the server response to make sure your request was successful.
Viewing operations with clusters
All actions with Apache Spark™ clusters are logged as a list of operations. Each operation gets its own unique ID.
Getting a list of operations
To get a list of operations for a Apache Spark™ cluster:
-
In the management console, open the folder with the cluster.
-
Select Managed Service for Apache Spark™.
-
In the left-hand panel, select Clusters.
-
Select the cluster you need.
-
Navigate to the Operations panel for the cluster you selected.
You will see a list of operations with the cluster.
-
Get an IAM token for API authentication and save it as an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi repository:
cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume the repository contents are stored in the
~/cloudapi/directory. -
Use the ClusterService/ListOperations call and send the following request, e.g., via gRPCurl:
grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.ListOperationsYou can get the cluster ID with the list of clusters in the folder.
-
View the server response to make sure your request was successful.