Information about existing clusters
You can get detailed information about each Apache Spark™ cluster you created.
Getting a list of clusters in a folder
- In the management console
, navigate to the relevant folder. - Go to Managed Service for Apache Spark™.
-
Get an IAM token for API authentication and put it into an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/List method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "folder_id": "<folder_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.List ``` You can get the folder ID with the [list of folders in the cloud](../../resource-manager/operations/folder/get-id.md). -
Check the server response to make sure your request was successful.
Getting detailed information about a cluster
- In the management console
, navigate to the relevant folder. - Go to Managed Service for Apache Spark™.
- Click the cluster name.
-
Get an IAM token for API authentication and put it into an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/Get method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.GetYou can get the cluster ID with the list of clusters in the folder.
-
Check the server response to make sure your request was successful.
Viewing operations with clusters
All actions with Apache Spark™ clusters are logged as a list of operations. Each operation gets its own unique ID.
Getting a list of operations
To get a list of operations for a Apache Spark™ cluster:
-
In the management console
, open the folder containing your cluster. -
Go to Managed Service for Apache Spark™.
-
In the left-hand panel, select
Clusters. -
Select the cluster you need.
-
Navigate to the
Operations panel for the cluster you selected.You will see the list of operations with this cluster.
-
Get an IAM token for API authentication and put it into an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/ListOperations method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.ListOperationsYou can get the cluster ID with the list of clusters in the folder.
-
View the server response to make sure your request was successful.