Stopping and starting a Apache Spark™ cluster
You can stop and restart an Apache Spark™ cluster as needed. When stopped, a cluster retains all its data. The data will be available again as soon as you restart the cluster.
Stopping a cluster
- In the management console
, navigate to the relevant folder. - Go to Managed Service for Apache Spark™.
- Find the cluster in the list, click
, and select Stop. - In the dialog box that opens, confirm that you want to stop the cluster and click Stop.
-
Get an IAM token for API authentication and put it into an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/Stop method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.StopYou can get the cluster ID with the list of clusters in the folder.
-
View the server response to make sure your request was successful.
Starting a cluster
You can restart clusters with the Stopped status.
- In the management console
, navigate to the relevant folder. - Go to Managed Service for Apache Spark™.
- Find the stopped cluster you need in the list, click
, and select Start. - In the dialog box that opens, click Start.
-
Get an IAM token for API authentication and put it into an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/Start method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.StartYou can get the cluster ID with the list of clusters in the folder.
-
View the server response to make sure your request was successful.