Stopping and restarting an Apache Spark™ cluster
If necessary, you can stop and restart your Apache Spark™ cluster. When stopped, a cluster retains all its data. The data will be available again as soon as you restart the cluster.
Stopping a cluster
- In the management console
, navigate to the relevant folder. - Go to Managed Service for Apache Spark™.
- Find the cluster in the list, click
, and select Stop. - In the dialog box that opens, confirm that you want to stop the cluster and click Stop.
If you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id parameter.
To stop an Apache Spark™ cluster, run this command:
yc managed-spark cluster stop <cluster_name_or_ID>
You can get the cluster name and ID with the list of clusters in the folder.
-
Get an IAM token for API authentication and place it in an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/Stop method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.StopYou can get the cluster ID from the list of clusters in your folder.
-
Check the server response to make sure your request was successful.
Starting a cluster
You can restart clusters with the Stopped status.
- In the management console
, navigate to the relevant folder. - Go to Managed Service for Apache Spark™.
- Find the stopped cluster in the list, click
, and select Start. - In the dialog box that opens, click Start.
If you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id parameter.
To start an Apache Spark™ cluster, run this command:
yc managed-spark cluster start <cluster_name_or_ID>
You can get the cluster name and ID with the list of clusters in the folder.
-
Get an IAM token for API authentication and place it in an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService/Start method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>" }' \ spark.api.cloud.yandex.net:443 \ yandex.cloud.spark.v1.ClusterService.StartYou can get the cluster ID from the list of clusters in your folder.
-
Check the server response to make sure your request was successful.