Contact UsGet started
© 2025 Direct Cursus Technology L.L.C.

Stopping and starting a Apache Spark™ cluster

Written by
Updated at October 20, 2025

You can stop and restart an Apache Spark™ cluster as needed. When stopped, a cluster retains all its data. The data will be available again as soon as you restart the cluster.

Stopping a cluster

  1. In the management console, navigate to the relevant folder.
  2. In the list of services, select Managed Service for Apache Spark™.
  3. Find the cluster in the list, click , and select Stop.
  4. In the dialog box that opens, confirm that you want to stop the cluster and click Stop.

  1. Get an IAM token for API authentication and save it as an environment variable:

    export IAM_TOKEN="<IAM_token>"

  2. Clone the cloudapi repository:

    cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapi

    Below, we assume the repository contents are stored in the ~/cloudapi/ directory.

  3. Use the ClusterService/Stop call to make a request, e.g., via gRPCurl:

    grpcurl \
    -format json \
    -import-path ~/cloudapi/ \
    -import-path ~/cloudapi/third_party/googleapis/ \
    -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \
    -rpc-header "Authorization: Bearer $IAM_TOKEN" \
    -d '{
            "cluster_id": "<cluster_ID>"
        }' \
    spark.api.cloud.yandex.net:443 \
    yandex.cloud.spark.v1.ClusterService.Stop

    You can get the cluster ID with the list of clusters in the folder.

  4. View the server response to make sure your request was successful.

Starting a cluster

You can restart clusters with the Stopped status.

  1. In the management console, navigate to the relevant folder.
  2. In the list of services, select Managed Service for Apache Spark™.
  3. Find the stopped cluster you need in the list, click , and select Start.
  4. In the dialog box that opens, click Start.

  1. Get an IAM token for API authentication and save it as an environment variable:

    export IAM_TOKEN="<IAM_token>"

  2. Clone the cloudapi repository:

    cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapi

    Below, we assume the repository contents are stored in the ~/cloudapi/ directory.

  3. Use the ClusterService/Start call to make a request, e.g., via gRPCurl:

    grpcurl \
    -format json \
    -import-path ~/cloudapi/ \
    -import-path ~/cloudapi/third_party/googleapis/ \
    -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \
    -rpc-header "Authorization: Bearer $IAM_TOKEN" \
    -d '{
            "cluster_id": "<cluster_ID>"
        }' \
    spark.api.cloud.yandex.net:443 \
    yandex.cloud.spark.v1.ClusterService.Start

    You can get the cluster ID with the list of clusters in the folder.

  4. View the server response to make sure your request was successful.

Previous
Updating a cluster
Next
Deleting a cluster