Contact UsTry it for free
© 2026 Direct Cursus Technology L.L.C.

Stopping and restarting an Apache Spark™ cluster

Written by
Updated at May 5, 2026

If necessary, you can stop and restart your Apache Spark™ cluster. When stopped, a cluster retains all its data. The data will be available again as soon as you restart the cluster.

Stopping a cluster

  1. In the management console, navigate to the relevant folder.
  2. Go to Managed Service for Apache Spark™.
  3. Find the cluster in the list, click , and select Stop.
  4. In the dialog box that opens, confirm that you want to stop the cluster and click Stop.

If you do not have the Yandex Cloud CLI yet, install and initialize it.

The folder used by default is the one specified when creating the CLI profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also specify a different folder for any command using --folder-name or --folder-id. If you access a resource by its name, the search will be limited to the default folder. If you access a resource by its ID, the search will be global, i.e., through all folders based on access permissions.

To stop an Apache Spark™ cluster, run this command:

yc managed-spark cluster stop <cluster_name_or_ID>

You can get the cluster name and ID with the list of clusters in the folder.

  1. Get an IAM token for API authentication and place it in an environment variable:

    export IAM_TOKEN="<IAM_token>"

  2. Clone the cloudapi repository:

    cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapi

    Below, we assume that the repository contents reside in the ~/cloudapi/ directory.

  3. Call the ClusterService/Stop method, e.g., via the following gRPCurl request:

    grpcurl \
    -format json \
    -import-path ~/cloudapi/ \
    -import-path ~/cloudapi/third_party/googleapis/ \
    -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \
    -rpc-header "Authorization: Bearer $IAM_TOKEN" \
    -d '{
            "cluster_id": "<cluster_ID>"
        }' \
    spark.api.cloud.yandex.net:443 \
    yandex.cloud.spark.v1.ClusterService.Stop

    You can get the cluster ID from the list of clusters in your folder.

  4. Check the server response to make sure your request was successful.

Starting a cluster

You can restart clusters with the Stopped status.

  1. In the management console, navigate to the relevant folder.
  2. Go to Managed Service for Apache Spark™.
  3. Find the stopped cluster in the list, click , and select Start.
  4. In the dialog box that opens, click Start.

If you do not have the Yandex Cloud CLI yet, install and initialize it.

The folder used by default is the one specified when creating the CLI profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also specify a different folder for any command using --folder-name or --folder-id. If you access a resource by its name, the search will be limited to the default folder. If you access a resource by its ID, the search will be global, i.e., through all folders based on access permissions.

To start an Apache Spark™ cluster, run this command:

yc managed-spark cluster start <cluster_name_or_ID>

You can get the cluster name and ID with the list of clusters in the folder.

  1. Get an IAM token for API authentication and place it in an environment variable:

    export IAM_TOKEN="<IAM_token>"

  2. Clone the cloudapi repository:

    cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapi

    Below, we assume that the repository contents reside in the ~/cloudapi/ directory.

  3. Call the ClusterService/Start method, e.g., via the following gRPCurl request:

    grpcurl \
    -format json \
    -import-path ~/cloudapi/ \
    -import-path ~/cloudapi/third_party/googleapis/ \
    -proto ~/cloudapi/yandex/cloud/spark/v1/cluster_service.proto \
    -rpc-header "Authorization: Bearer $IAM_TOKEN" \
    -d '{
            "cluster_id": "<cluster_ID>"
        }' \
    spark.api.cloud.yandex.net:443 \
    yandex.cloud.spark.v1.ClusterService.Start

    You can get the cluster ID from the list of clusters in your folder.

  4. Check the server response to make sure your request was successful.

Previous
Maintenance
Next
Managing cluster access