Updating a Yandex Data Processing cluster

Written by

Updated at December 12, 2025

After creating a cluster, you can edit its basic and advanced settings.

You can disable sending cluster logs to Yandex Cloud Logging. For more information, see Working with logs.

You can also move a Yandex Data Processing cluster to a different availability zone. This process depends on the cluster type:

Management console

CLI

Terraform

To change a Yandex Data Processing cluster’s settings:

Navigate to the folder dashboard and select Yandex Data Processing.
Select the cluster and click Edit in the top panel.
Change the cluster name and description in the Cluster name and Description fields.
Add or delete cluster labels in the Labels field:
Update cluster settings:
- Service account: Service account of the Yandex Data Processing cluster.
  
  Select an existing service account or create a new one.
  
  To update a service account in a Yandex Data Processing cluster, assign the iam.serviceAccounts.user role or higher to your Yandex Cloud account.
  
  Warning
  
  If the cluster already uses a service account to access objects from Object Storage, then changing it to a different service account may make these objects unavailable and interrupt the cluster operation. Before changing the service account settings, make sure that the cluster doesn't use the objects in question.
- Properties: Cluster component properties.
  
  Add, edit, or delete the required properties:
  
  Tip
  
  If you want a property to be included into a configuration file relating to a specific component, specify a prefix for the key.
- Bucket ID format: Bucket name selection format, List or ID.
- Bucket name: Name of the bucket that the cluster will use.
  
  Depending on the format you selected, either pick a name from the list or specify it manually. You can request the bucket name with the list of buckets in the folder.
- Security groups: Security groups that the cluster will use.
  
  Select one or more security groups. If the required security group is not in the list, create it.
  
  Warning
  
  Incorrect security group settings may cause performance issues in a Yandex Data Processing cluster. For more information on setting up security groups, see this guide.
- UI Proxy: Option that manages access to component web interfaces via UI Proxy.
  
  Warning
  
  You may need to additionally set up security groups to use UI Proxy.
- Log group: Yandex Cloud Logging log group the cluster will send logs to.
  
  Select the default log group or another existing log group. If the required log group is not in the list, create it.
  
  To enable the cluster to send logs, assign the logging.writer role to its service account. For more information, see the Yandex Cloud Logging documentation.
In the advanced cluster settings, select the required Deletion protection value.

This option manages cluster protection against accidental deletion by a user.

Even with cluster deletion protection enabled, one can still connect to the cluster manually and delete its data.
Click Save changes.

If you do not have the Yandex Cloud CLI installed yet, install and initialize it.

By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also set a different folder for any specific command using the --folder-name or --folder-id parameter.

To change a Yandex Data Processing cluster’s settings:

View the description of the CLI command for updating a cluster:
```
yc dataproc cluster update --help
```
To update the cluster's service account, provide the name or ID of the service account in the --service-account-name or --service-account-id parameter.
```
yc dataproc cluster update <cluster_name_or_ID> \
   --service-account-id=<service_account_ID>
```
To add or update the service account of auto-scalable subclusters, provide the name or ID of the service account in the --autoscaling-service-account-name or --autoscaling-service-account-id parameter.
```
yc dataproc cluster update <cluster_name_or_ID> \
   --autoscaling-service-account-id=<service_account_ID>
```
To edit the log group the cluster logs go to, provide the log group ID in the --log-group-id parameter:
```
yc dataproc cluster update <cluster_name_or_ID> \
   --log-group-id=<log_group_ID>
```
You can request the log group ID with the list of log groups in the folder.
To protect a cluster from accidental deletion by a user of your cloud, add the --deletion-protection parameter:
```
yc dataproc cluster update <cluster_name_or_ID> \
   --deletion-protection
```
Even with cluster deletion protection enabled, one can still connect to the cluster manually and delete its data.
To update component properties, provide the required properties in the --property parameter:
```
yc dataproc cluster update <cluster_name_or_ID> \
   --property "<key_1_prefix>:<key_1>=<value>", "<key_2_prefix>:<key_2>=<value>", ...
```
Warning

The --property option will reset all component properties that were not explicitly provided, to their default values. To save the properties you updated, list them in your request along with the ones you want to update.

You can get the cluster ID and name with the list of clusters in the folder.

To change a Yandex Data Processing cluster’s settings:

Open the current Terraform configuration file describing your infrastructure.

For information on how to create such a file, see Creating a cluster.
To activate cluster deletion protection and access to the web interfaces of the Yandex Data Processing components, update the values in the appropriate fields of the Yandex Data Processing cluster description:
```
resource "yandex_dataproc_cluster" "data_cluster" {
  ...
  deletion_protection = true
  ui_proxy            = true
  ...
}
```
To update the service account of the Yandex Data Processing cluster, edit the service_account_id value in the Yandex Data Processing cluster description:
```
resource "yandex_dataproc_cluster" "data_cluster" {
  ...
  service_account_id = "<service_account_ID>"
  ...
}
```
To add or update a service account to manage auto-scalable subclusters, use the autoscaling_service_account_id argument in the Yandex Data Processing cluster description:
```
resource "yandex_dataproc_cluster" "data_cluster" {
  ...
  autoscaling_service_account_id = "<service_account_ID>"
  ...
}
```
Make sure the settings are correct.
1. In the command line, navigate to the directory that contains the current Terraform configuration files defining the infrastructure.
2. Run this command:
```
terraform validate
```
  Terraform will show any errors found in your configuration files.
Confirm updating the resources.
1. Run this command to view the planned changes:
```
terraform plan
```
  If you described the configuration correctly, the terminal will display a list of the resources to update and their parameters. This is a verification step that does not apply changes to your resources.
2. If everything looks correct, apply the changes:
  1. Run this command:
```
terraform apply
```
  2. Confirm updating the resources.
  3. Wait for the operation to complete.

For more information about the resources you can create with Terraform, see this provider guide.

Updating a Yandex Data Processing cluster

Was the article helpful?