Updating an Apache Airflow™ cluster

Go to the folder page and select Managed Service for Apache Airflow™.

Select the cluster and click Edit in the top panel.

Under Basic parameters, edit the cluster name and description, delete labels, or add new ones.

Under Access settings, select a service account or create a new one with the managed-airflow.integrationProvider role. Thus the cluster will get the permissions required for working with user resources. For more information, see Impersonation.

Under Network settings, select a security group for cluster network traffic or create a new group.

Security group settings do not affect access to the Apache Airflow™ web interface.

Under the settings of Managed Service for Apache Airflow™ components, such as Web server configuration, Scheduler configuration, and Worker configuration, specify the number of instances and resources.

Under Triggerer configuration, enable or disable the Triggerer service. If it is enabled, specify the number of instances and resources.

Under Dependencies, delete or add names of pip and deb packages.

Under DAG file storage, select an existing bucket to store DAG files or create a new one. Make sure to grant the READ permission for this bucket to the cluster service account.

Under Advanced settings, enable or disable deletion protection.

Under Airflow configuration:

• Add, edit, or delete Apache Airflow™ additional properties, e.g., the api.maximum_page_limit key with 150 for its value.

  Populate the fields manually or import a configuration from a file (see sample configuration file).

• Enable or disable the Use Lockbox Secret Backend option allowing you to use secrets in Yandex Lockbox to store Apache Airflow™ configuration data, variables, and connection parameters.

  To extract the required information from the secret, the cluster service account must have the lockbox.payloadViewer role.

  You can assign this role either at whole folder level or individual secret level.

Click Save changes.