Getting started with Managed Service for Apache Airflow™

To get started with Managed Service for Apache Airflow™:

1. Create a cluster.
2. Open the Apache Airflow™ web interface.

Getting startedGetting started

1. Navigate to the management console and log in to Yandex Cloud or sign up if not signed up yet.

2. If you do not have a folder yet, create one:

   1. In the management console, select the appropriate cloud from the list on the left.

   2. At the top right, click Create folder.

   3. Give your folder a name. The naming requirements are as follows:

      • It must be from 2 to 63 characters long.
      • It can only contain lowercase Latin letters, numbers, and hyphens.
      • It must start with a letter and cannot end with a hyphen.

   4. Optionally, specify the description for your folder.

   5. Select Create a default network. This will create a network with subnets in each availability zone. Within this network, you will also have a default security group, within which all network traffic will be allowed.

   6. Click Create.

   Security group settings do not affect access to the Apache Airflow™ web interface.

3. Assign the following roles to your Yandex Cloud account:

   • managed-airflow.editor to create a cluster.
   • vpc.user to use the cluster network.
   • iam.serviceAccounts.user to attach a service account to a cluster.

   Note

   If you are unable to manage roles, contact your cloud or organization administrator.

4. Create a Yandex Object Storage bucket for storing Managed Service for Apache Airflow™ DAG files.

5. Create a service account.

6. Assign the service account the managed-airflow.integrationProvider role for a folder or bucket.

7. Grant the READ permission for the bucket to the service account.

Create a clusterCreate a cluster

1. In the management console, select the folder where you want to create a Managed Service for Apache Airflow™ cluster.
2. Select Managed Service for Apache Airflow™.
3. Click Create a cluster.
4. Specify your cluster settings and click Create. For more information, see Creating a cluster.
5. Wait until the cluster is ready: its status on the Managed Service for Apache Airflow™ dashboard will change to Running and its state, to Alive. This may take some time.

Open the Apache Airflow™ web interfaceOpen the Apache Airflow™ web interface

You can manage Apache Airflow™ through the web interface. Only users with the managed-airflow.user role or higher can use it. To get started with the Apache Airflow™ web interface:

1. In the management console, open the cluster page.

2. Go to the Managed Service for Apache Airflow™ web server page.

3. In the web interface that opens, enter the credentials:

   • Username: Admin
   • Password: Admin user password that you set when creating a cluster

For more information about how to use the web interface, see the Apache Airflow™ documentation.

In addition to the web interface, you can use the Apache Airflow™ API. For more information, see Working with Apache Airflow™ interfaces.

What's nextWhat's next

• Read about Managed Service for Apache Airflow™ concepts.
• Learn more about creating a cluster and using Apache Airflow™ interfaces.
• Create DAG files and upload them to the Managed Service for Apache Airflow™ cluster. For a DAG file example, check this Apache Airflow™ tutorial.