Getting started with Managed Service for Apache Airflow™
To get started with the service:
Getting started
-
Go to the management console
and log in to Yandex Cloud or sign up if not signed up yet. -
If you do not have a folder yet, create one:
-
In the management console
, select the appropriate cloud from the list on the left. -
At the top right, click Create folder.
-
Enter the folder name. The naming requirements are as follows:
- The name must be from 3 to 63 characters long.
- It may contain lowercase Latin letters, numbers, and hyphens.
- The first character must be a letter and the last character cannot be a hyphen.
-
(Optional) Enter a description of the folder.
-
Select Create a default network. This will create a network with subnets in each availability zone. Within this network, a default security group will be created, inside which all network traffic is allowed.
-
Click Create.
Security group settings do not affect access to the Apache Airflow™ web interface.
-
-
Make sure your account has the following roles for creating a cluster:
- managed-airflow.editor: To create a cluster.
- vpc.user: To use the cluster network.
- iam.serviceAccounts.user: To link a service account to the cluster.
-
Create a Yandex Object Storage bucket for storing Managed Service for Apache Airflow™ DAG files.
-
Assign the service account the
managed-airflow.integrationProvider
role for a folder or bucket. -
Grant the
READ
permission for the bucket to the service account.
Create a cluster
- In the management console, select the directory where you want to create a cluster.
- Select Managed Service for Apache Airflow™.
- Click Create a cluster.
- Set the cluster parameters and click Create. For more information, see Creating clusters.
- Wait until the cluster is ready: its status on the Managed Service for Apache Airflow™ dashboard will change to Running and its state, to Alive. This may take some time.
Open the Apache Airflow™ web interface
You can manage Apache Airflow™ through the web interface. Only users with the managed-airflow.user role or higher can use it. To get started with the Apache Airflow™ web interface:
-
In the management console
, open the cluster page. -
Go to the Managed Service for Apache Airflow™ web server page.
-
In the web interface that opens, enter the credentials:
- Username:
Admin
- Password:
Admin
user password that you set when creating a cluster
- Username:
For more information about how to use the web interface, see the Apache Airflow™ documentation
In addition to the web interface, you can use the Apache Airflow™ API
What's next
- Read about service concepts.
- Learn more about creating clusters and working with Apache Airflow™ interfaces.
- Create DAG files and upload them to the Managed Service for Apache Airflow™ cluster. For a DAG file example, see the Apache Airflow™ documentation
.