yandex_airflow_cluster (DataSource)

Managed Airflow cluster.

Example usageExample usage

//
// Get information about Apache Airflow cluster by name
//
data "yandex_airflow_cluster" "airflow_cluster_by_name" {
  name = "airflow-created-with-terraform"
}

//
// Get information about Apache Airflow cluster by id
//
data "yandex_airflow_cluster" "airflow_cluster_by_id" {
  id = "<airflow-cluster-id>"
}

Arguments & Attributes ReferenceArguments & Attributes Reference

• admin_password (Read-Only) (String). Password that is used to log in to Apache Airflow web UI under admin user.
• airflow_config (Read-Only) (Map Of Map Of String). Configuration of the Apache Airflow application itself. The value of this attribute is a two-level map. Keys of top-level map are the names of configuration sections. Keys of inner maps are the names of configuration options within corresponding section.
• airflow_version (Read-Only) (String). Apache Airflow version in format <major>.<minor>.
• code_sync [Block]. Parameters of the location and access to the code that will be executed in the cluster.
  • git_sync [Block]. Git repository is supported as the source of DAG files.
    • branch (Required)(String). The name of the Git branch that stores DAG files used in the cluster.
    • password (String). Password or access token for repository authentication. Exactly one of ssh_key or username/password should be specified.
    • repo (Required)(String). The URL of the Git repository that stores DAG files used in the cluster.
    • ssh_key (String). The SSH key that will be used to access the Git repository. Exactly one of ssh_key or username/password should be specified.
    • sub_path (Required)(String). The path to the directory in the Git repository that stores DAG files used in the cluster.
    • username (String). Username for repository authentication. For GitLab access tokens use oauth2. Exactly one of ssh_key or username/password should be specified.
  • s3 [Block]. Object Storage (S3) is supported as the source of DAG files.
    • bucket (Required)(String). The name of the Object Storage bucket that stores DAG files used in the cluster.
• created_at (Read-Only) (String). The creation timestamp of the resource.
• dag_processor [Block]. Configuration of dag-processor instances.
  • count (Read-Only) (Number). The number of dag-processor instances in the cluster.
  • resource_preset_id (Read-Only) (String). The identifier of the preset for computational resources available to an instance (CPU, memory etc.).
• datacatalog [Block]. Configuration of Datacatalog integration.
  • enabled (Read-Only) (Bool). Enables usage of Datacatalog integration.
• deb_packages (Read-Only) (Set Of String). System packages that are installed in the cluster.
• deletion_protection (Read-Only) (Bool). The true value means that resource is protected from accidental deletion.
• description (Read-Only) (String). The resource description.
• folder_id (String). The folder identifier that resource belongs to. If it is not provided, the default provider folder-id is used.
• id (String). The resource identifier. Exactly one of the attributes id or name should be specified.
• labels (Read-Only) (Map Of String). A set of key/value label pairs which assigned to resource.
• lockbox_secrets_backend [Block]. Configuration of Lockbox Secrets Backend. See documentation for details.
  • enabled (Read-Only) (Bool). Enables usage of Lockbox Secrets Backend.
• logging [Block]. Cloud Logging configuration.
  • enabled (Read-Only) (Bool). Enables delivery of logs generated by the Airflow components to Cloud Logging.
  • folder_id (Read-Only) (String). Logs are written to default log group of specified folder.
  • log_group_id (Read-Only) (String). Logs are written to the specified log group.
  • min_level (Read-Only) (String). Minimum level of messages that are sent to Cloud Logging. Can be either TRACE, DEBUG, INFO, WARN, ERROR or FATAL.
• maintenance_window [Block]. Configuration of window for maintenance operations.
  • day (Read-Only) (String). Day of week for maintenance window. One of MON, TUE, WED, THU, FRI, SAT, SUN.
  • hour (Read-Only) (Number). Hour of day in UTC time zone (1-24) for maintenance window.
  • type (Read-Only) (String). Type of maintenance window. Can be either ANYTIME or WEEKLY. If WEEKLY, day and hour must be specified.
• name (String). The resource name. Exactly one of the attributes id or name should be specified.
• pip_packages (Read-Only) (Set Of String). Python packages that are installed in the cluster.
• python_version (Read-Only) (String). Version of Python that Airflow will run on. Must be in format <major>.<minor>.
• scheduler [Block]. Configuration of scheduler instances.
  • count (Read-Only) (Number). The number of scheduler instances in the cluster.
  • resource_preset_id (Read-Only) (String). The identifier of the preset for computational resources available to an instance (CPU, memory etc.).
• security_group_ids (Read-Only) (Set Of String). The list of security groups applied to resource or their components.
• service_account_id (Read-Only) (String). Service account which linked to the resource. For more information, see documentation.
• status (Read-Only) (String). Status of the cluster. Can be either CREATING, STARTING, RUNNING, UPDATING, STOPPING, STOPPED, ERROR or STATUS_UNKNOWN. For more information see status field of JSON representation in the official documentation.
• subnet_ids (Read-Only) (Set Of String). The list of VPC subnets identifiers which resource is attached.
• triggerer [Block]. Configuration of triggerer instances.
  • count (Read-Only) (Number). The number of triggerer instances in the cluster.
  • resource_preset_id (Read-Only) (String). The identifier of the preset for computational resources available to an instance (CPU, memory etc.).
• webserver [Block]. Configuration of webserver instances.
  • count (Read-Only) (Number). The number of webserver instances in the cluster.
  • resource_preset_id (Read-Only) (String). The identifier of the preset for computational resources available to an instance (CPU, memory etc.).
• worker [Block]. Configuration of worker instances.
  • max_count (Read-Only) (Number). The maximum number of worker instances in the cluster.
  • min_count (Read-Only) (Number). The minimum number of worker instances in the cluster.
  • resource_preset_id (Read-Only) (String). The identifier of the preset for computational resources available to an instance (CPU, memory etc.).
• timeouts [Block].
  • read (String). A string that can be parsed as a duration consisting of numbers and unit suffixes, such as "30s" or "2h45m". Valid time units are "s" (seconds), "m" (minutes), "h" (hours). Read operations occur during any refresh or planning operation when refresh is enabled.