Creating a trigger for Cloud Logging that invokes a Cloud Functions function

If you do not have the Yandex Cloud command line interface yet, install and initialize it.

The folder specified in the CLI profile is used by default. You can specify a different folder using the --folder-name or --folder-id parameter.

To create a trigger that invokes a function, run this command:

yc serverless trigger create logging \
  --name <trigger_name> \
  --log-group-name <log_group_name> \
  --batch-size <message_group_size> \
  --batch-cutoff <maximum_timeout> \
  --resource-ids <resource_ID> \
  --resource-types <resource_type> \
  --stream-names <logging_stream> \
  --log-levels <logging_level> \
  --invoke-function-id <function_ID> \
  --invoke-function-service-account-id <service_account_ID> \
  --retry-attempts <number_of_retry_attempts> \
  --retry-interval <interval_between_retry_attempts> \
  --dlq-queue-id <dead-letter_queue_ID> \
  --dlq-service-account-id <service_account_ID>

Where:

• --name: Trigger name.
• --log-group-name: Name of the log group that will invoke a function when entries are added to it.

• --batch-size: Message batch size. This is an optional parameter. The values may range from 1 to 10. The default value is 1.
• --batch-cutoff: Maximum wait time. This is an optional parameter. The values may range from 1 to 60 seconds. The default value is 1 second. The trigger groups messages for a period not exceeding batch-cutoff and sends them to a function. The number of messages cannot exceed batch-size.

• --resource-ids: IDs of Yandex Cloud or your resources, such as Cloud Functions functions. This is an optional parameter.
• --resource-types: Resource types, such as serverless.function for Cloud Functions functions. This is an optional parameter.
• --stream-names: Log streams. This is an optional parameter.
• --log-levels: Logging levels. This is an optional parameter.
  The trigger fires when the specified log group receives records that match all of the following parameters: resource-ids, resource-types, stream-names, and log-levels. If a parameter is not specified, the trigger fires for any value of the parameter.

• --invoke-function-id: Function ID.
• --invoke-function-service-account-id: ID of the service account with permissions to invoke the function.
• --retry-attempts: Number of invocation retries before the trigger moves a message to the dead-letter queue. This is an optional parameter. The values may range from 1 to 5. The default value is 1.
• --retry-interval: Time after which the function will be invoked again if the current attempt fails. This is an optional parameter. The values may range from 10 to 60 seconds. The default value is 10 seconds.
• --dlq-queue-id: Dead-letter queue ID. This is an optional parameter.
• --dlq-service-account-id: ID of the service account with write permissions to the dead-letter queue. This is an optional parameter.

Result:

id: a1sfe084v4**********
folder_id: b1g88tflru**********
created_at: "2019-12-04T08:45:31.131391Z"
name: logging-trigger
rule:
  logging:
    log-group-name: default
    resource_type:
      - serverless.functions
    resource_id:
      - d4e1gpsgam78********
    stream_name:
      - test
    levels:
      - INFO
    batch_settings:
      size: "1"
      cutoff: 1s
    invoke_function:
      function_id: d4eofc7n0m**********
      function_tag: $latest
      service_account_id: aje3932acd**********
      retry_settings:
        retry_attempts: "1"
        interval: 10s
      dead_letter_queue:
        queue-id: yrn:yc:ymq:ru-central1:aoek49ghmk**********:dlq
        service-account-id: aje3932a**********
status: ACTIVE

With Terraform, you can quickly create a cloud infrastructure in Yandex Cloud and manage it using configuration files. These files store the infrastructure description written in HashiCorp Configuration Language (HCL). If you change the configuration files, Terraform automatically detects which part of your configuration is already deployed, and what should be added or removed.

Terraform is distributed under the Business Source License. The Yandex Cloud provider for Terraform is distributed under the MPL-2.0 license.

For more information about the provider resources, see the documentation on the Terraform website or mirror website.

If you don't have Terraform, install it and configure the Yandex Cloud provider.

To create a trigger for Cloud Logging:

1. In the Terraform configuration file, describe the parameters of the resources you want to create:

   resource "yandex_function_trigger" "my_trigger" {
     name        = "<trigger_name>"
     description = "<trigger_description>"
     function {
        id                 = "<function_ID>"
        service_account_id = "<service_account_ID>"
        retry_attempts     = "<number_of_retry_attempts>"
        retry_interval     = "<interval_between_retry_attempts>"
     }
     logging {
        group_id       = "<log_group_ID>"
        resource_types = [ "<resource_type>" ]
        resource_ids   = [ "<resource_ID>" ]
        stream_names   = [ "<logging_stream>" ]
        levels         = [ "<logging_level>", "<logging_level>" ]
        batch_cutoff   = "<maximum_timeout>"
        batch_size     = "<message_group_size>"
     }
     dlq {
       queue_id           = "<dead-letter_queue_ID>"
       service_account_id = "<service_account_ID>"
     }
   }
   

   Where:

   • name: Trigger name. The name format is as follows:

     • The name must be from 3 to 63 characters long.
     • It may contain lowercase Latin letters, numbers, and hyphens.
     • The first character must be a letter and the last character cannot be a hyphen.

   • description: Trigger description.

   • function: Function parameters:

     • id: Function ID.
     • service_account_id: ID of the service account with permissions to invoke the function.
     • retry_attempts: Number of invocation retries before the trigger moves a message to the dead-letter queue. This is an optional parameter. The values may range from 1 to 5. The default value is 1.
     • retry_interval: Time until another attempt is made to invoke the function if the current attempt fails. This is an optional parameter. The values may range from 10 to 60 seconds. The default value is 10 seconds.

   • logging: Trigger parameters:

     • group_id: ID of the log group that will invoke a function when entries are added to it.

     • resource_types: Types of resources, e.g., of the resource_types = [ "serverless.function" ] Cloud Functions function. You can specify multiple types.

     • resource_ids: IDs of your resources or Yandex Cloud resources, e.g., of the resource_ids = [ "<function_ID>" ] functions. You can specify multiple IDs.

     • stream_names: Log streams. This is an optional parameter.

     • levels: Logging levels. For example, levels = [ "INFO", "ERROR"].

       A trigger fires when the specified log group receives entries that comply with all of the following parameters: resource-ids, resource-types, stream-names, and levels. If a parameter is not specified, the trigger fires for any value of the parameter.

     • batch_cutoff: Maximum wait time. Acceptable values are from 0 to 60 seconds. The trigger groups messages for a period of time not exceeding the specified timeout and sends them to a function. The number of messages cannot exceed the specified batch-size.

     • batch_size: Message batch size. Acceptable values are from 1 to 10.

   • dlq: Dead-letter queue message parameters:
     • queue_id: Dead-letter queue ID. This is an optional parameter.
     • service_account_id: ID of the service account with write permissions to the dead-letter queue. This is an optional parameter.

   For more information about the yandex_function_trigger resource parameters, see the provider documentation.

2. Create resources:

   1. In the terminal, change to the folder where you edited the configuration file.

   2. Make sure the configuration file is correct using the command:

      terraform validate
      

      If the configuration is correct, the following message is returned:

      Success! The configuration is valid.
      

   3. Run the command:

      terraform plan
      

      The terminal will display a list of resources with parameters. No changes are made at this step. If the configuration contains errors, Terraform will point them out.

   4. Apply the configuration changes:

      terraform apply
      

   5. Confirm the changes: type yes in the terminal and press Enter.

   Terraform will create all the required resources. You can check the new resources using the management console or this CLI command:

   yc serverless trigger list
   

To create a trigger for Cloud Logging, use the create REST API method for the Trigger resource or the TriggerService/Create gRPC API call.