Contact UsGet started
© 2024 Iron Hive LLC Belgrade

Searching for Yandex Cloud events in Yandex Query

Written by
Updated at November 14, 2024

Audit Trails support is integrated in Yandex Query. You can analyze events of Yandex Cloud resources by executing analytical and streaming YQL queries.

You can execute analytical queries for logs stored in a bucket and streaming queries for logs stored in a Yandex Data Streams data stream.

To connect a bucket with audit logs to Yandex Query and execute YQL queries:

  1. Prepare the environment.
  2. Create a connection between a trail and YQ.
  3. Execute a query to logs in Object Storage.

If you no longer need the resources you created, delete them.

Getting started

Sign up for Yandex Cloud and create a billing account:

  1. Go to the management console and log in to Yandex Cloud or create an account if you do not have one yet.
  2. On the Yandex Cloud Billing page, make sure you have a billing account linked and it has the ACTIVE or TRIAL_ACTIVE status. If you do not have a billing account, create one.

If you have an active billing account, you can go to the cloud page to create or select a folder for your infrastructure to operate in.

Learn more about clouds and folders.

If you do not have the Yandex Cloud command line interface yet, install and initialize it.

The cost of infrastructure support includes a fee for a bucket (see Pricing for Object Storage).

Prepare the environment

Create a bucket for audit logs

  1. In the management console, select the folder where you want to create a bucket, e.g., example-folder.
  2. Select Object Storage.
  3. Click Create bucket.
  4. On the bucket creation page:
    • Enter a name for the bucket according to the naming requirements.
    • In the Object read access, Object listing access, and Read access to settings fields, select Restricted.
    • Leave the default values for other parameters.
  5. Click Create bucket.

Create service accounts

Create a service account named trail-sa:

  1. In the management console, go to example-folder.
  2. In the list of services, select Identity and Access Management.
  3. Click Create service account.
  4. Specify Name: trail-sa.
  5. Click Create.

Similarly, create a service account named bucket-yq-sa.

Assign rights to service accounts

Assign the audit-trails.viewer and storage.uploader roles to the trail-sa service account:

  1. The audit-trails.viewer role for an organization:

    yc organization-manager organization add-access-binding \
--role audit-trails.viewer \
--id <organization_ID> \
--service-account-id <service_account_ID>

    Where --service-account-id is the trail-sa service account ID.

    Result:

    done (1s)

    For more information about the yc organization-manager organization add-access-binding command, see the CLI reference.

  2. The storage.uploader role for a folder:

    yc resource-manager folder add-access-binding example-folder \
  --role storage.uploader \
  --subject serviceAccount:<service_account_ID>

    Where --subject is the trail-sa service account ID.

    Result:

    done (1s)

    For more information about the yc resource-manager folder add-access-binding command, see the CLI reference.

Assign the bucket-yq-sa service account the storage.viewer role for example-folder:

yc resource-manager folder add-access-binding example-folder \
    --role storage.viewer \
    --subject serviceAccount:<service_account_ID>

Where --subject is the bucket-yq-sa service account ID.

Result:

done (1s)

For more information about the yc resource-manager folder add-access-binding command, see the CLI reference.

Create a trail

  1. In the management console, select example-folder.

  2. Select Audit Trails.

  3. Click Create trail.

  4. In the Name field, specify logsyq.

  5. Under Destination, configure the destination object:

    • Destination: Object Storage.
    • Bucket: Select the bucket you created earlier.

  6. Under Service account, select trail-sa.

  7. Under Collecting management events, configure the collection of management event audit logs:

    • Collecting events: Select Enabled.
    • Resource: Select Organization.
    • Organization: Automatically populated field containing the name of the current organization.
    • Cloud: Keep the default value, All.

  8. Under Collecting data events, select Disabled in the Collecting events field.

  9. Click Create.

Create a connection between a trail and YQ

A connection must be created only the first time a trail is connected to YQ.

  1. In the management console, select example-folder.
  2. Select Audit Trails.
  3. Select the logsyq trail.
  4. Click Process in YQ.
  5. Create a connection.
    • Select Service account bucket-yq-sa.
    • Leave the default values for other parameters.
  6. Click Create.
  7. In the window with data binding options, click Create.

You will go to the page for creating a query to trail logs.

Execute a query to logs in Object Storage

Open the page to create an analytical query to Audit Trails logs:

  1. In the management console, select a folder with a trail.
  2. In the list of services, select Audit Trails.
  3. Select the trail for which a connection to YQ is configured.
  4. Click Process in YQ to go to the analytical query execution page.

Run event queries to bind audit-trails-logsyq-object_storage:

  1. Deleting a folder:

    1. Select this query from the list: 1. Find out who deleted the folder.

    2. Edit the query by specifying the folder ID:

      SELECT * FROM bindings.`audit-trails-logsyq-object_storage`
WHERE
    JSON_VALUE(data, "$.event_type") = 'yandex.cloud.audit.resourcemanager.DeleteFolder'
    and JSON_VALUE(data, "$.details.folder_name") = '<folder_ID>'
    LIMIT 100;

    3. Click Execute.

  2. Enabling access via the serial console:

    1. Select this query from the list: 6. Changing a VM: Adding serial console access.

    2. Edit the query by specifying the number of displayed records:

      SELECT * FROM bindings.`<audit-trails-logsyq-object_storage>`
WHERE
    JSON_VALUE(data, "$.event_type") = 'yandex.cloud.audit.compute.UpdateInstance'
    and JSON_VALUE(data, "$.details.metadata_serial_port_enable") = '1'
    LIMIT <number_of_records>;

    3. Click Execute.

  3. Changing access rights to an Object Storage bucket:

    1. Select this query from the list: 11. Suspicious activity with the Audit Trails log repository (Object Storage bucket).

    2. Edit the query by specifying the number of displayed records:

      SELECT * FROM bindings.`audit-trails-logsyq-object_storage`
WHERE
    (JSON_VALUE(data, "$.event_type") = 'yandex.cloud.audit.storage.BucketAclUpdate'
    or JSON_VALUE(data, "$.event_type") = 'yandex.cloud.audit.storage.BucketPolicyUpdate')
    LIMIT <number_of_records>;

    3. Click Execute.

  4. Assigning administrator rights:

    1. Select this query from the list: 20. Assigning admin permissions (for a folder and cloud).

    2. Edit the query by specifying the number of displayed records:

      SELECT * FROM bindings.`audit-trails-logsyq-object_storage`
WHERE
    JSON_VALUE(data, "$.details.access_binding_deltas.access_binding.role_id") = 'admin'
    LIMIT <number_of_records>;

    3. Click Execute.

How to delete the resources you created

If you created a separate bucket to follow these instructions, you can delete it to stop paying for bucket use.

Previous
Viewing operations with a trail
Next
Searching for Yandex Cloud events in Object Storage