Transferring data from an AWS CloudTrail endpoint

Yandex Data Transfer enables you to export audit logs from AWS CloudTrail to Yandex Cloud managed databases and implement various data processing and transformation scenarios. To set up a transfer:

1. Review the available data transfer scenarios.
2. Prepare your AWS CloudTrail database for the transfer.
3. Set up a source endpoint in Yandex Data Transfer.
4. Set up one of the supported data targets.
5. Create and launch the transfer.
6. If you run into any problems, check the available solutions for troubleshooting.

AWS CloudTrail transfer scenariosAWS CloudTrail transfer scenarios

You can export logs to various databases for cloud storage, processing, and further loading into data marts for visualization.

For a detailed description of possible Yandex Data Transfer scenarios, see Tutorials.

Preparing the AWS CloudTrail databasePreparing the AWS CloudTrail database

Get an AWS key ID and secret access key by following the AWS guide.

For more information, see this Airbyte® guide.

Configuring an AWS CloudTrail source endpointConfiguring an AWS CloudTrail source endpoint

When creating or updating an endpoint, make sure to configure AWS access. For more information, see this Airbyte® guide.

Configuring the data targetConfiguring the data target

Configure one of the supported data targets:

• MySQL®
• MongoDB
• ClickHouse®
• Greenplum®
• Yandex Managed Service for YDB
• Apache Kafka®
• YDS
• PostgreSQL

For a complete list of supported sources and targets in Yandex Data Transfer, see Available transfers.

Make sure that the network hosting the target cluster is configured to allow connections from the internet. To enable internet access, set up routing.

Once you have configured the source and target, create and launch the transfer.

Airbyte® is a registered trademark of Airbyte, Inc in the United States and/or other countries.