Transferring data from a YTsaurus source endpoint
Yandex Data Transfer enables you to migrate data from YTsaurus tables to managed databases and implement various data transfer, processing, and transformation scenarios. To implement a transfer:
- Explore possible data transfer scenarios.
- Set up a source endpoint in Yandex Data Transfer.
- Set up one of the supported data targets.
- Create a transfer and start it.
- Perform the required operations with the database and see how the transfer is going.
Scenarios for transferring data from YTsaurus
You can implement scenarios for loading data from tables into Yandex Cloud managed databases for storage in the cloud, processing, and loading into data marts for visualization.
For a detailed description of possible Yandex Data Transfer scenarios, see Tutorials.
Configuring the Managed Service for YTsaurus source endpoint
When creating or updating an endpoint, configure access to the Managed Service for YTsaurus cluster:
-
Service account ID: Select or create a service account with the
managed-ytsaurus.editorrole that Data Transfer will use to connect to the cluster. -
Cluster ID: Select the cluster to connect to.
-
Security groups: Select the following:
- Cloud network for hosting the endpoint.
- Security groups for network traffic.
Security group rules apply to a transfer. They allow opening up network access from the transfer VM to the cluster. Learn more in Networking in Yandex Data Transfer.
- Tables and directories: Paths to data tables. To add a new path, click + Path and enter the value.
Configuring the data target
Configure one of the supported data targets:
For a complete list of supported sources and targets in Yandex Data Transfer, see Available transfers.
After configuring the data source and target, create and start the transfer.