Transferring data from a BigQuery endpoint

When creating or updating an endpoint, make sure to configure BigQuery access.

Yandex Data Transfer enables you to export data from BigQuery to Yandex Cloud managed databases and implement various data processing and transformation scenarios. To set up a transfer:

1. Review the available data transfer scenarios.
2. Prepare the BigQuery database for the transfer.
3. Set up a source endpoint in Yandex Data Transfer.
4. Set up one of the supported data targets.
5. Create and launch the transfer.
6. If you run into any problems, check the available solutions for troubleshooting.

BigQuery transfer scenariosBigQuery transfer scenarios

You can export data from BigQuery to managed databases for cloud storage, processing, and further loading into data marts for visualization.

For a detailed description of possible Yandex Data Transfer scenarios, see Tutorials.

Preparing your BigQuery databasePreparing your BigQuery database

To prepare a BigQuery data source:

1. Create a Google Cloud service account.
2. Add the service account as a participant with the BigQuery User role to the Google Cloud project.
3. Create a Google Cloud service account key.

For more information, see this Airbyte® guide.

Configuring the BigQuery source endpointConfiguring the BigQuery source endpoint

Configuring the data targetConfiguring the data target

Configure one of the supported data targets:

• MySQL®
• MongoDB
• ClickHouse®
• Greenplum®
• Yandex Managed Service for YDB
• Apache Kafka®
• YDS
• PostgreSQL

For a complete list of supported sources and targets in Yandex Data Transfer, see Available transfers.

Make sure that the network hosting the target cluster is configured to allow connections from the internet. To enable internet access, set up routing.

Once you have configured the source and target, create and launch the transfer.