Contact UsGet started

Transferring data from a Microsoft SQL Server source endpoint

Written by
Updated at October 2, 2024

Yandex Data Transfer enables you to migrate data from a Microsoft SQL Server database to Yandex Cloud managed databases and implement various data processing and transformation scenarios. To implement a transfer:

  1. Explore possible data transfer scenarios.
  2. Prepare the Microsoft SQL Server database for the transfer.
  3. Set up an endpoint source in Yandex Data Transfer.
  4. Set up one of the supported data targets.
  5. Create a transfer and start it.
  6. In case of any issues, use ready-made solutions to resolve them.

Scenarios for transferring data from Microsoft SQL Server

You can implement scenarios for data migration and delivery from a Microsoft SQL Server database to managed databases for further storage in the cloud, processing and loading into data marts for further visualization.

For a detailed description of possible Yandex Data Transfer data transfer scenarios, see Tutorials.

Preparing the Microsoft SQL Server database

Airbyte® has the following requirements for a Microsoft SQL Server data source:

  1. Make sure your database is accessible from the computer running Airbyte®.
  2. Create a dedicated read-only Airbyte® user with access to all tables that require replication.

For more information, see the Airbyte® documentation.

Airbyte® is already built into Data Transfer, so you do not have to create a separate VM to deploy it and add a user. All you have to do is grant Data Transfer network access to the source database.

Configuring the Microsoft SQL Server source endpoint

When creating an endpoint, select MSSQL as your database type and configure access to SQL Server. You can change the settings after you create an endpoint.

  • Host: IP address or FQDN of the host you want to connect to.

  • Port: Port number Data Transfer will use for connections to the host.

  • Database: Name of the DB to connect to.

  • Username, Password: DB user name and password.

  • Replication method: Replication method used to retrieve data from the database. STANDARD replication requires setup on the DB side, while it does not show data changes. CDC replication allows identifying data inserts, updates, and deletes.

  • SSL Method: Encryption method used when exchanging data with the database:

    • UNENCRYPTED: Saving the password as plain text.

    • ENCRYPTER (trust cert): Using a certificate from a trusted source.

    • ENCRYPTER (verify cert): Using a self-signed certificate.

For more information about the settings, see the Airbyte® documentation.

Configuring the data target

Configure one of the supported data targets:

For a complete list of supported sources and targets in Yandex Data Transfer, see Available Transfers.

Make sure that the network hosting the target cluster is configured to allow connections from the internet. To enable internet access, set up routing.

After configuring the data source and target, create and start the transfer.

Airbyte® is a registered trademark of Airbyte, Inc in the United States and/or other countries.

ClickHouse® is a registered trademark of ClickHouse, Inc.

Greenplum® and Greenplum Database® are registered trademarks or trademarks of VMware, Inc. in the United States and/or other countries.

Previous
Source
Next
Source