Data Transfer release notes: March 2024

New featuresNew features

1. Added the following parameters for working with transfers using Terraform:

   • yds_source and yds_target in the yandex_datatransfer_endpoint resource, for working with Data Streams endpoints.
   • runtime and transformation in the yandex_datatransfer_transfer resource, for data transformation support.
   • changefeed_custom_name in the yandex_datatransfer_endpoint resource, for changefeed management in a Managed Service for YDB source.
   • unescape_string_values in the yandex_datatransfer_endpoint resource, for processing string values in JSON files.

2. Documented troubleshooting procedures for errors occurring in the service.

3. For PostgreSQL endpoints in custom installations, added the option to specify multiple host values in <host>:<port> format if cluster hosts are on different ports.

Fixed issuesFixed issues

1. Fixed the memory call error when transferring data from Elasticsearch to OpenSearch.

2. Restored performance of transfers from the Microsoft SQL Server (Airbyte®) source when a subnet is specified in the endpoint settings.

3. Fixed the error of loading data to ClickHouse® due to missing shard names.

4. Fixed the error of logging incorrect timezones in the cloud log.

ClickHouse® is a registered trademark of ClickHouse, Inc.