Discuss with expertTry it for free
© 2026 Direct Cursus Technology L.L.C.

Creating a schema registry to deliver data in Debezium CDC format from Apache Kafka®

Written by
Updated at May 18, 2026

You can create a schema registry to track schema evolution for an Apache Kafka® or Yandex Managed Service for Apache Kafka® source using Yandex Data Transfer. This tutorial tracks the evolution of schemas for a Managed Service for Apache Kafka® source.

To track schema changes for a Managed Service for Apache Kafka® source:

  1. Set up your infrastructure.
  2. Create a schema registry.
  3. Prepare and run your transfer.

If you no longer need the resources you created, delete them.

Getting started

Sign up for Yandex Cloud and create a billing account:

  1. Navigate to the management console and log in to Yandex Cloud or create a new account.
  2. On the Yandex Cloud Billing page, make sure you have a billing account linked and it has the ACTIVE or TRIAL_ACTIVE status. If you do not have a billing account, create one and link a cloud to it.

If you have an active billing account, you can create or select a folder for your infrastructure on the cloud page.

Learn more about clouds and folders here.

Set up your infrastructure

Create a Managed Service for Apache Kafka® cluster of any suitable configuration. If you intend to connect to broker hosts from the internet, enable public access. In this case, you can only connect to them using SSL.

Create a schema registry

  1. In the management console, select the folder you are going to use to work with your schema registry.
  2. Navigate to Yandex MetaData Hub.
  3. In the left-hand panel, select Schema Registry / Namespace.
  4. Click Create namespace.
  5. Specify namespace settings. After saving a namespace, you can use its ID to get the Schema Registry URL: {namespace_id}.schema-registry.yandexcloud.net:443.

Prepare and run your transfer

  1. Open the management console.

  2. Navigate to Yandex Data Transfer.

  3. Create an Apache Kafka® source endpoint with the following settings:

    • Database type: Apache Kafka®.

    • Connection type: Manual setup.

    • Installation type: Managed Service for Apache Kafka® cluster.

    • Under Managed Service for Apache Kafka® cluster:

      • Managed Service for Apache Kafka® cluster: Select the Managed Service for Apache Kafka® cluster you created previously.
      • Authentication: SASL.
      • Username and Password: User credentials in the Managed Service for Apache Kafka® cluster.

    • Under Advanced settings → Conversion rules:

      • Conversion rules: Debezium CDC parser.
      • Schema Registry connection settings: On Premise Schema Registry.
      • Schema Registry URL: Schema Registry URL you got earlier.

  4. Create and run a data transfer.

Delete the resources you created

Note

Before deleting the resources, deactivate the transfer.

Some resources are not free of charge. Delete the resources you no longer need to avoid paying for them:

Previous
Deleting a subject
Next
Schema registry