Getting started as a metadata steward

When using Yandex Data Catalog as a metadata steward, you can collect and organize metadata on Yandex Cloud objects and links between them.

Data Catalog can collect metadata from the following services:

• PostgreSQL
• MySQL®
• ClickHouse®
• Yandex Data Transfer
• WebSQL
• Yandex StoreDoc/ MongoDB
• OpenSearch
• Greenplum®

To get started:

1. Create a metadata catalog.
2. Create a metadata source.
3. Create data ingestions from sources on a schedule.
4. Test the ingested metadata.
5. Create a classification and tags.
6. Create a domain and subdomains.
7. Create a glossary and terms.
8. Mark up the obtained data.

Required paid resourcesRequired paid resources

The cost of infrastructure support includes a fee for Yandex Managed Service for PostgreSQL cluster computing resources, storage volume, and backups (see Managed Service for PostgreSQL pricing).

Getting startedGetting started

1. Navigate to the management console and log in to Yandex Cloud or sign up if not signed up yet.

2. If you do not have a resource folder, create one:

   1. In the management console, select the appropriate cloud from the list on the left.

   2. At the top right, click Create folder.

   3. Give your folder a name. The naming requirements are as follows:

      • It must be from 2 to 63 characters long.
      • It can only contain lowercase Latin letters, numbers, and hyphens.
      • It must start with a letter and cannot end with a hyphen.

   4. Optionally, specify the description for your folder.

   5. Select Create a default network. This will create a network with subnets in each availability zone. Within this network, you will also have a default security group, within which all network traffic will be allowed.

   6. Click Create.

3. Assign your Yandex Cloud account the following roles for the resource folder:

   • data-catalog.dataSteward: To create and manage Data Catalog resources.
   • vpc.user: To use the cluster network.

   Note

   If you are unable to manage roles, contact your cloud or organization administrator.

4. Create a Managed Service for PostgreSQL cluster to supply data from as a test load.

Create a metadata catalogCreate a metadata catalog

Create a metadata source and ingestionCreate a metadata source and ingestion

Test the ingested metadataTest the ingested metadata

Create a classification and tagsCreate a classification and tags

Create a classificationCreate a classification

Create tagsCreate tags

Create a domain and subdomainsCreate a domain and subdomains

Create a domainCreate a domain

Create a subdomainCreate a subdomain

Create a glossary and termsCreate a glossary and terms

Create a glossaryCreate a glossary

Create termsCreate terms

Mark up the obtained dataMark up the obtained data

What's nextWhat's next

• Create a term in a glossary.
• Create a child term.
• Update a glossary.
• Edit a term in a glossary.
• Create a tag in a classification.
• Update a classification.
• Edit a tag in a classification.