Getting started as a metadata analyst
Note
This feature is at the Preview stage.
Using Yandex Data Catalog as a metadata analyst, you can analyze and visualize metadata on Yandex Cloud objects and links between them.
To get started:
- View the metadata catalog.
- View the metadata information.
- Find metadata using search.
- Configure metadata filters.
- View marked up resources.
Getting started
-
Navigate to the management console
and log in to Yandex Cloud, or sign up if you have not already. -
Contact your working cloud or organization administrator for access to the resource catalog the metadata is processed in.
-
Make sure your account has the
data-catalog.dataConsumerrole for the working catalog to view and update Data Catalog resources.If you do not have the role, contact the metadata catalog administrator in your cloud or organization.
-
Check with your cloud or organization administrator as to which metadata catalog you should be using.
View the metadata catalog
- In the management console
, select your working resource folder. - Navigate
to Yandex MetaData Hub. - Under Manage metadata, select Data Catalog.
- Select the metadata catalog you need.
- Navigate to the Search tab to view the metadata available in the catalog.
View metadata information
-
In the management console
, select your working metadata catalog. -
Navigate to the Search tab and select the dataset of interest.
-
To view general dataset information, navigate to the Overview tab and expand the list with the parameters you are looking for.
-
To view the object schema, navigate to the Schema tab and select the schema version from the drop-down list.
-
To view links with other objects go to the Lineage tab.
You can set the lineage depth and turn Additional connections on or off.
Data Catalog displays links not just between objects but also between individual columns within objects. To view links between columns, expand the list of columns in the object of interest.
-
Go to the Queries tab to view data queries.
Find metadata using search
-
In the management console
, select your working metadata catalog. -
Navigate to the Search tab.
-
By default, you search across all data types. If you need only specific data types, select them in the drop-down list to the left of the search bar.
-
In the Data search field, enter the search query.
-
To increase the relevance of search results, refine your search query and configure metadata filters.
The number of filters you can use depends on the data types you select. If you are working with several data types at the same time, only filters valid for all selected data types will be available.
You can increase the number of available filters by carefully selecting your data types.
Note
With AI search enabled, the AI assistant analyzes your query and available data and provides an answer or a brief summary of the information relevant to your query along with search results.
The rows of data the AI assistant referenced when generating the response are highlighted.
Configure metadata filters
-
In the management console
, select your working metadata catalog. -
Navigate to the Search tab.
-
Click
Add filter. -
Filter metadata by one or more tags created in the catalog.
You can also add other filters. The number of filters you can use depends on the data types selected in the list to the left of the search bar. If you are working with several data types at the same time, only filters valid for all selected data types will be available.
You can increase the number of available filters by carefully selecting your data types.
View marked up resources
Domains
- In the management console
, select your working metadata catalog. - Navigate to the Domains tab.
- Select the domain or subdomain from the list.
- Navigate to the Search tab. It will present the list of datasets marked up by the current domain or containing fields marked up by the current domain.
- To find specific data, enter your query in the search bar above the data list.
- To go to the dataset, click its name in the list.
Terms
- In the management console
, select your working metadata catalog. - Navigate to the Terms and glossaries tab.
- Select the glossary containing the term you are looking for.
- Select the term from the list.
- Navigate to the Search tab. It will present the list of datasets marked up by the current term or containing fields marked up by the current term.
- To find specific data, enter your query in the search bar above the data list.
- To go to the dataset, click its name in the list.
Tags
- In the management console
, select your working metadata catalog. - Navigate to the Tags and classifications tab.
- Select the classification containing the tag you are looking for.
- Select the tag from the list. The tag page will present the list of datasets marked up by the current tag or containing fields marked up by the current tag.
- To find specific data, enter your query in the search bar above the data list.
- To go to the dataset, click its name in the list.
What's next
- Create a term in a glossary.
- Create a child term.
- Update a glossary.
- Edit a term in a glossary.
- Create a tag in a classification.
- Update a classification.
- Edit a tag in a classification.
Useful links
Getting started as a metadata steward
A glossary is a dictionary of domain-specific terms and their definitions. It acts as a single source of truth for terminology used within a company. For more information, see Glossaries and terms.
A domain is a high-level logical group used to organize metadata based on your business process needs, e.g., by departments or business units. For each domain, you can create a subdomain. For more information, see Domains and subdomains.
A metadata catalog is the main entity within Data Catalog. It acts both as a repository for aggregating and storing metadata ingested from various sources and as a workspace for its markup. For more information, see Metadata catalog.
A classification is a group of tags used to mark up metadata. For more information, see Classifications and tags.
A subdomain is a nested metadata unit within a domain used for more granular distribution of metadata. For more information, see Domains and subdomains.
A tag is a label used to mark up metadata by type, e.g., sensitive data or table attributes. For more information, see Classifications and tags.
A term is a concept used to mark up data by its semantic meaning based on an organization’s official definitions, e.g., revenue or expenses. For more information, see Glossaries and terms.