Using Yezzey in Managed Service for Greenplum®

The Yezzey extension allows you to use hybrid storage in a Managed Service for Greenplum® cluster for storing append-optimized tables.

You can export rarely used tables of this type to a cold storage and continue working with them as with ordinary tables. You can upload tables back to the cluster storage if you need to.

For more information about Yezzey and storage types, see Hybrid storage.

Installing Yezzey in a Greenplum® clusterInstalling Yezzey in a Greenplum® cluster

1. Enable the hybrid storage option if you did not do this when creating the cluster.

   Warning

   You cannot disable this option after you save your cluster settings.

2. Connect to the database as the owner or a user with the CREATE permission and send this request:

   CREATE EXTENSION yezzey;
   

3. Make sure that the extension is installed:

   SELECT extname FROM pg_extension;
   

Getting a table's placement infoGetting a table's placement info

To learn where a table or its segment files are placed (in cluster storage or a cold storage):

1. Connect to the database as the owner or a user with the SELECT permission for the database.

2. Send one of the following requests to find out where the table is placed:

   • With the table name specified:

     SELECT * FROM yezzey_offload_relation_status('<table_name>');
     

   • With the schema the table is in and the table name specified:

     SELECT * FROM yezzey_offload_relation_status('<schema_name>', '<table_name>');
     

   You will get information about each segment of the Greenplum® cluster the table's data resides in. Observe the external_bytes column:

   • If all the column values are null, the table is in cluster storage.
   • If the column contains values other than null, the table is in a cold storage.

3. Send one of the following requests to learn where the table’s segment files are:

   • With the table name specified:

     SELECT * FROM yezzey_offload_relation_status_per_filesegment('<table_name>');
     

   • With the schema the table is in and the table name specified:

     SELECT * FROM yezzey_offload_relation_status_per_filesegment('<schema_name>', '<table_name>');
     

   You will get information about each of the table’s segment files. Observe the external_bytes column:

   • If all the column values are null, the files are in cluster storage.
   • If the column contains values other than null, the files are in a cold storage.

Figuring out how a table is placed in a cold storageFiguring out how a table is placed in a cold storage

If the table is in a cold storage, its segment files are stored in a service bucket.

To get info on how the table’s segment files are placed in the bucket:

1. Connect to the database as the owner or a user with the SELECT permission for the database.

2. Send one of the following requests:

   • With the table name specified:

     SELECT * FROM yezzey_relation_describe_external_storage_structure('<table_name>');
     

   • With the schema the table is in and the table name specified:

     SELECT * FROM yezzey_relation_describe_external_storage_structure('<schema_name>', '<table_name>');
     

   The following information will be displayed about each of the table’s segment files:

   • offload_reloid: Object ID (object identifier, OID) for the table.

   • segindex: Segment number.

   • segfileindex: Segment file number.

   • external_storage_filepath: Path to the segment file in the Object Storage bucket.

     The path to the segment file is generated automatically. It depends on the table structure and the number of segments in the Greenplum® cluster.

   • local_bytes and local_commited_bytes: Number of segment file bytes in the cluster storage. The values must be null.

   • external_bytes: Segment file size.

Exporting a table from the cluster storage to a cold storageExporting a table from the cluster storage to a cold storage

If the table is in the cluster storage, you can export it to a cold storage. To figure out where the table is, get its placement info.

To export a table:

1. Connect to the database as the owner or a user with the SELECT permission for the database.

2. Invoke one of the following functions:

   • With the table name specified:

     SELECT yezzey_define_offload_policy('<table_name>');
     

   • With the schema the table is in and the table name specified:

     SELECT yezzey_define_offload_policy('<schema_name>', '<table_name>');
     

The time the export takes depends on the table size and the number of segment files. During the export, you will be getting messages that will allow you to track its progress.

• Messages like this one show the size of the segment files exported earlier:

  NOTICE:  yezzey: relation virtual size calculated: 0  (segX sliceY ... pid=...)
  

  0 means that no segment files were exported earlier (this is the first export).

• Messages like this one indicate that the segment files were successfully exported:

  INFO:  yezzey: relation segment reached external storage (blkno=...), up to logical eof ...  (segX sliceY ... pid=...)
  

Downloading a table from a cold storage to the cluster storageDownloading a table from a cold storage to the cluster storage

If the table is in a cold storage, you can download it to the cluster storage. To figure out where the table is, get its placement info.

To download a table:

1. Connect to the database as the owner or a user with the SELECT permission for the database.

2. Invoke one of the following functions:

   • With the table name specified:

     SELECT yezzey_load_relation('<table_name>');
     

   • With the schema the table is in and the table name specified:

     SELECT yezzey_load_relation('<schema_name>', '<table_name>');
     

The time the download takes depends on the table size and the number of segment files. After the download is completed, you will get a message in the following format:

INFO:  loaded relation ... to local storage

Usage exampleUsage example

For an example of using the extension to work with hybrid storage, see Exporting Greenplum® data to a cold storage in Yandex Object Storage.

Greenplum® and Greenplum Database® are registered trademarks or trademarks of VMware, Inc. in the United States and/or other countries.