Disk types in Managed Service for Greenplum®
Managed Service for Greenplum® allows you to use network and local storage drives for database clusters. Network drives are based on network blocks, which are virtual disks in the Yandex Cloud infrastructure. Local disks are physically located on the cluster servers.
When creating a cluster, you can select the following disk types for data storage:
-
Network HDD storage (
network-hdd
): Most cost-effective option for clusters that do not require high read/write performance. -
Network SSD storage (
network-ssd
): Balanced solution. Such disks are slower than local SSD storage, but, unlike local disks, they ensure data integrity if Yandex Cloud hardware fails. -
Non-replicated SSD storage (
network-ssd-nonreplicated
): Network SSD storage with enhanced performance but without redundancy.The storage size can only be increased in 93 GB increments.
-
Local SSDs (
local-ssd
): Disks with the fastest performance.The size of such a storage can be increased:
-
For Intel Cascade Lake: In 100 GB increments only.
-
For Intel Ice Lake: In 368 GB increments only.
Note
For clusters with hosts residing in the
ru-central1-d
availability zone, local SSD storage is not available if using the Intel Cascade Lake platform. -
In a Managed Service for Greenplum® cluster, the type of disks for master hosts and segment hosts may differ.
Note
When using standard Intel Ice Lake hosts, access to local SSD storage is provided on request. Contact technical support
Specifics of local SSD storage
Local SSDs do not provide fault-tolerant storage and impact the cost of the entire cluster: you are charged for a cluster with this type of storage even if it is stopped. You can find more information in the pricing policy.
Disk space management
If any host storage is more than 95% full, the cluster will switch to read-only mode automatically, all DBs get the DEFAULT_TRANSACTION_READ_ONLY = TRUE
setting through the ALTER DATABASE
query.
In this mode, the INSERT
, DELETE
, or UPDATE
queries result in an error.
Monitoring the transition to read-only mode
To monitor storage usage on cluster hosts, configure alerts in Yandex Monitoring:
-
Go to the folder page and select Monitoring.
-
Select Managed Service for Greenplum®.
-
Create an alert with the following properties:
-
Metric: Set the following metric parameters:
-
Cloud
-
Folder
-
Managed Service for Greenplum® service
-
Managed Service for Greenplum® cluster ID
You can get the cluster ID with a list of clusters in the folder.
-
disk.free_bytes
label
-
-
Condition: Set the
Less than or equals
condition for free disk space utilization percentage to trigger the alert:- 95% of the storage size for
Alarm
- 90% of the storage size for
Warning
- 95% of the storage size for
-
Advanced settings:
- Aggregation function:
Minimum
(minimum metric value for the period). - Evaluation window: Preferred metric update period.
- Aggregation function:
-
Add the previously created notification channel.
-
Recovering a cluster from read-only mode
If the cluster switched to read-only mode:
-
Increase the storage capacity so that it exceeds the threshold value. Yandex Cloud will then disable read-only mode automatically.
-
Disable read-only mode manually and free up storage space by deleting some data.
Alert
When doing so, make sure the amount of free disk space never reaches zero. Otherwise, since the fail-safe mechanism is disabled, Greenplum® will crash and the cluster will stop operating.
To disable read-only mode manually, contact support
-
Connect to the database in any appropriate way.
-
Open a transaction and run the following command inside it:
SET LOCAL transaction_read_only TO off;
-
As part of the same transaction, delete the data you do not need using the
DROP
orTRUNCATE
operators. Do not use theDELETE
operator, as it marks rows as deleted but does not physically delete them from the database. -
Commit the transaction and restart all connections to the database.
For example, if your database contains a table called
ExcessDataTable1
that you no longer need, delete it using the following transaction:
BEGIN; SET LOCAL transaction_read_only TO off; DROP TABLE ExcessDataTable1; COMMIT;
Greenplum® and Greenplum Database® are registered trademarks or trademarks of VMware, Inc. in the United States and/or other countries.