Storage in Yandex Data Processing
Yandex Data Processing enables you to use network storage drives to store subclusters. Network drives are based on network blocks, i.e., virtual drives in the Yandex Cloud infrastructure.
When creating a cluster, you can choose between the following storage types:
-
Network HDD storage (
network-hdd): Most cost-effective option for clusters that do not require high read/write performance. -
Network SSD storage (
network-ssd): Balanced solution. Such disks are slower than non-replicated SSDs, but, unlike non-replicated disks, they ensure data integrity in case Yandex Cloud hardware fails. -
Non-replicated SSD storage (
network-ssd-nonreplicated): Network SSDs with enhanced performance achieved by eliminating redundancy.You can only expand this type of storage in 93 GB increments.
For more information about this disk type, see this Yandex Compute Cloud guide.
Note
Up to 5% of disk space is reserved for system use, so the disks may have less available space than indicated when creating a cluster.
For more information about sizes and performance of different disk types, see this Yandex Compute Cloud guide.
Specifics of non-replicated SSD storage
Non-replicated SSD storage does not provide fault tolerance; this means, if a disk fails, the data is permanently lost.