Managing data streams
You can view a list of streams, edit their settings, create a new stream, or delete an existing one.
Creating a data stream
-
In the management console
, select the folder where you want to create a data stream. -
Select Data Streams.
-
Click Create stream.
-
Specify the Yandex Managed Service for YDB database or create a new one. If you chose to create a new database, click
after creating it to refresh the list of databases. -
Name the data stream. Follow these naming requirements:
- It must be from 2 to 63 characters long.
- It can only contain lowercase Latin letters, numbers, and hyphens.
- It must start with a letter and cannot end with a hyphen.
-
Select a pricing plan (for serverless databases).
-
Set the maximum shard throughput. A stream's throughput is equal to the product of the number of shards by the throughput of each of them.
-
Optionally, enable autopartitioning and specify the following parameters:
-
Shards: Minimum and maximum number of data shards.
-
Autopartitioning mode:
Scale up: Number of shards can be scaled up to the specified maximum value.Paused: Number of shards will remain the same.
-
Stabilization period: Period of time in seconds after which the number of shards will start to scale when the load changes.
-
Upper utilization limit: Load threshold percentage at which the number of shards will scale up.
Warning
Once a data stream is created, you can enable autopartitioning or change its settings, but you cannot disable it.
You cannot reduce the current number of shards, if automatically increased, for the created stream.
-
-
Specify the number of data shards.
Warning
You cannot reduce the number of shards for the created stream.
-
Select data storage settings:
Size Limit: Specify the maximum data storage size.Time Limit: Specify the maximum data retention period for the stream.
-
Click Create.
Wait for the stream to start. Once the stream is ready for use, its status will change from CREATING to ACTIVE.
Viewing a list of streams
- In the management console
, select the folder for which to get the list of data streams. - Select Data Streams. A list of streams will open.
Changing stream settings
-
In the management console
, select the folder where you want to change the stream settings. -
Select Data Streams.
-
Click
in the stream row and select Edit. -
Configure the data stream:
-
Set the maximum shard throughput per second.
-
Optionally, enable autopartitioning and specify the following parameters:
-
Shards: Minimum and maximum number of data shards.
-
Autopartitioning mode:
Scale up: Number of shards can be scaled up to the specified maximum value.Paused: Number of shards will remain the same.
-
Stabilization period: Period of time in seconds after which the number of shards will start to scale when the load changes.
-
Upper utilization limit: Load threshold percentage at which the number of shards will scale up.
Warning
After saving the changes, you can edit autopartitioning settings but cannot disable autopartitioning.
You cannot reduce the current number of segments if automatically increased.
-
-
Select the required number of shards.
Warning
You cannot reduce the number of segments after saving the changes.
-
Select a pricing plan.
-
Select data storage settings:
Size Limit: Specify the maximum data storage size.Time Limit: Specify the maximum data retention period for the stream.
-
-
Click Update.
Deleting a stream
- In the management console
, select the folder to delete a stream from. - Select Data Streams.
- Click
in the data stream row and select Delete. - Confirm the deletion.