Migrating Yandex StoreDoc cluster hosts to a different availability zone
Yandex StoreDoc cluster hosts reside in Yandex Cloud availability zones. To migrate hosts from one availability zone to another, do the following:
-
Create a subnet in your target availability zone.
-
Add a host to your cluster:
Management consoleCLITerraformREST APIgRPC API-
Open the folder dashboard
. -
Navigate to the Yandex StoreDoc service.
-
Click the name of your Yandex StoreDoc cluster and open the Hosts tab.
-
Click
Create host. -
Specify the following host settings:
- Target availability zone for your hosts.
- New subnet.
- To make the host accessible from outside Yandex Cloud, select Public access.
-
Click Save.
If you do not have the Yandex Cloud CLI installed yet, install and initialize it.
By default, the CLI uses the folder specified when creating the profile. To change the default folder, use the
yc config set folder-id <folder_ID>command. You can also set a different folder for any specific command using the--folder-nameor--folder-idparameter.Run this command:
yc managed-mongodb host add \ --cluster-name <cluster_name> \ --host type=<host_type>,` `zone-id=<availability_zone>,` `subnet-id=<new_subnet_ID>,` `assign-public-ip=<allow_public_access_to_host>Command specifics:
- You can get the cluster name from the list of clusters in your folder.
- Possible
typevalues aremongod,mongos,mongocfg, andmongoinfra. The host type depends on the sharding type. - In the
zone-idargument, provide the target availability zone for your hosts.
-
Add the host manifest to the Terraform configuration file describing your infrastructure:
resource "yandex_mdb_mongodb_cluster" "<cluster_name>" { ... host { type = "<host_type>" zone_id = "<availability_zone>" subnet_id = "<new_subnet_ID>" assign_public_ip = <allow_public_access_to_host> ... } }Possible
typevalues areMONGOD,MONGOINFRA,MONGOS, andMONGOCFG. The host type depends on the sharding type.In the
zoneargument, provide the target availability zone for your hosts. -
Validate your configuration.
-
In the command line, navigate to the directory that contains the current Terraform configuration files defining the infrastructure.
-
Run this command:
terraform validateTerraform will show any errors found in your configuration files.
-
-
Confirm resource changes.
-
Run this command to view the planned changes:
terraform planIf you described the configuration correctly, the terminal will display a list of the resources to update and their parameters. This is a verification step that does not apply changes to your resources.
-
If everything looks correct, apply the changes:
-
Run this command:
terraform apply -
Confirm updating the resources.
-
Wait for the operation to complete.
-
-
-
Get an IAM token for API authentication and place it in an environment variable:
export IAM_TOKEN="<IAM_token>" -
Call the Cluster.AddHosts method, e.g., via the following cURL
request:curl \ --request POST \ --header "Authorization: Bearer $IAM_TOKEN" \ --header "Content-Type: application/json" \ --url 'https://mdb.api.cloud.yandex.net/managed-mongodb/v1/clusters/<cluster_ID>/hosts:batchCreate' \ --data '{ "hostSpecs": [ { "zoneId": "<availability_zone>", "subnetId": "<subnet_ID>", "assignPublicIp": <allow_public_access_to_host>, "type": "<host_type>", "shardName": "<shard_name>", "hidden": <hide_host>, "secondaryDelaySecs": "<lag_in_seconds>", "priority": "<host_priority_for_assignment_as_master>", "tags": "<host_labels>" } ] }'Where
hostSpecsis an array of new hosts, in which each element contains the settings for a single host:zoneId: Availability zone.subnetId: Subnet ID.assignPublicIp: Controls whether the host is accessible via a public IP address,trueorfalse.type: Host type in a sharded cluster,MONGOD,MONGOINFRA,MONGOS, orMONGOCFG. For a non-sharded cluster, useMONGOD.shardName: Shard name in a sharded cluster.hidden: Determines whether the host is hidden,trueorfalse.secondaryDelaySecs: Host's replication lag behind the master.priority: Host priority for master promotion during failover.tags: Host tags.
You can get the cluster ID from the list of clusters in your folder.
-
Check the server response to make sure your request was successful.
-
Get an IAM token for API authentication and place it in an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService.AddHosts method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/mdb/mongodb/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>", "host_specs": [ { "zone_id": "<availability_zone>", "subnet_id": "<subnet_ID>", "assign_public_ip": <allow_public_access_to_host>, "type": "<host_type>", "shard_name": "<shard_name>", "hidden": <hide_host>, "secondary_delay_secs": "<lag_in_seconds>", "priority": "<host_priority_for_assignment_as_master>", "tags": "<host_labels>" } ] }' \ mdb.api.cloud.yandex.net:443 \ yandex.cloud.mdb.mongodb.v1.ClusterService.AddHostsWhere
host_specsis an array of new hosts, in which each element contains the settings for a single host:zone_id: Availability zone.subnet_id: Subnet ID.assign_public_ip: Controls whether the host is accessible via a public IP address,trueorfalse.type: Host type in a sharded cluster,MONGOD,MONGOINFRA,MONGOS, orMONGOCFG. For a non-sharded cluster, useMONGOD.shard_name: Shard name in a sharded cluster.hidden: Determines whether the host is hidden,trueorfalse.secondary_delay_secs: Host’s replication lag behind the master.priority: Host priority for master promotion during failover.tags: Host tags.
You can get the cluster ID from the list of clusters in your folder.
-
Check the server response to make sure your request was successful.
-
-
To connect to the database after migration, specify the new host’s FQDN in your backend or client, e.g., in your application code or graphical IDE. Delete the original host's FQDN in your source availability zone.
You can get this FQDN from the list of hosts in your cluster:
yc managed-mongodb host list --cluster-name <cluster_name>You will see the FQDN under
NAMEin the command output.For details on how to get a host’s FQDN in the management console
, see this guide. -
Delete the hosts in the source availability zone:
Management consoleCLITerraformREST APIgRPC API- Open the folder dashboard
. - Navigate to the Yandex StoreDoc service.
- Locate the Yandex StoreDoc cluster you need in the list, click its name, and select the Hosts tab.
- Find the host you need in the list, click
in its row, select Delete, and confirm the deletion.
Run the following command for each host:
yc managed-mongodb host delete <host_FQDN> --cluster-name <cluster_name>-
In your Terraform infrastructure configuration file, locate your cluster description and delete the
hostsections with the source availability zone. -
Validate your configuration.
-
In the command line, navigate to the directory that contains the current Terraform configuration files defining the infrastructure.
-
Run this command:
terraform validateTerraform will show any errors found in your configuration files.
-
-
Type
yesand press Enter.-
Run this command to view the planned changes:
terraform planIf you described the configuration correctly, the terminal will display a list of the resources to update and their parameters. This is a verification step that does not apply changes to your resources.
-
If everything looks correct, apply the changes:
-
Run this command:
terraform apply -
Confirm updating the resources.
-
Wait for the operation to complete.
-
-
-
Get an IAM token for API authentication and place it in an environment variable:
export IAM_TOKEN="<IAM_token>" -
Call the Cluster.DeleteHosts method, e.g., via the following cURL
request:curl \ --request POST \ --header "Authorization: Bearer $IAM_TOKEN" \ --header "Content-Type: application/json" \ --url 'https://mdb.api.cloud.yandex.net/managed-mongodb/v1/clusters/<cluster_ID>/hosts:batchDelete' \ --data '{ "hostNames": [ "<host_name>" ] }'Where
hostNamesis the array containing the host you want to delete. You can get the host name from the list of hosts in your cluster.You can get the cluster ID from the list of clusters in your folder.
-
Check the server response to make sure your request was successful.
-
Get an IAM token for API authentication and place it in an environment variable:
export IAM_TOKEN="<IAM_token>" -
Clone the cloudapi
repository:cd ~/ && git clone --depth=1 https://github.com/yandex-cloud/cloudapiBelow, we assume that the repository contents reside in the
~/cloudapi/directory. -
Call the ClusterService.DeleteHosts method, e.g., via the following gRPCurl
request:grpcurl \ -format json \ -import-path ~/cloudapi/ \ -import-path ~/cloudapi/third_party/googleapis/ \ -proto ~/cloudapi/yandex/cloud/mdb/mongodb/v1/cluster_service.proto \ -rpc-header "Authorization: Bearer $IAM_TOKEN" \ -d '{ "cluster_id": "<cluster_ID>", "host_names": [ "<host_name>" ] }' \ mdb.api.cloud.yandex.net:443 \ yandex.cloud.mdb.mongodb.v1.ClusterService.DeleteHostsWhere
host_namesis an array containing the host names you want to delete. You can get the host name from the list of hosts in your cluster.You can get the cluster ID from the list of clusters in your folder.
-
Check the server response to make sure your request was successful.
- Open the folder dashboard
-
Wait for the cluster state to change to Alive. In the management console
, navigate to the folder containing your cluster. Navigate to the Yandex StoreDoc service. You can check the cluster state in the Availability column.
Note
Clusters with hosts residing in the ru-central1-d availability zone do not support:
- Intel Broadwell
- Local SSD storage if using Intel Cascade Lake
Specifics of migration in Yandex Data Transfer
If your cluster is used as an endpoint when transferring data with Data Transfer, and the transfer type is Replication or Snapshot and increment, restart the transfer after migrating the cluster. This way, the transfer will get data about the cluster's new topology.
You do not need to restart Snapshot transfers, as information about the new topology is provided automatically while activating them.
To restart a transfer, choose one of the two methods:
- Deactivate the transfer and wait for its status to change to Stopped. Next, reactivate the transfer and wait for its status to change to Replicating.
- Update any setting for the transfer or endpoint.
For more information, see Migrating a Data Transfer transfer and endpoints to a different availability zone.