Creating a GPU cluster

If you do not have the Yandex Cloud CLI yet, install and initialize it.

The folder used by default is the one specified when creating the CLI profile. To change the default folder, use the yc config set folder-id <folder_ID> command. You can also specify a different folder for any command using --folder-name or --folder-id. If you access a resource by its name, the search will be limited to the default folder. If you access a resource by its ID, the search will be global, i.e., through all folders based on access permissions.

1. See the description of the CLI command for creating a GPU cluster:

   yc compute gpu-cluster create --help
   

   Note that currently, you can only create GPU clusters with the infiniband interconnect type.

2. Create a GPU cluster in the default availability zone:

   yc compute gpu-cluster create --interconnect-type infiniband
   

If you do not have Terraform yet, install it and configure the Yandex Cloud provider.

To manage infrastructure using Terraform under a service account or user accounts (a Yandex account, a federated account, or a local user), authenticate using the appropriate method.

1. In the Terraform configuration file, describe the resource you want to create:

   provider "yandex" {
     zone = "ru-central1-a"
   }
   
   resource "yandex_compute_gpu_cluster" "default" {
     name               = "<GPU_cluster_name>"
     interconnect_type  = "<interconnect_type>"
     zone               = "ru-central1-a"
     labels             = {
       <label_1_key> = "<label_1_value>"
       <label_2_key> = "<label_2_value>"
     }
   }
   

   Where:

   • name: GPU cluster name. This is a required setting.
   • interconnect_type: Interconnect type. Currently, you can only create GPU clusters with the infiniband interconnect type. This is a required setting.
   • labels: Resource label in <key> = "<value>" format. This is an optional setting.

   For more information about the yandex_compute_gpu_cluster resource properties, see this Terraform provider guide.

2. Create the resources:

   1. In the terminal, navigate to the configuration file directory.

   2. Make sure the configuration is correct using this command:

      terraform validate
      

      If the configuration is valid, you will get this message:

      Success! The configuration is valid.
      

   3. Run this command:

      terraform plan
      

      You will see a list of resources and their properties. No changes will be made at this step. Terraform will show any errors in the configuration.

   4. Apply the configuration changes:

      terraform apply
      

   5. Type yes and press Enter to confirm the changes.

This will create a GPU cluster in the specified folder. You can check the new GPU cluster and its settings using the management console or this CLI command:

yc compute gpu-cluster get <GPU_cluster_name>

To create a GPU cluster, use the create REST API method for the GpuCluster resource or the GpuClusterService/Create gRPC API call.