Creating a VM with a GPU
This section explains how to create a VM with a GPU. For more information about VM configurations, see Graphics accelerators (GPUs).
By default, the cloud has a zero quota for creating VMs with GPUs. To change the quota
You can create VMs on Intel Broadwell with NVIDIA® Tesla® V100, Intel Cascade Lake with NVIDIA® Tesla® V100, AMD EPYC™ with NVIDIA® Ampere® A100 and Intel Ice Lake with NVIDIA® Tesla® T4 in the ru-central1-a
and ru-central1-b
availability zones.
-
In the management console
, select the folder to create the virtual machine in. -
In the list of services, select Compute Cloud.
-
At the top right, click Create virtual machine.
-
Under Basic parameters:
-
Enter a name and description for the VM. The naming requirements are as follows:
- The name must be from 3 to 63 characters long.
- It may contain lowercase Latin letters, numbers, and hyphens.
- The first character must be a letter and the last character cannot be a hyphen.
Note
The VM name is used to generate an internal FQDN only once: when creating a VM. If the internal FQDN is important to you, choose an appropriate name for the VM at the creation stage.
-
Select an availability zone to place your virtual machine in.
You can create VMs on Intel Broadwell with NVIDIA® Tesla® V100, Intel Cascade Lake with NVIDIA® Tesla® V100, AMD EPYC™ with NVIDIA® Ampere® A100 and Intel Ice Lake with NVIDIA® Tesla® T4 in the
ru-central1-a
andru-central1-b
availability zones.
-
-
Select one of the GPU-oriented images and OS version under Image/boot disk selection in the Marketplace tab.
For VMs with GPUs, you can use the following special images of operating systems with NVIDIA drivers:
- Intel Broadwell with NVIDIA® Tesla® V100 and Intel Cascade Lake with NVIDIA® Tesla® V100
-
- Ubuntu 16.04 LTS GPU (
ubuntu-1604-lts-gpu
) - Ubuntu 20.04 LTS GPU (
ubuntu-2004-lts-gpu
)
- Ubuntu 16.04 LTS GPU (
- Intel Ice Lake with NVIDIA® Tesla® T4
-
- Ubuntu 20.04 LTS GPU (
ubuntu-2004-lts-gpu
)
- Ubuntu 20.04 LTS GPU (
- AMD EPYC™ with NVIDIA® Ampere® A100
-
- Ubuntu 20.04 LTS GPU A100 (
ubuntu-2004-lts-a100
) - Ubuntu 18.04 LTS GPU A100 (
ubuntu-1804-lts-a100
)
- Ubuntu 20.04 LTS GPU A100 (
We recommend using a standard image from Yandex Cloud. You can also install the drivers on another standard image yourself or create a custom image with pre-installed drivers.
-
(Optional) Configure the boot disk under Disks and file storages:
-
Select the disk type.
-
Specify the required disk size.
-
(Optional) To encrypt a boot disk, under Disks and file storages, configure encryption parameters for the disk:
- Select the Encrypted disk option.
- In the KMS Key field, select the key with which you want to encrypt the disk. To create a new key, click Create.
- In the Service account field, select the service account with the
kms.keys.encrypterDecrypter
role for the specified key. To create a service account, click Create.
The encryption feature in Compute Cloud is currently at the Preview stage. To access it, open the resource creation page and click Request access under Encryption or contact support
.If you deactivate the key used to encrypt a disk or snapshot, access to the data will be suspended until you reactivate the key.
Alert
If you destroy the key or its version used to encrypt a disk or snapshot, access to the data will be irrevocably lost. Learn more in Destroying key versions.
-
-
(Optional) Under Disks and file storages, select the File storages tab and attach the file storage:
- Click Attach file storage.
- In the window that opens, select the file storage.
- Enter the device name.
- Click Attach file storage.
-
Under Computing resources:
-
Choose a platform:
- Intel Broadwell with NVIDIA® Tesla® V100
- Intel Cascade Lake with NVIDIA® Tesla® V100
- AMD EPYC™ with NVIDIA® Ampere® A100
- Intel Ice Lake with NVIDIA® Tesla® T4
-
Select a VM configuration specifying the required number of GPUs.
-
Make your VM preemptible, if required.
-
-
Under Network settings:
-
Enter a subnet ID or select a cloud network from the list.
If you do not have a network, click Create network to create one:- In the window that opens, enter the network name and specify the folder to host the network.
- (Optional) To automatically create subnets, select the Create subnets option.
- Click Create.
Each network must have at least one subnet. If there is no subnet, create one by selecting Create subnet.
-
In the Public IP field, choose a method for assigning an IP address:
Auto
: Assign a random IP address from the Yandex Cloud IP pool. With this, you can enable DDoS protection using the option below.List
: Select a public IP address from the list of previously reserved static addresses. For more information, see Converting a dynamic public IP address to static.No address
: Do not assign a public IP address.
-
In the Internal IPv4 address field, select the method for assigning internal addresses:
Auto
orManual
. -
(Optional) Create records for the VM in the DNS zone:
- Expand the DNS settings for internal addresses section and click Add record.
- Specify the zone, FQDN, and TTL for the record. When setting the FQDN, you can select
Detect automatically
for the zone.
You can add multiple records to internal DNS zones. For more information, see Cloud DNS integration with Compute Cloud. - To create another record, click Add record.
-
Select the appropriate security groups.
-
-
Under Access, specify the data required to access the VM:
-
(Optional) Select or create a service account. With a service account, you can flexibly configure access rights for your resources.
For VMs with a Linux-based operating system:
-
Enter the username in the Login field.
Alert
Do not use the
root
username or other names reserved by the operating system. To perform operations that require superuser permissions, use thesudo
command. -
In the SSH key field, paste the contents of the public key file.
-
(Optional) Enable access to the serial console, if required.
In public Linux images provided by Yandex Cloud, the functionality of connecting over SSH using login and password is disabled by default.
-
-
-
(Optional) Under Placement, select a VM placement group.
-
Click Create VM.
The virtual machine will appear in the list.
If you do not have the Yandex Cloud command line interface yet, install and initialize it.
The folder specified in the CLI profile is used by default. You can specify a different folder using the --folder-name
or --folder-id
parameter.
-
View the description of the CLI command to create a VM:
yc compute instance create --help
-
Prepare a key pair (public and private keys) for SSH access to the VM.
-
Select a public image.
To get a list of available images, run the following command:
yc compute image list --folder-id standard-images
Result:
+----------------------+----------------------------------+-----------------------+----------------------+--------+ | ID | NAME | FAMILY | PRODUCT IDS | STATUS | +----------------------+----------------------------------+-----------------------+----------------------+--------+ ... | fdv7ooobjfl3******** | windows-2016-gvlk-gpu-1548913814 | windows-2016-gvlk-gpu | dqnnc72gj2is******** | READY | | fdv4f5kv5cvf******** | ubuntu-1604-lts-gpu-1549457823 | ubuntu-1604-lts-gpu | dqnnb6dc7640******** | READY | ... +----------------------+----------------------------------+-----------------------+----------------------+--------+
For VMs with GPUs, you can use the following special images of operating systems with NVIDIA drivers:
- Intel Broadwell with NVIDIA® Tesla® V100 and Intel Cascade Lake with NVIDIA® Tesla® V100
-
- Ubuntu 16.04 LTS GPU (
ubuntu-1604-lts-gpu
) - Ubuntu 20.04 LTS GPU (
ubuntu-2004-lts-gpu
)
- Ubuntu 16.04 LTS GPU (
- Intel Ice Lake with NVIDIA® Tesla® T4
-
- Ubuntu 20.04 LTS GPU (
ubuntu-2004-lts-gpu
)
- Ubuntu 20.04 LTS GPU (
- AMD EPYC™ with NVIDIA® Ampere® A100
-
- Ubuntu 20.04 LTS GPU A100 (
ubuntu-2004-lts-a100
) - Ubuntu 18.04 LTS GPU A100 (
ubuntu-1804-lts-a100
)
- Ubuntu 20.04 LTS GPU A100 (
We recommend using a standard image from Yandex Cloud. You can also install the drivers on another standard image yourself or create a custom image with pre-installed drivers.
-
Create a VM in the default folder:
yc compute instance create \ --name gpu-instance \ --zone ru-central1-a \ --platform=gpu-standard-v3 \ --cores=8 \ --memory=96 \ --gpus=1 \ --network-interface subnet-name=default-ru-central1-a,nat-ip-version=ipv4 \ --create-boot-disk image-folder-id=standard-images,image-family=ubuntu-1604-lts-gpu \ --ssh-key ~/.ssh/id_ed25519.pub
Where:
-
--name
: VM name.Note
The VM name is used to generate an internal FQDN only once: when creating a VM. If the internal FQDN is important to you, choose an appropriate name for the VM at the creation stage.
-
--zone
: Availability zone.You can create VMs on Intel Broadwell with NVIDIA® Tesla® V100, Intel Cascade Lake with NVIDIA® Tesla® V100, AMD EPYC™ with NVIDIA® Ampere® A100 and Intel Ice Lake with NVIDIA® Tesla® T4 in the
ru-central1-a
andru-central1-b
availability zones. -
--platform
: Platform ID:gpu-standard-v1
for Intel Broadwell with NVIDIA® Tesla® V100.gpu-standard-v2
for Intel Cascade Lake with NVIDIA® Tesla® V100.gpu-standard-v3
for AMD EPYC™ with NVIDIA® Ampere® A100.standard-v3-t4
for Intel Ice Lake with NVIDIA® Tesla® T4.
-
--cores
: Number of vCPUs. -
--memory
: Amount of RAM. -
--gpus
: Number of GPUs. -
--preemptible
: For a preemptible VM. -
--create-boot-disk
: OS image.For VMs with GPUs, you can use the following special images of operating systems with NVIDIA drivers:
- Intel Broadwell with NVIDIA® Tesla® V100 and Intel Cascade Lake with NVIDIA® Tesla® V100
-
- Ubuntu 16.04 LTS GPU (
ubuntu-1604-lts-gpu
) - Ubuntu 20.04 LTS GPU (
ubuntu-2004-lts-gpu
)
- Ubuntu 16.04 LTS GPU (
- Intel Ice Lake with NVIDIA® Tesla® T4
-
- Ubuntu 20.04 LTS GPU (
ubuntu-2004-lts-gpu
)
- Ubuntu 20.04 LTS GPU (
- AMD EPYC™ with NVIDIA® Ampere® A100
-
- Ubuntu 20.04 LTS GPU A100 (
ubuntu-2004-lts-a100
) - Ubuntu 18.04 LTS GPU A100 (
ubuntu-1804-lts-a100
)
- Ubuntu 20.04 LTS GPU A100 (
We recommend using a standard image from Yandex Cloud. You can also install the drivers on another standard image yourself or create a custom image with pre-installed drivers.
-
nat-ip-version=ipv4
: Public IP address. To create a VM without a public IP address, disable this parameter.
Get a description of the created VM:
yc compute instance get --full gpu-instance
Result:
name: gpu-instance zone_id: ru-central1-a platform_id: gpu-standard-v3 resources: memory: "103079215104" cores: "8" core_fraction: "100" gpus: "1" status: RUNNING ...
-
If you don't have Terraform, install it and configure the Yandex Cloud provider.
-
In the configuration file, describe the parameters of the resources you want to create:
resource "yandex_compute_disk" "boot-disk" { name = "<disk_name>" type = "<disk_type>" zone = "<availability_zone>" size = "<disk_size>" image_id = "<image_ID>" } resource "yandex_compute_instance" "vm-1" { name = "vm-with-gpu" allow_stopping_for_update = true platform_id = "standard-v3" zone = "<availability_zone>" resources { cores = <number_of_vCPU_cores> memory = <GB_of_RAM> gpus = <number_of_GPUs> } boot_disk { disk_id = yandex_compute_disk.boot-disk.id } network_interface { subnet_id = "${yandex_vpc_subnet.subnet-1.id}" nat = true } metadata = { ssh-keys = "<username>:<SSH_key_contents>" } } resource "yandex_vpc_network" "network-1" { name = "network1" } resource "yandex_vpc_subnet" "subnet-1" { name = "subnet1" zone = "<availability_zone>" network_id = "${yandex_vpc_network.network-1.id}" }
Where:
-
yandex_compute_disk
: Boot disk description:-
name
: Disk name. -
type
: Disk type. -
zone
: Availability zone to host the disk. -
size
: Disk size in GB. -
image_id
: ID of the image to create the VM from. You can get the image ID from the list of public images.For VMs with GPUs, you can use the following special images of operating systems with NVIDIA drivers:
- Intel Broadwell with NVIDIA® Tesla® V100 and Intel Cascade Lake with NVIDIA® Tesla® V100
-
- Ubuntu 16.04 LTS GPU (
ubuntu-1604-lts-gpu
) - Ubuntu 20.04 LTS GPU (
ubuntu-2004-lts-gpu
)
- Ubuntu 16.04 LTS GPU (
- Intel Ice Lake with NVIDIA® Tesla® T4
-
- Ubuntu 20.04 LTS GPU (
ubuntu-2004-lts-gpu
)
- Ubuntu 20.04 LTS GPU (
- AMD EPYC™ with NVIDIA® Ampere® A100
-
- Ubuntu 20.04 LTS GPU A100 (
ubuntu-2004-lts-a100
) - Ubuntu 18.04 LTS GPU A100 (
ubuntu-1804-lts-a100
)
- Ubuntu 20.04 LTS GPU A100 (
We recommend using a standard image from Yandex Cloud. You can also install the drivers on another standard image yourself or create a custom image with pre-installed drivers.
-
-
yandex_compute_instance
: Description of the VM:-
name
: VM name. -
allow_stopping_for_update
: Allow a VM instance to stop to make changes. Settrue
if you plan to change the network settings, computing resources, disks, or file storage for your VM using Terraform. The default value isfalse
. -
platform_id
: ID of the platform. -
zone
: Availability zone to host the VM.You can create VMs on Intel Broadwell with NVIDIA® Tesla® V100, Intel Cascade Lake with NVIDIA® Tesla® V100, AMD EPYC™ with NVIDIA® Ampere® A100 and Intel Ice Lake with NVIDIA® Tesla® T4 in the
ru-central1-a
andru-central1-b
availability zones. -
platform_id
: ID of the platform:gpu-standard-v1
for Intel Broadwell with NVIDIA® Tesla® V100.gpu-standard-v2
for Intel Cascade Lake with NVIDIA® Tesla® V100.gpu-standard-v3
for AMD EPYC™ with NVIDIA® Ampere® A100.standard-v3-t4
for Intel Ice Lake with NVIDIA® Tesla® T4.
-
resources
: Number of vCPU cores and the amount of RAM available to the VM. The values must match the selected platform. -
boot_disk
: Boot disk settings. Specify the disk ID. -
network_interface
: Network settings. Specify the ID of the selected subnet. To automatically assign a public IP address to the VM, setnat = true
. -
metadata
: In the metadata, provide the public key for VM access via SSH. For more information, see VM metadata.
-
-
yandex_vpc_network
: Description of the cloud network. -
yandex_vpc_subnet
: Description of the subnet your VM will connect to.
Note
If you already have suitable resources, such as a cloud network and subnet, you do not need to describe them again. Use their names and IDs in the appropriate parameters.
For more information about resources you can create with Terraform, see the provider documentation
. -
-
Create resources:
-
In the terminal, change to the folder where you edited the configuration file.
-
Make sure the configuration file is correct using the command:
terraform validate
If the configuration is correct, the following message is returned:
Success! The configuration is valid.
-
Run the command:
terraform plan
The terminal will display a list of resources with parameters. No changes are made at this step. If the configuration contains errors, Terraform will point them out.
-
Apply the configuration changes:
terraform apply
-
Confirm the changes: type
yes
in the terminal and press Enter.
All the resources you need will then be created in the specified folder. You can check the new resources and their configuration using the management console
. -
To create a VM, use the create REST API method for the Instance resource or the InstanceService/Create gRPC API call.
When a VM is created, it is assigned an IP address and hostname (FQDN). This data can be used for SSH access.
You can make a public IP address static. For more information, see Making a VM's public IP address static.
See also
- Learn how to change the VM configuration.