Installing NVIDIA drivers
To enable compatibility with GPU, make sure that NVIDIA drivers are installed on the VM. You can install the drivers from inside the VM after it is created.
Drivers for NVIDIA A100
In Compute Cloud, there are two available configurations for VMs based on NVIDIA® A100 NVLink with AMD Epyc Rome: with 1 GPU and 8 GPUs. For the 8 GPU configuration, you should additionally install Fabric Manager
To install the drivers for NVIDIA A100:
- Go to the form
page. - Select Data Center / Tesla in the Product type field.
- Select A-Series in the Product series field.
- Select NVIDIA A100 in the Product family field.
- Select the OS in the Operating system field.
- Specify other settings according to your OS and driver requirements.
- Click Search. The appropriate driver page opens.
- Click Download now.
- Run the downloaded installer and follow the instructions.
To install and configure Fabric Manager:
-
In the terminal, run:
sudo apt install -y nvidia-driver-<driver version>-server nvidia-utils-<driver version>-server nvidia-fabricmanager-<driver version> sudo systemctl enable nvidia-fabricmanager sudo systemctl start nvidia-fabricmanager
Note
When installing, specify the required driver version (for example, 460).
-
Test Fabric Manager:
nvidia-smi nvlink -s