Skip to content

(2024.12.01 and earlier) NVIDIA GPU driver and corresponding DCV packages are not installed on G6 Gr6 VDI

Jump to bottom
Junbo Liang edited this page Mar 13, 2025 · 1 revision

Bug description

RES customers are able to launch G6 / Gr6 VDI from the RES web portal, but they will run into the command not found error when executing CLI commands like nvidia-smi, dcvgldiag and dcvgltest to verify the GPU driver and GPU package installation.

Affected versions

2024.12.01 and earlier

Mitigation

  1. Download patch.py and support_for_g6_instance_type.patch by replacing <output-directory> with the directory to download the patch script and patch file and <environment-name> with the name of your RES environment in the command below: a. The patch applies to RES 2024.12.01. b. The patch script requires AWS CLI v2, Python 3.9.16 or above, and Boto3. c. Configure the AWS CLI for the account / region where RES is deployed, and make sure that you have S3 permissions to write to the bucket created by RES.
OUTPUT_DIRECTORY=<output-directory>
ENVIRONMENT_NAME=<environment-name>
RES_VERSION=2024.12.01

mkdir -p ${OUTPUT_DIRECTORY}
curl https://research-engineering-studio-us-east-1.s3.amazonaws.com/releases/${RES_VERSION}/patch_scripts/patch.py --output ${OUTPUT_DIRECTORY}/patch.py
curl https://research-engineering-studio-us-east-1.s3.amazonaws.com/releases/${RES_VERSION}/patch_scripts/patches/support_for_g6_instance_type.patch --output ${OUTPUT_DIRECTORY}/support_for_g6_instance_type.patch
  1. Add the global settings to the cluster-settings DynamoDB table via the following commands:
aws dynamodb put-item --table-name ${ENVIRONMENT_NAME}.cluster-settings --item "{\"key\":{\"S\":\"global-settings.gpu_settings.nvidia_public_driver_versions.gr6\"},\"value\":{\"S\":\"510.47.03\"},\"version\":{\"N\":\"1\"}}"
aws dynamodb put-item --table-name ${ENVIRONMENT_NAME}.cluster-settings --item "{\"key\":{\"S\":\"global-settings.gpu_settings.nvidia_public_driver_versions.g6\"},\"value\":{\"S\":\"510.47.03\"},\"version\":{\"N\":\"1\"}}"
  1. Navigate to the directory where the patch script and patch file are downloaded. Run the following patch command:
python3 ${OUTPUT_DIRECTORY}/patch.py --environment-name ${ENVIRONMENT_NAME} --res-version ${RES_VERSION} --module virtual-desktop-controller --patch ${OUTPUT_DIRECTORY}/support_for_g6_instance_type.patch
  1. Restart the VDC Controller instance for your environment. You may also terminate the instance from the Amazon EC2 Management Console.
INSTANCE_ID=$(aws ec2 describe-instances \
    --filters \
    Name=tag:Name,Values=${ENVIRONMENT_NAME}-vdc-controller \
    Name=tag:res:EnvironmentName,Values=${ENVIRONMENT_NAME}\
    --query "Reservations[0].Instances[0].InstanceId" \
    --output text)
 
aws ec2 terminate-instances --instance-ids ${INSTANCE_ID}
  1. Verify the VDC Controller instance status by checking the activity of the auto scaling group starting with the name <RES-EnvironmentName>-vdc-controller-asg. Wait until the new instance is launched successfully.
  2. launch a new G6 or Gr6 VDI to verify the fix.

Clone this wiki locally
⌂ 换网址