ctr-remote --gpus <arg> always assume that NVIDIA gpus is passed, which isn't true if host only has AMD GPUs. It will be best to make it flexible and also allow AMD devices to be passed in combination with --runtime argument.
This is making it not possible to optimize image that need AMD GPUs for instance rocm/vllm etc
ctr-remote--gpus<arg>always assume that NVIDIA gpus is passed, which isn't true if host only has AMD GPUs. It will be best to make it flexible and also allow AMD devices to be passed in combination with--runtimeargument.This is making it not possible to optimize image that need AMD GPUs for instance
rocm/vllmetc