In your compose file, make sure you've added runtime: nvidia.
You also don't need to deploy the resources and reserve the GPU, you can remove the entire deploy section when using the nvidia runtime.
In your compose file, make sure you've added runtime: nvidia.
You also don't need to deploy the resources and reserve the GPU, you can remove the entire deploy section when using the nvidia runtime.