I'm trying to monitor a process that uses CUDA and MPI, is there any way I could do this, something like the command "top" but that monitors the GPU too?
I find gpustat very useful. It can be installed with pip install gpustat
, and prints breakdown of usage by processes or users.