I have tried adding -g option in the command line, however, I still can't enter the kernels in PGI Debugger.
-g
You'll need to use a debugger such as cuda-gdb to debug on the device. PGDBG only supports debugging host code.