As this article(http://msdn.microsoft.com/en-gb/library/ee441265.aspx#BKMK_debugMany) says: when we create a MS-MPI application in Visual Studio(pro or higher), we can use MPI Cluster Debugger to debug our parallel program, but when I open the list "Debugger to launch" and there are no debugger named "MPI Cluster Debugger", I want to know why and how to get it in my VS then?
Why my Visual Studio 2013 Ultimate doesn't have MPI Cluster Debugger?
Because it's in Visual Studio 2010 not Visual Studio 2013. From the page you linked:
Walkthrough: Launching the MPI Cluster Debugger in Visual Studio 2010
Visual Studio 2010
The download page is clear as well:
File Name: SOADebugger_VS2010.msi Date Published: 18/01/2011 File Size: 688 KB