visual studio: attach debugger without starting web debugging

I have a visual studio solution with a half dozen web application projects. I often want to attach the debugger to a process. When I do this, visual studio always wants to start up cassini or IIS express or do something to run the web applications in the solution. Is there a way I can skip that, so when attaching to a process visual studio does not try to start the web applications in the current solution?

On the project properties, there's a setting called "Development Server" -> "Always Start When Debugging." Might be worth a shot.