tfsmicrosoft-test-manager

How to Run the Same Manual Test Case Against Different Environments Requiring Different Parameter Values


I have a set of manual test cases which I have run successfully against my development environment. I would now like to run the same tests against the QA and UAT environments (and maybe later against the STAGE and PRODUCTION environments).

My test cases include the URL of the site to test. In my situation, the URL differs from one environment to the next, for instance dev.mysite.com, qa.mysite.com, uat.mysite.com. The test steps will be identical in the QA and UAT environments to the steps which have run successfully in the DEV environment.

I know that I could create separate test plans for QA and UAT, and that I could clone the existing tests into the new test plans. That would allow me to edit the cloned test cases to change the parameters.

But this would be a maintenance problem: for every test, I would have three separate copies. When a test changed in DEV, I would have to make the same change to the QA and UAT versions!

Is there a better way to accomplish running the same tests in multiple environments?

Note that these are existing physical environments, so I can't use Lab Management to create a set of isolated virtual environments, where I could play with networking to have them all called env.mysite.com, or something.


Solution

  • There is not a way to pass parameters as the primary use case for manual testing / and coded UI is validation of functional behaviour. Once you have validated it once a simple smoke test should be used to validate the deployment.

    However you can use the hosts file on the client machines to have a constant url, say m siteundertest.mydomain.com always point to the correct server.

    You then are simulating a single url when in fact it points to a different box.