Test Cases allow you to specify a response criterion for your test scenarios.
Specify that automatic test runs consistently choose the same response for a question. For example, item 1 at Question Q1 and/or the 3rd response on question Q7.
Specify the responses to a question that should be selected by the percentage of automatic test runs conducted using the selected TestCase.
Bypass custom validations (e.g., for British postal codes) as the auto-complete feature does not allow defined random values for text questions.
Define multiple test scenarios to go through different routing flows in your surveys. For example, if the client only made changes to section B of a survey, you could create a TestCase flow that ensures all future automatic test runs (using the specified Test case) always go through the routing that takes them to Section B.
Here is an example using our Museum Demo survey.
SurveyTester only knows a survey question exists once it has recorded it in a test run. So, we will start by doing one manual test run to work our way through the (short) survey, giving SurveyTester a record of the questions we want to use in this demo. Another way to do that is to run several (or many) automatic test runs so the system has a good idea of the routing flow in the project.
We choose ‘English’ as the survey language.
When we reached the BIOLOGY question, we chose ‘No’ to respond to that question.
As you can see in the Routing Diagram, the ‘No’ response to the BIOLOGY question sent us to the BEFORE question.
We want to test the survey when the BIOLOGY response is ‘Yes,’ as that routing activates a few more questions to be asked before getting to the BEFORE question.
On the Project details form, we select the Test cases menu item, then specify the name of this “routing set” to be Sample.
If you have not previously executed some test runs, you will see this message:
We now specify the rules to be followed for a specific question. Click Add on the TestCase form to show a list of all the survey questions (previously identified by a test run).
You may need to complete several test runs to ensure the desired questions are displayed in this list. You can review the routing flow diagram to confirm the location of a question in the routing.
In this example, we will specify the Language question to have an ‘Exact’ response.
The Test cases system shows you the survey question (language) you have selected and the list of responses to that question.
Enter the answer that SurveyTester should use for answering this question when this Test Case is selected for automatically given answers. The Exact match on this page shows the questions symbolically. The
presentation might differ from your actual survey design. It is also possible to use this definition for multiple languages.
Single Response questions are shown with checkboxes because you can select various categories. They will be chosen randomly for automatic answers.
For Multi Response questions, all answers are used exactly how you define them here. Use the pattern method for more flexible answer definitions.
Click on the Pattern method to enter detailed answer options, which SurveyTester will use.
For a single response question, choose the item you want to be selected for this question, and it will then be chosen in all future automatic test runs using the Sample test case.
‘English’ will be the language used in the automatic test runs using the Sample Testcase routing.
We then click SAVE and define a second parameter, choosing ‘yes’ as the response for the BIOLOGY question.
We will now do two automatic test runs, both of which will select ‘English’ as the language and ‘Yes’ as the response to the BIOLOGY question. Select the appropriate test case (Sample) from the new Testcase dropdown list to specify that routing.
As seen in the following routing diagram, ‘Yes’ was the response to the BIOLOGY question in the two new automatic test runs. This verifies that the test case specified routing was followed correctly. And we now see that if the respondent chooses ‘Yes’ to BIOLOGY, they will be asked a Certificate question before moving on to the BEFORE question.
Clicking on the Pattern item in the Test cases form will refresh the page showing cells into which you can enter a percentage value for subsequent test runs. In this case, 10% (approximately) of future automatic test runs will select a ‘Yes’ response, 80% will choose a ‘No’ response, and 10% will select the ‘No answer’ reply.
In long, complicated surveys with many potential routings, this feature allows you to specify several automatic test run routings to be followed.
You can also rename, duplicate or delete a Test Case. Deleted Test Cases cannot be recovered, and all related information will be lost.
Click on the three dots to the right of a test case to launch an edit window.
SurveyTester now remembers the selected Language, Test Case, and Market during the browser session. The next time you launch a test run for a previously tested project, the settings will be populated.
Those settings will also be displayed on the Issues form.
The value for the checkbox “Open New Tab” is stored permanently. It will remain in effect during the entire session and future sessions until you decide to uncheck (or check) the box.
Test cases are now visible inside the Issues grid and Issues details page. This makes it easier for project managers to determine what could have caused a reported issue.
