Clicking on this menu item will launch the survey in the test window, recording all activities for further review and playback.
The system shows the dialog box below when starting a new test run as an authenticated user. The list in the Page dropdown box will show all the currently available pages in the Pages tab. These pages were already encountered/tested on a previous test run for this specific project.
You might also be presented with a popup menu asking you to select the language of the survey you want to be displayed. If the survey only contains one language, it will be the sole option in the dropdown menu item.
The Box on the left, highlighted in Blue, is the default way to start a test run – Manually moving through the survey like actual respondents will do.
In Manual mode, you may also choose to jump directly to a specific page in the survey. This allows you to test and review particular questions without having to take the entire survey every time you want to check on something specific.
Programmers wishing to go to a specific question to review a bug can easily select that page from the list. Please note that the list only contains questions that a tester has already tested inside the chosen project. By clicking the Start button, most testers will skip the jump option and begin the test with the first question in the survey (the default).
The box on the right lets you have SurveyTester run a specified number of automatic test runs. The default is 5 test runs. Clicking on the text in that box will highlight the item and allow you to specify the desired number of automatic test runs to be completed.
The ability to generate several automatic test runs allows you to easily (automatically) do several tests that randomly go through various routings.
After selecting a specific page “to jump to,” SurveyTester will use the last suitable test run for the selected language that can be used to deliver the tester to the requested page.
SurveyTester will render the survey as the final respondent would have seen it.
The SurveyTester Tool icon (bubble) will be visible at the bottom left of the browser window.
Clicking on this Small icon will launch a form on which you will see these items.
Routing Diagram: Displays the routing showing where the tester is currently located in the survey.
Answer Log: Will display a list of all questions previously seen in this test run and the answers you selected for those
Show Existing & Add New Issues: Review any issues reported by previous testers (if you have permission to see those issues) and enter any new issues you wish to report.
Exit: Exit the test run and return to the
At the bottom of the SurveyTester screen are four items that help you complete the survey. Chapter 8 of the Guide will provide more information on these items.
Erase: this allows you to clear the current page of all specified responses.
AutoAnswer: Automatically answer any single response, multi-response, numeric, and grid questions on the page. (This is a tremendous time saver on grid questions). In some cases, AutoAnswer will generate an invalid response to a question (such as an alphanumeric response in a numeric field). When this happens, an error message will display when you click to move to the next question/page. The error will then need to be manually corrected.
AutoNext: Automatically answer any single response, multi-response, numeric, and grid questions on the page, as with AutoAnswer, and then move to the following survey page. (This is the same basic process as responding to all items and then hitting the Next button on the survey form).
Unlock Auto Complete: This function allows a tester to complete a manual test run without clicking AutoNext on each page. It is the equivalent of an automatic test run but an automated test run that can be started at any point in the survey. See page 106 for more details.
2nd Chance Answers
The automatically created answers are initially random choices. As soon as an error message appears on the screen, SurveyTester will parse the error message to find a more suitable solution that fits the given restrictions.
For example, think of a sum grid, where the single lines must sum up to a specific number. This can be a static
number or a number previously entered for another question. When SurveyTester finds an error message like
“Please make sure the numbers add to 100%”, then the Auto Answer algorithm will interpret this information and attempt to generate an answer to the question with a valid response.
In this case, press the Auto Answer Button again, and SurveyTester will usually (often) generate an accepted/valid answer to the question.
For complex questions, the algorithm might need help finding the correct answers. In this case, you can enter the answer manually and use the survey’s next button.