9. Test Survey

Clicking on this menu item will launch the survey in the test window, recording all activities for further review and playback. 

 

When starting a new test run as an authenticated user, the system shows the dialog box below. The list in Jump to Page shows all the pages that are currently available in the Pages tab. These are pages that were already encountered/tested on a previous test run for this specific project.

 

You will also be presented with a pop-up menu asking you to select the language of the survey you want displayed. If the survey only contains one language, it will be the sole option presented in the drop down menu item.

The Box on the left that is highlight in Gray is the default way to start a test run – Manually moving through the survey like actual respondents will do.

 

New to this release, we have the box on the right that lets you have SurveyTester run a specified number of automatic test runs. The default being 5 test runs.

 

Clicking on the text in that box will highlight the item and allow you to specify the desired number of test runs to be completed.

In Manual mode, you may also choose to jump directly to a specific page in the survey. This allows you to test and review specific questions without having to take the entire survey every time you want to check on something specific.

Most testers will skip the jump option and begin the test with the first question in the survey (the default), by clicking the Start button. Programmers wishing to simply go to a specific question to review a bug can easily do so by selecting that page from the list. Please note that the list only contains questions that have been already been tested by a tester inside the selected project.

 

 

In previous releases it was recommended that someone click through the entire survey when it is activated, so that each page of the survey has been viewed and later testers have the ability to use this feature. This is a great time saver if you want to start your test run on a specific page. 

 

In the latest release the ability to generate a number of automatic test runs allows you to easily (automatically) do a number of tests that will randomly go that=rough various routings

 

After selecting a specific page “to jump to”, SurveyTester will use the last suitable test run for the selected language that can be used to deliver the tester to the requested page.

 

SurveyTester will then render the survey as the final respondent would have seen it.  The SurveyTester tool-icon will be visible at the bottom left of the browser window.

Items on the old (Data Collection/Confirmit) SurveyTester menu icon.

 

The items below are specific to previous versions of SurveyTester and will now only be seen when testing Data Collection/Intelligence and Confirmit surveys if you do NOT have the USE BROWSER EXTENSION item checked on the Project details form.

Routing Diagram: Display the routing showing where the tester is in the survey.

 

Ruler: Display/hide the ruler. (This item removed when using ST extension).

 

Show Issues: Review any issues reported by previous testers (if you have permissions to see those issues) and enter any issues you wish to report.

 

Exit: Exit the test run and return to the SurveyTester menu.

 

 

If you are using SurveyTester on a project with the SurveyTester Browser Extension enabled you will see these items.

 

The + sign is a quicker way to add a new issue.

At the bottom of the SurveyTester screen are 3 light blue items that help you move through the survey.

Erase All: this allows you to clear the current page of any and all responses you have specified.

 

AutoAnswer: Automatically answer any single response, multi-response, numeric, and grid questions on the page. (This is a tremendous time saver on grid questions). In some cases AutoAnswer will generate an invalid response to a question (such as alphanumeric response in a numeric field). When this happens an error message will display when you click to move to the next question/page.  The error will then need to be manually corrected.   

 

AutoNext: Automatically answer any single response, multi-response, numeric, and grid questions on the page, as with AutoAnswer, and then move to the next survey page. (This is the same basic process as responding to all items and then hitting the Next button on the survey form).

 

 

9.1 Routing Diagram

 

A new routing diagram will show you where you are in the survey and the routings encountered by previous testers. This tester is on the age question.

Jump anywhere you want - from anywhere you want.


While testing a survey, you can now click on any question in the flow diagram to jump to it. It even works if the question is completely out of your current branch. 

A new test run will NOT be started, the shortest route from the question you currently on- to the target question; is being calculated and will automatically processed in just a few seconds. This allows you to freely move inside of your survey like never before! 

 

9.2 Ruler (phased out in the new Chrome extension version)

 

Some sites measure the size and layout of grids and images.  The Ruler allows you to easily view these measurements. The Ruler can be flipped and re-sized by clicking on the icons at the edge of the ruler.

The Arrow Line icon changes the length of the ruler.

The Circle icon will transpose the ruler 90 degrees.

 

9.3 Exit

 

When you reach the end of the survey, simply click on the Exit icon and you will exit SurveyTester. 

All of your comments are now stored in a central dashboard for the programmers to review and address.

 

9.4 Issues

 

When you find an issue, click on the Issues menu item and a window will appear into which you can type your comments. The number and contents of the drop down item list are different for each customer, and under the control of your system administrator.

 

If there are no reported issues on this page, an empty form will appear. Click on Add Issue to create a new issue report.

 

This is the new Issues form if using the Chrome extension

When you add an issue, you can specify the Priority, Issue Type, and other parameters that the system administrator has configured. The Issues form that you see might not look like the one in this example, as they can be company and project specific.

 

Below is an example of a more complicated classification set.

Click on Add Issue in the lower right hand corner of the form to save the item you have created.

 

Subsequent testers will see all issues that you and others have reported.

 

 

To close the ISSUES form simply click on the X in the upper right hand corner of the box.

Depending on what version of SurveyTester you are using. New Chrome Extension or non-extension for Confirmit/Data Collection surveys, you will see different ways to highlight issues on the screen.

 

With DC/ Confirmit You can highlight items on the page using the pencil tool located on the bottom of the Issues form.

 

The screen shots that are saved when you report an issue will contain those highlighted items.

 

 

 

 

 

 

 

 

 

 

Click on a pencil color to enable yourself to draw a Highlight box on the screen

With the Chrome Extension you now simply enable the “mouse marking item” on the issue form and then put your cursor on the survey page and create a highlighted box area around the issue.

Other testers will then be able to see the issue that you have reported. As you can see in the example below, comments from testers of both the Spanish and English language version of this survey are collected in the Issue form.

9.5 AutoAnswer Menu Items

 

The AutoAnswer function is a fantastic time saver for grid questions.

For example, on the mandatory response question above, you have three options:

  1. Click 10 times: once for each of the 10 items in the grid and then once on the Next button on the survey page.
  2. Click two times: once on the AutoAnswer menu bar item and then once on the Next button on the survey page.
  3. Click one time: once on the AutoNext menu bar item.

The responses are randomly selected. Each time you do AutoAnswer on the same question, different responses might be specified.

 

If you click on AutoAnswer, SurveyTester will automatically answer any single response, multi-response, numeric, and grid questions on the page. In some cases AutoAnswer will generate an invalid response to a question (such as alphanumeric response in a numeric field). When this happens an error message will display when you click to move to the next question/page.  The error will then need to be manually corrected.

 

Click on the Erase all button to clear any and all responses on a page.

 

 

9.6 AutoNext

 

You can also click on AutoNext, which has the same function as AutoAnswer, but also takes you to the next survey page. (This is the same basic process as responding to all items and then hitting the Next button on the survey form).

 

 

9.7 Page Name

 

For better tracking we display the name of survey page in the lower right hand corner of the browser window. In this example the user is on the HowMany question page.

9.8 Languages

 

See all answers in any language active in the project.

 

Ever wanted to know what that Chinese label actually means in English? You can cut and paste into Google Translate (maybe). Or you can use the new labels feature.  All labels are now detected and saved in every language of your survey, so that you can switch back and forth to your preferred language whenever you want. This assumes, of course, that the project has more than one activated language.