How do I use the Respondents tab in Website Testing results to manage respondents?

In this help, we'll explain how to use the Respondents tab to:

• Use the respondent list
• View details about individual respondents
• Filter respondents
• Apply mass actions to selected respondents

Use the respondent list 

The list of respondents is the main feature of the Respondents tab. These are are all the people who participated in your study. Each respondent's entry contains:

• The respondent's number and icon. The icons are randomly generated and serve only for easier identification of respondents
• Respondent selection via a checkbox. Selected respondents are highlighted and can have several operations done on top of them
• Play first task - click the play_circle_outline button to replay the respondent's first task. Last session means the visitor's most recent session that matches the filter above
• Time taken - how long it took the respondent to complete the whole study
• Questions answered - the number of questions expressed by a percentage
• Tasks completed/skipped/closed/successful - the number of tasks, expressed by a percentage
• Include in analysis - determines whether the respondent should be counted in the calculations found under the Analysis tab. Respondents who abandon the study are excluded by default.
• After you've adjusted which respondents should be included in the analysis, click Recalculate analysis above the list of respondents to apply the changes to the analysis (everything under the Analysis tab)
• By default, the respondents are ordered by the time when they participated in the study. You can change this order by selecting a different sorting metric in the Sort by dropdown list above the respondent list. Click the arrow buttons to change between ascending (arrow up) and descending (arrow down) order

Filter respondents 

• Filter the respondents to only display the ones who meet a certain criteria
• You can filter the respondents based on the time it took them to complete the study
• If your questionnaires contained multiple-option questions, you can also filter the respondents based on their answers
• Enter your filter and then press Apply filter to filter the respondents
• If any selected respondents become invisible due to a filter, they will also be de-selected

View details about individual respondents 

To view more information about the respondent, click More details beneath the respondent's entry. There are four tabs in the detailed respondent modal view with the following contents:

Respondent's Details 

• ID - the number of the respondent
• Started at - when the respondent opened the study
• Time taken
• Questions answered
• Tasks completed / skipped / closed / successful
• Instructions seen - count of how many times the respondent re-opened the study instructions after seeing them initially (seeing instructions for the first time doesn't count)
• Number of comments - how many comments the respondent left behind
• IP address
• Device
• Device type
• Operating system
• Browser
• Screen resolution
• Location (city, region, country)

Respondent's Questionnaire 

Select the questionnaire you want to see answers for:

• Screening question
• Pre-study questions
• Post-study questions
• Questions after tasks

After selecting Questions after task, select the task the questionnaire you're interested in is related to. Either use the task selection dropdown list, or use the arrow buttons on the right and left sides of the task selection dropdown list to move between tasks one at a time.

The question results show the respondent's answers for each question, as well as the question text and the list of available options (in case of multiple-option questions). If you include Skip Logic in your questionnaire it is important to differentiate between:

• Question skipped - the participant didn’t see this question because of the Skip Logic rules
• Question seen, did not answer - the participant saw this question and decided to skip it

Respondent's Task Results 

• This tab shows the respondent's data for each task
• The result - Success / Failure / Skip / Close
• Time taken - The time from when the starting URL opens, until respondents submits their answer
• Task text
• Destination - What URL the respondent chose as the right location
• Source and Correct destination - What URLs were set as the starting screen and as correct answers (to facilitate analysis)
• Stream - Click the play icon to see session replay of the respondent's execution of the task

Respondent's Crowd Feedback 

This tab shows the respondent's data from all crowd feedback collected during the study. If you ran Crowd Feedback after tasks, use the dropdown list to switch between tasks. By default, feedback from all tasks is displayed.

Ideas in Crowd Feedback belong into one of three categories. Each category has its own distinct color:

• Like - What the respondent liked
• Dislike - What the respondent disliked
• Improvement - What suggestions the respondent had for improvement

For each category that you collected with crowd feedback, you will see:

• Respondent's ideas - A list of ideas submitted by the respondent.
• Idea the respondent voted for - Voted ideas, along with their author. If the respondent submitted an additional comment with their vote, you will see it here. If you used the Likert scale, there will also be a score.

Respondent's Comments 

The comments left by the respondents during the study. Each comment contains text and the information about the step of the study during which it was submitted.

Apply mass actions to selected respondents 

• You can either select respondents individually, or en masse by using the Select all and Deselect all buttons
• Deselect respondents by a chosen criteria by using the filters
• Pick an action that you want to do with the selected respondents and click Go to execute it
• Mark as included/excluded - marks all selected respondents as either included or excluded in the analysis
• Delete - permanently deletes all of the respondent's data related to the study
• Export as CSV - exports details about the selected respondents (the same details as seen in the Respondent's Details tab) as a CSV spreadsheet

The order of columns in the respondent export:

• Order
• Identifier
• Started
• IP
• Device
• Operating system
• Browser
• Location
• Time taken
• Answered questions (percentage)
• Completed tasks (percentage)
• Skipped tasks (percentage)
• Closed tasks (percentage)
• Successful tasks (percentage)