How do I use the Overview tab in Website Testing results?

In this help, we'll explain the information found in the Overview tab.

Summary 

• The donut chart tells you how many respondents participated and how many actually completed the study
• The numbers of respondents who were screened out or abandoned the study are also displayed below
• Created on is the date when the study draft was first made
• Launched on is when data started being collected

Time Taken 

• A breakdown of how long it takes people to complete your study
• The candlestick chart displays the time range in which respondents completed your study
• The bar illustrates the upper and lower quartiles with the line inside marking the median value
• T-shaped 'wicks' in the candle chart mark the highest and lowest times that it took to complete the study

Top Locations 

• The top three countries that your respondents came from
• Location is determined based on the respondent's IP address and as such can be inaccurate (such as when the respondent is using and out-of-country VPN or other means to obfuscate their presence online)

Success 

• Success is the percentage of answers that were correct, calculated for all answers from all respondents. It shows how well the respondents handled the tasks overall.

Tasks result overview 

This bar chart breaks down the answers to each task depending on their ending status.

• Success - the respondent ended the task on a correct URL
• Failure - the respondent ended the task on an incorrect URL
• Skip - the respondent pressed the button to skip the task
• Cancel - the respondent closed the task tab

The skips will only appear in the results if you allowed respondents to skip tasks in the task setup.

Lostness 

The Lostness metric is calculated for each of your tasks as a gauge of effectiveness of your website's navigation. It tells you how lost your users get when they use your website (when they solve your tasks). Lostness is based on the difference between the number of pages visited by the user and the minimum number of pages that need to be visited to solve the task (the optimal path). If you haven't entered an optimal number in task setup, we automatically consider the minimum number of pages traversed by a respondent to be the optimal path. (However, this respondent may or may not also have been lost, which is why we recommend properly setting up the length of the optimal path for your tasks.)

Lostness is calculated as the average lostness of all respondents who successfully completed the task. A high lostness score (closer to 1) means that users are very lost and have a problem with solving the task. A low score (closer to 0) means users can solve the task relatively easily.

If there are respondents who completed the task in a shorter number of steps than the optimal path you specified in setup, their lostness has value of '0!' and is not included in the average. Average lostness can have the value of '0!' if all successful respondents have lostness of '0!'. If there are no successful respondents, lostness will show 'No data'.

Avg. page views - the average number of unique pages is also calculated only from respondents who completed the task successfully.

Device Breakdown 

• The top three types of devices that your visitors accessed your website / web app from

OS Breakdown 

• The top three operating systems that your visitors accessed your website / web app from

Browser Breakdown 

• The top three browsers that your visitors accessed your website / web app from

Screen Resolution Breakdown 

• The top three countries that your visitors viewed your website / web app in