There are a number of dropdown menus at the top of the page that allow leaders to customize comparisons.

• Use the ‘I want to compare’ menu to select the type of questions you want to compare with your demographic questions. 
  • Satisfaction score questions ask participants to rate their satisfaction on a 10 point scale. This comparison will display how demographics groups compared to one another in their degrees of satisfaction.
  • Favorability score questions ask participants to respond to a question or statement using a 5-point Likert scale often indicating agreement or alignment (ex. strongly disagree, disagree, neither agree nor disagree, agree, strongly agree). This comparison will show how groups differed from one another in their levels of agreement.
  • Demographic group sizes provides a simple comparison of the number of participants who responded with each possible option to closed-ended survey questions other than Satisfaction score or Likert-type questions.
• ‘Between these demographic questions’ is where you can select the closed-ended questions (other than satisfaction score or Likert-type questions) that will form the basis of the comparison.
• If you chose Satisfaction or Favorability scores in the ‘I want to compare’ menu the ‘And these Likert Scale/Satisfaction score questions’ will appear. This is where you can select the relevant questions whose scores you will be comparing across demographic groups.
• The optional ‘Filtered by’ menu allows you to focus your analysis on participants who responded in a given way to any of your demographic questions.
• If you selected Favorability scores in the ‘I want to compare’ menu, the optional ‘Configure Favorability’ button will appear. This menu allows you to select the responses to each of your Likert-type questions that you consider favorable or positive for this comparison (sometimes, based on the way questions are posed, ‘disagree’ could be considered a favorable response rather than ‘agree’). Simply click the checkboxes next to the favorable responses for each question and click Save.
  
• The ‘Advanced’ menu allows you to include or leave out:
  • Answer options with 0 responses.
  • Partial responses (answers from participants who left the survey before completing all the questions)
  • The count of participants who responded with each option to your demographic questions.

The results of your chosen comparisons are displayed according to the type of comparison being conducted (each is described below). The visualization of each comparison can be exported as a .png file using the ‘Export’ button above and to the right of the visualization.

Favorability Scores

Favorability score comparisons show the percentage of participants in each category of the demographic question who responded with the options indicated as ‘favorable’ in the ‘Configure Favorability’ menu. The tool compares these proportions to the ‘Overall’ favorability score (which combines the responses from all participants). Groups with a green or dark green treatment demonstrated favorability scores that were higher than the overall group and groups with a red or dark red treatment demonstrated favorability scores that were lower than the overall group. Results with an asterisk (*) indicate a statistically significant difference from the overall score (see section below about tests of statistical significance for more information).

Note: Results are hidden for demographic groups with fewer than 5 participants to protect participant identities. 

Comparing Favorability Scores Across Engagements

You also have the option to compare favorability scores across engagements if you have asked the same question more than once. Simply select "Yes, include another engagement" in the "Include other engagements?" drop-down menu and select the engagement you would like to run the comparison with in the "Select other engagement" drop-down menu.

The table will now show how the pattern of responses in the engagement you are focused on compares with the engagement you selected in the "Select another engagement" menu. Green cells demonstrate an increase in the proportion of responses, and red cells indicate a decrease.

Satisfaction Scores

Satisfaction score comparisons show the percentage of participants in each category of the demographic question who indicated they were dissatisfied, passive, or satisfied in response to the chosen satisfaction score question. Participants who responded with a score of 0 through 6 are sorted into the dissatisfied category, those who responded 7 or 8 are passive, and 9 and 10 are satisfied. The ‘Satisfaction Score’ is the percentage of participants who were satisfied minus the percentage of participants who were dissatisfied. 

Note: Results are hidden for demographic groups with fewer than 5 participants to protect participant identities. 

Demographic Group Sizes

Demographic group sizes display the number of participants who provided each possible answer to the selected demographic question(s).