Question Type: Rank

Question Type: Rank

Overview

In a Rank question, panelists are presented with a group of samples or concepts/choices and asked to rank the choices in order of preference or perceived intensity.

There are five types of Rank questions available:
  1. Rank all concepts: A panelist is presented a list of concepts and is asked to rank all of the concepts. 

  2. Rank n concepts : A panelist is presented a list of concepts and is asked to rank a subset of concepts. The minimum and maximum number of concepts that can be ranked is predetermined during the test setup. 

  3. Rank all samples:  A panelist is presented a list of samples and is asked to rank all of the samples. 

  4. Rank n samples:  A panelist is presented a list of samples and is asked to rank a subset of samples. The minimum and maximum number of samples that can be ranked is predetermined during the test setup. 

  5. Rank preference: A panelist is presented a pair of samples and is asked to select which sample they prefer. 

For the full page view of this article, in the top right-hand corner, please click on the icon with an arrow.


Question Compatibility

Rank questions are compatible with the following test types:
  1. Standard test
  2. Survey - Only Rank all concepts and Rank n concepts are compatible. 
  3. Same/Different test - Only Rank all concepts and Rank n concepts are compatible.

Add the Question:

  1. From the Build area of your questionnaire, click the blue Add Element button on the left. 
  2. Select Rank/preference and click one of the following Rank options: 
    1. Rank all concepts
    2. Rank n concepts
    3. Rank all samples
    4. Rank n samples  
    5. Rank preference
  3. Update Question Name field. 
  4. Click Add panelist instructions for this question to add text. The Rank preference question will have preset instructions which you can update as needed.
Images can be added in the panelist Instructions.

You are able to drag and drop a question to the location of your choice when adding in a new question to your questionnaire. You can also move your question after adding it by using the Move up and Move down arrows.

Question Options

Click Question options to access a list of options available to further customize your question.



If you don't see the menu options on the right, click the question in the build area to highlight the question.

Options in the Concepts Tab

The Concepts tab is only available in Rank all/n Concept questions.

Option Name  

Option Description 


Concept  


Identifies how many choices are in the question.  

Images can be added in the panelist Instructions. Hover over a concept number and the cursor will change like this: 

Click and drag the choice to a different spot in the question. The value will not be updated when the choice is moved to a different order in the list. 

Text 

Edit the text to label the choices.  

Value 

Enter the number indicating the value that will be assigned to each concept in the test results. The values can be updated after results have been collected.  


Image 


Click  Add image  to associate an image with the choice.     

If you want this image to display to panelists, you will need to ensure the Choice display    option, found in the Display   tab, is set to either  Choice image only  or  Choice label and image  .

Delete 

Click      to remove the choice from your question.     

Add Choice 

Click to add additional choices at the bottom of the list of your question.  

Reset values


Click to renumber the values in the Value column to be in the ascending order.  

This is helpful for choices that were manually moved around to ensure that the values reflect the final choice order.  



Options in the General Tab 


Option Name  

Option Description  

Question name  

The  Question Name  is the label displayed for analysts in the heading of the following areas: 

  1. Question in the Build area of your test.
  2. Analysis Reports, Graphs and Exports.

Show question name to panelists   

Click to display the  Question Name  to panelists or to hide it from them. 

Display name  


Enter the text that you wish to display to the panelist if your  Question Name  is of a sensitive nature and should not be visible to them.

Sensitive data 

Click  Yes  to flag the collected results for this question as sensitive.  


If the panelist unsubscribes or is deleted from the Panelists library by an administrator, their data collected in questions marked as sensitive will also be removed.  

Data collected in questions that are not marked as sensitive will remain in your tests even after a panelist is unsubscribed/deleted.  
Question type
Select from the dropdown a different variation of this question type.  
This option is not available in Rank preference question type.


Options in the Display Tab for Rank all/n Concepts


Option Name 

Option Description 


Show question 


This will control whether your question will be sample related, test related, or not sample related. 


  1. For all samples : The question will display for all the samples in your test. 
  2. Once (not sample related): The question will display only once and will not be sample related. This is useful for collecting demographic data.  


Present question


Specify how you'd like the question to appear:     


  1. Monadically/one sample at a time :  This will display the question to the panelists one sample at a time.   
  2. All samples at first opportunity : This will display the question to the panelists for all the samples on the same page, in the first cycle through the questionnaire.  
  3. All samples at last opportunity :  This will display the question to the panelist for all the samples on the same page, in the last cycle through the questionnaire.
  4. First Cycle  : This will display a  Once (not sample related)  question in the first cycle through the questionnaire.  
In a test that has all not sample related questions (i.e. in the Survey test type), the question will be displayed in the order it is in the list of questions.  


Choice display 


Select from the following choice components to be displayed to the panelists:  


  1. Choice label only:  Display the text label only.  
  2. Choice image only:  Display only the image associated with the choice. 
  3. Choice label and image:    Display both the image associated with the choice and the text label. Add an image to your choice in the Choice/Concept tab.  
By default,  Choice label and image  option is selected.  

Evaluate image as sample  

Displays the image file associated with the presented sample. Images can be uploaded to each sample in the  Samples & design  area.   


Allow ties 


Allow panelists to rank two or more choices as the same.  

You will not be able to allow ties if your Rank n is set up as a Rank 1 of 2.   


Additional Display Options for Rank n Concepts  

Option Name  

Option Description  

Max selections allowed  

Set the value for the maximum number of ranked concepts. The highest value equals the total number of choices in the question.    

Min selections allowed  

Set the value for the minimum number of ranked concepts. The lowest value is 1. 


Options in the Display Tab for Rank all/n Samples and Rank Preference

Option Name 

Option Description 

Show question 

This will control whether your question will be sample related, test related, or not sample related. 

  1. For all samples: This will display the question for all the samples in your test. 


The  For all samples option is the only available option when ranking samples.  


Present question


Specify how you'd like the question to appear:     

  1. All Samples at first opportunity : This will display the question for all the samples all at once to the panelist. 
  2. All Samples at last opportunity :   This will display the question for all the samples at once at the end of the cycles to the panelist.   
By default this option is set to  Al l Samples at last opportunity when a Rank all/n samples question is selected. 

Show blinding code

Display the sample blinding code of the current sample.  


Sample order


Display the order in which samples will be presented to panelists on screen.  

  1. Sample set order: Sample choices display according to the design order in the sample set.
  2. Fixed order : Sample choices display according to the order in the Samples list (Sample 1, Sample 2, etc.). 
  3. Random order : Sample choices display randomly to every panelist.  


Evaluate image as sample


Displays the image file associated with the presented sample. Images can be uploaded to each sample in the  Samples & design area.  


Allow ties 


Allow panelists to rank two or more choices as the same.  

This option is not available in the Rank preference question type.


Sample display 


Choose how your samples will be displayed to panelists on the screen.  

  1. Sample label only  : Sample choices display text label only, as selected in  Sample label to show   list.
  2. Sample multimedia only  : Sample choices display only the image associated with the sample in   Samples & design  .
  3. Sample label and multimedia :  Sample choices display both the image associated with the sample in  Samples & design    and the display text. 
  4. Sample label to show  : Choose how the sample label will display to panelists on the screen.   


Sample label to show


Choose which information to show as your Sample labels to the panelists.  

  1. Sample blinding code : Sample blinding codes display to panelists. 
  2. Sample name :  Sample names display to panelists. 
  3. Product name : Product names as stored in the Products library display to panelists. 
  4. Product code : Product codes as stored in the Products  library display to panelists.   


Additional Display Options for Rank n Samples 

Option Name   

Option Description 

Max selections allowed

Set the value for the maximum number of samples panelists will rank. The highest value equals the total number of choices in the question.   

Min selections allowed  

Set the value for the minimum number of samples panelists will rank. The lowest value is 1. 

Analysis 

Click the Results tab to access and choose from the following analysis options:  
  1. Graphs - Visual representation of the data.
    Graphs are not available for Rank all concepts or Rank n concepts .
  1. Data - Raw data display. This will display the rank that each sample/concept was given. 
  2. Reports - Create new or view previously generated reports. The following reports are compatible with the Rank question type:
    1. Standard report - Detailed information about counts, Friedman Analysis of Rank, Distribution of Responses, Binomial distribution : Null Hypothesis, Alternative hypothesis,  statistical decision and Multiple Comparison Test.
      Information found in the Standard report will depend on the question setup of your Rank question.
    1. Summary Report - Provides you with a more compact table of the results found in the standard report. This includes: Counts of when each sample was selected as preferred, p-value for two-sided binomial, p-value for one-sided binomial, and 4 d' calculations.
      The Summary report is only available for Rank preference.
    1. PowerPoint report - Visual representation of the data in the PowerPoint Report file format. 
      The PowerPoint report is not available for Rank all concepts or Rank n concepts .
    1. Raw data export - Choose from the Multivariate, Univariate, and Multivariate Columnar raw data export formats to suit your exporting needs.


    • Related Articles

    • Question Type: Sort

      Overview In a Sort question, Panelists are presented with a group of samples or concepts and asked to organize them into bins. There are three types of Sort questions available: Free sort: The Free Sort question allows panelists to sort products into ...

    • Question Type: Comment

      Overview Comment questions are used to gather panelist comments, observations or demographic information, such as their name.  You can specify the size of the comment box (number of characters across/down), and set the maximum number of characters ...

    • Question Type: Tetrad

      Overview Tetrad test is a discrimination test type that helps you determine if there is a difference between two products by asking panelists to group 4 samples into 2 groups of 2. Unlike most other question types, the Tetrad question is not ...

    • Question Type: Choose

      Overview In a Choose question, panelists are presented with a group of choices or concepts and asked to pick one choice, all choices that apply, or a specific number of choices. There are three types of Choose questions available in Compusense20: ...

    • Question Type: Triangle

      Overview In Triangle questions panelists are presented with a total of 3 samples, two of one product and one of another. They are then asked to taste the samples in front of them from left to right. After they have tasted all three samples they are ...