Descriptive Analysis Workbook Panelist Consistency

Descriptive Analysis Workbook Panelist Consistency

What is it?

Panelist Consistency is one of the sheets in the Descriptive Analysis Workbook . Determines consistency by looking at the range of responses given across the reps.

Why would I use it?

Identify panelists, attributes or samples that were not repeated successfully across reps.

Setup options



To generate the Panelist Consistency sheet, under 2. Select Options , select Panelist consistency and adjust the thresholds as needed.
 


The Panelist Consistency sheet is designed to work with a 100 pt scale.

Analysis Overview

The range is calculated by subtracting the minimum value from the maximum value of all the reps.


  1. Large Threshold .  Includes all differences greater than the threshold value.
  2. Medium Threshold .  Includes all differences between the medium threshold value and larger threshold value.
  3. Small Threshold .  Includes all differences between the small threshold value and medium threshold value.
  4. Number of sessions .  The total number of reps included in the report.







  1. Percentages .  The total number within the threshold/ the total number *100.


 
Difference scores with the difference sizes highlighted. If the value falls below the small difference threshold, it is left white.
  1. #Large Difference . Number of attributes with a large difference.
  2. #Medium Difference . Number of attributes with a medium difference.
  3. #Small Difference . Number of attributes with a small difference.

For more details on response replication, see the Panelist SD Table sheet.

Example Conclusion

There are several factors to consider when reviewing potential differences between replications. For instance, if a particular attribute or sample has several responses in the large threshold, we might wonder whether something happened with one of the samples or perhaps that attribute was not well understood by the panel.

In the summary by attribute table, we see that Sweetness Flavour is causing some issues for our panel.

In the summary by panelist table, we see that Tabitha has issues with replication in several attributes/samples which can be identified by looking at the breakdown by sample tables.

In the summary by sample table, we see that the number of differences found are fairly even across the samples and therefore might consider that the attributes are causing more issues to our panelists than the samples.

In the breakdown by sample table for Apple Juice 1 we see that Tabitha Rouse is experiencing issues with Sweetness Flavour and we will want to look at the other samples to see if there is something going on in general with this attribute or only with Apple Juice 1.





    • Related Articles

    • Descriptive Analysis Workbook Review

      ​Overview​ The Descriptive Analysis Workbook provides detailed analyses on product and panelist performance. The report is compatible with sample related Line Scale , Category , LMS , Numeric , and ' Choose Only 1 ' questions when 2 or more samples ...
    • Descriptive Analysis Workbook Panelist Cards

      What is it? Panelist Cards is one of the sheets in the Descriptive Analysis Workbook .  Displays a table/card for each panelist showing their response broken down by each attribute, including all samples for each rep. Why would I use it? Provide a ...
    • Descriptive Analysis Workbook Panelist Results by Sample

      What is it? Panelist Results by Sample is one of the sheets in the Descriptive Analysis Workbook.  Panelist results and descriptive statistics by sample, attribute and rep for each panelist. Why would I use it? Review panelist raw data and ...
    • Descriptive Analysis Workbook Panelist Mean Graphs

      What is it? Panelist Mean Graphs is one of the sheets in the Descriptive Analysis Workbook . It is a visual overview of the product intensities for each attribute, showing the panel and panelist means. Why would I use it? It can be helpful for ...
    • Descriptive Analysis Workbook Panelist Rank Orders

      What is it? Panelist Rank Orders is one of the sheets in the Descriptive Analysis Workbook . Rating scores are converted to ranks for your panel and panelists. Why would I use it? Review panel agreement in intensity ranking without needing to adjust ...