Assessing the performance of a sensory panel–panellist monitoring and tracking

Sensory science uses the human senses as instruments of measurement. This study presents univariate and multivariate data analysis methods to assess individual and group performances in a sensory panel. Green peas were evaluated by a trained panel of 10 assessors for six attributes over two replicates. A consonance analysis with principal component analysis (PCA) is run to get an overview of the panel agreement and detect major individual errors. The origin of the panellist errors is identified by a series of tests based on analysis of variance, i.e. sensitivity, reproducibility, crossover and panel agreement, complemented with an eggshell correlation test. One assessor is identified with further need for training in attributes pea flavour, sweetness, fruity and off‐flavour, showing errors in sensitivity, reproducibility and crossover. Another assessor shows poor performance for attribute mealiness and to some extent also fruity flavour. Only one panellist performs well to very well in all attributes. The specificity and complementarity of the series of univariate tests are explored and verified with the use of a PCA model. Copyright © 2005 John Wiley & Sons, Ltd.

[1]  S. R. Searle,et al.  Generalized, Linear, and Mixed Models: McCulloch/Generalized, Linear, and Mixed Models , 2005 .

[2]  Bruce R. Kowalski,et al.  Predicting sensory profiles from external instrumental measurements , 1989 .

[3]  John W. Hall,et al.  A COMPARISON OF METHODS FOR EVALUATING THE PERFORMANCE OF A TRAINED SENSORY PANEL , 2001 .

[4]  H. Martens,et al.  Modified Jack-knife estimation of parameter uncertainty in bilinear modelling by partial least squares regression (PLSR) , 2000 .

[5]  Bernice W. Polemis Nonparametric Statistics for the Behavioral Sciences , 1959 .

[6]  Mina R. McDaniel,et al.  USE OF CONTRASTS FOR THE EVALUATION OF PANEL INCONSISTENCY , 1990 .

[7]  Tormod Næs,et al.  Analysis of Variance for Sensory Data , 1997 .

[8]  Mina R. McDaniel,et al.  THE PANELIST EFFECT – FIXED OR RANDOM? , 1988 .

[9]  Garmt Dijksterhuis,et al.  Assessing panel consonance , 1995 .

[10]  Mina R. McDaniel,et al.  INFLUENCE OF PANEL INCONSISTENCY ON THE OUTCOME OF SENSORY EVALUATIONS FROM DESCRIPTIVE PANELS , 1991 .

[11]  Tormod Næs,et al.  Measuring validity in sensory analysis , 1995 .

[12]  Tormod Næs,et al.  Detecting individual differences among assessors and differences among replicates in sensory profiling , 1998 .

[13]  S. R. Searle,et al.  Generalized, Linear, and Mixed Models , 2005 .

[14]  M. Martens Sensory and chemical quality criteria for white cabbage studied by multivariate data analysis , 1985 .

[15]  Tormod Næs,et al.  Handling individual differences between assessors in sensory profiling , 1990 .

[16]  Tormod Naes,et al.  A graphical technique for assessing differences among a set of rankings , 1994 .