What is the validity of the sorting task for describing beers? A study using trained and untrained assessors

In the sensory evaluation literature, it has been suggested that sorting tasks followed by a description of the groups of products can be used by consumers to describe products, but a closer look at this literature suggests that this claim needs to be evaluated. In this paper, we proposed to examine the validity of the sorting task to describe products by trained and untrained assessors. The experiment reported here consisted in two parts. In a first part, participants sorted nine commercial beers and then described each group with their own words or with a list of terms. In a second part, participants were asked to match each beer with one of their own sets of descriptors. The matching task was used to evaluate the validity of the sorting task to describe products. Results showed that (1) the categories of trained and untrained assessors were comparable, (2) trained and untrained assessors did not describe groups of beers similarly, (3) for both groups, the results of matching task were not very good and presented a high inter-variability, and (4) providing a list of terms did not seem to help the assessors. Overall, the results suggest that the sorting task followed by a description does not seem to be adapted for a precise and reliable description of complex products such as beers but may be an interesting tool to probe assessors’ perception.

[1]  H. Lawless.  Flavor Description of White Wine by “Expert” and Nonexpert Wine Consumers , 1984 .

[2]  H. Lawless.  Exploration of fragrance categories and ambiguous odors using multidimensional scaling and cluster analysis , 1989 .

[3]  L. O’Neill,et al.  A matching task as a potential technique for descriptive profile validation , 2003 .

[4]  A. Lehrer.  Talking About Wine. , 1975 .

[5]  Anne Saint-Eve,et al.  Impact of the olfactory quality and chemical complexity of the flavouring agent on the texture of low fat stirred yogurts assessed by three different sensory methodologies , 2004 .

[6]  Dominique Valentin,et al.  Analyzing assessors and products in sorting tasks: DISTATIS, theory and applications , 2007 .

[7]  L. Guerrero,et al.  DESCRIPTIVE ANALYSIS OF TOASTED ALMONDS: A COMPARISON BETWEEN EXPERT AND SEMI‐TRAINED ASSESSORS , 1997 .

[8]  Dominique Valentin,et al.  IMPACT OF TRAINING ON BEER FLAVOR PERCEPTION AND DESCRIPTION: ARE TRAINED AND UNTRAINED SUBJECTS REALLY DIFFERENT? , 2001 .

[9]  Pauline Faye,et al.  Perceptive free sorting and verbalization tasks with naive subjects: an alternative to descriptive mappings , 2004 .

[10]  Dominique Valentin,et al.  Do trained assessors generalize their knowledge to new stimuli , 2005 .

[11]  Hildegarde Heymann,et al.  MULTIDIMENSIONAL SORTING, SIMILARITY SCALING AND FREE‐CHOICE PROFILING OF GRAPE JELLIES , 2002 .

[12]  M. O'Mahony,et al.  Group taste concept measurement: verbal and physical definition of the umami taste concept for Japanese and Americans , 1990 .

[13]  J. Delarue,et al.  Sensory mapping using Flash profile. Comparison with a conventional descriptive method for the evaluation of the flavour of fruit dairy products , 2004 .

[14]  G. Blancher,et al.  French and Vietnamese: How do they describe texture characteristics of the same food? A case study with jellies , 2007 .

[15]  A Dravnieks,et al.  Odor quality: semantically generated multidimensional profiles are stable. , 1982, Science.

[16]  Barbara A. Rainey.  IMPORTANCE OF REFERENCE STANDARDS IN TRAINING PANELISTS , 1986 .

[17]  C. E. Dalgliesh,et al.  Beer Flavor Terminology1 , 1979 .

[18]  H. Abdi.  The RV coefficient and the congruence coefficient , 2007 .

[19]  Howard R. Moskowitz.  Applied Sensory Analysis of Foods , 1988 .

[20]  Harry T. Lawless,et al.  Multidimensional scaling of sorting data applied to cheese perception , 1995 .

[21]  Harry T. Lawless,et al.  CONSISTENCY OF MULTIDIMENSIONAL SCALING MODELS DERIVED FROM ODOR SORTING , 1990 .

[22]  J. Corter.  Tree Models of Similarity and Association , 1983 .

[23]  Hervé Abdi,et al.  Additive-Tree Representations , 1990 .

[24]  Harry T. Lawless,et al.  THE IMPORTANCE OF LANGUAGE IN DESCRIBING PERCEPTIONS , 1986 .

[25]  Damien Brémaud,et al.  An alternative to external preference mapping based on consumer perceptive mapping , 2006 .

[26]  Juyun Lim,et al.  Qualitative differences of divalent salts: multidimensional scaling and cluster analysis. , 2005, Chemical senses.

[27]  Anthony Peter Macmillan Coxon,et al.  Sorting Data: Collection and Analysis , 1999 .

[28]  C. R. Stampanoni,et al.  The Use of Standardized Flavor Languages and Quantitative Flavor Profiling Technique for Flavored Dairy Products , 1994 .

[29]  Neil Salkind.  Encyclopedia of Measurement and Statistics , 2006 .

[30]  G. Miller,et al.  The verb as the main determinant of sentence meaning , 1970 .

[31]  Victoire Dairou,et al.  A Comparison of 14 Jams Characterized by Conventional Profile and a Quick Original Method, the Flash Profile , 2002 .

[32]  J. Piggott,et al.  FLAVOUR CHARACTERIZATION BY TRAINED AND UNTRAINED ASSESSORS , 1979 .

[33]  Neil Gains,et al.  Sensory profiling of canned lager beers using consumers in their own homes , 1990 .

[34]  R. Gawel,et al.  The use of language by trained and untrained experienced wine tasters , 1997 .

[35]  H. Abdi,et al.  Semantic, typicality and odor representation: a cross-cultural study. , 2005, Chemical senses.

[36]  P. Howgate,et al.  Patterns of odour similarity among carbonyls and their mixtures , 1992 .

[37]  R. Boakes,et al.  The knowing nose: the role of knowledge in wine expertise , 2002 .

[38]  Andreas Rytz,et al.  Sorting procedure as an alternative to quantitative descriptive analysis to obtain a product sensory map , 2006 .

[39]  Ivanne Soufflet,et al.  A comparison between industrial experts' and novices' haptic perceptual organization: a tool to identify descriptors of the handle of fabrics , 2004 .

[40]  D. A. Stevens,et al.  Semantic-free scaling of odor quality , 1996, Physiology & Behavior.

[41]  Alice J. O'Toole,et al.  DISTATIS: The Analysis of Multiple Distance Matrices , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[42]  Une approche pour valider la technique du profil sensoriel : la technique de l'appariement , 2000 .

[43]  G. Solomon.  Psychology of novice and expert wine talk , 1990 .

[44]  Sophie Nicklaus,et al.  Selection of Products Presenting Given Flavor Characteristics: An Application to Wine , 2004, American Journal of Enology and Viticulture.