Further investigations into the reproducibility of check-all-that-apply (CATA) questions for sensory product characterization elicited by consumers

Abstract The purpose of the present research was further investigate the reproducibility of check-all-that-apply (CATA) questions for sensory product characterization. Evaluations obtained when such questions are used by consumers are rarely replicated and therefore reproducibility of the data may be at risk. Results from the present work, which included five studies, each with 100–200 consumers across a range of product categories, revealed that sensory product characterizations obtained using CATA questions with consumers are highly reproducible. Hence, the research confirms previous research by Jaeger, Chheang, et al. (2013) and extends it to the use of CATA terms in randomised presentation order as has been recommended to avoid satisficing response behavior. In the future, if CATA studies are conducted without replication and researches seek to examine the reliability of CATA data, the use of a posterior bootstrapping re-sampling approach is suggested.

[1]  S. Jaeger,et al.  Lack of evidence that concurrent sensory product characterisation using CATA questions bias hedonic scores , 2014 .

[2]  P. Robert,et al.  A Unifying Tool for Linear Multivariate Statistical Methods: The RV‐Coefficient , 1976 .

[3]  Dave Plaehn,et al.  CATA penalty/reward , 2012 .

[4]  Gastón Ares,et al.  Check-all-that-apply (CATA) responses elicited by consumers: Within-assessor reproducibility and stability of sensory product characterizations , 2013 .

[5]  Gastón Ares,et al.  Visual attention by consumers to check-all-that-apply questions: Insights to support methodological development , 2014 .

[6]  J. Kennedy,et al.  EVALUATION OF REPLICATED PROJECTIVE MAPPING OF GRANOLA BARS , 2010 .

[7]  Age K. Smilde,et al.  Real-life metabolomics data analysis : how to deal with complex data ? , 2010 .

[8]  Edward B. Manoukian,et al.  Mathematical nonparametric statistics , 1986 .

[9]  Tormod Næs,et al.  Performance indices in descriptive sensory analysis – A complimentary screening tool for assessor and panel performance , 2013 .

[10]  S. Jaeger,et al.  Check-all-that-apply questions: Influence of attribute order on sensory product characterization , 2013 .

[11]  Dominique Valentin,et al.  Aroma properties of young Spanish monovarietal white wines: a study using sorting task, list of terms and frequency of citation , 2008 .

[12]  Harry T. Lawless,et al.  CONSISTENCY OF MULTIDIMENSIONAL SCALING MODELS DERIVED FROM ODOR SORTING , 1990 .

[13]  Gastón Ares,et al.  Polarized Projective Mapping: Comparison with Polarized Sensory Positioning approaches , 2013 .

[14]  Gastón Ares,et al.  CONSUMERS' TEXTURE PERCEPTION OF MILK DESSERTS. II – COMPARISON WITH TRAINED ASSESSORS' DATA , 2012 .

[15]  R. Fisher,et al.  Statistical Methods for Research Workers. , 1955 .

[16]  Gastón Ares,et al.  Sensory profiling, the blurred line between sensory and consumer science. A review of novel methods for product characterization , 2012 .

[17]  W. Verbeke,et al.  Cross-cultural conceptualization of the words Traditional and Innovation in a food context by means of sorting task and hedonic evaluation , 2012 .

[18]  Hervé Abdi,et al.  An ExPosition of multivariate analysis with the singular value decomposition in R , 2014, Comput. Stat. Data Anal..

[19]  S. Jaeger,et al.  Investigation of bias of hedonic scores when co-eliciting product attribute information using CATA questions , 2013 .

[20]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[21]  Gastón Ares,et al.  Comparison of check-all-that-apply and forced-choice Yes/No question formats for sensory characterisation , 2014 .

[22]  Chong Ho Yu,et al.  Test–Retest Reliability , 2022, The SAGE Encyclopedia of Research Design.

[23]  Gastón Ares,et al.  APPLICATION OF A CHECK‐ALL‐THAT‐APPLY QUESTION TO THE DEVELOPMENT OF CHOCOLATE MILK DESSERTS , 2010 .

[24]  John C. Castura,et al.  Check-All-That-Apply Questions , 2014 .

[25]  Jérôme Pagès,et al.  Testing the significance of the RV coefficient , 2008, Comput. Stat. Data Anal..

[26]  Young-Seung Lee,et al.  The application of check-all-that-apply (CATA) consumer profiling to preference mapping of vanilla ice cream and its comparison to classical external preference mapping , 2010 .

[27]  Gastón Ares,et al.  Novel Techniques in Sensory Characterization and Consumer Profiling , 2014 .

[28]  Gastón Ares,et al.  Are consumer profiling techniques equivalent for some product categories? The case of orange-flavoured powdered drinks , 2011 .

[29]  John C. Castura,et al.  Existing and new approaches for the analysis of CATA data , 2013 .

[30]  Sylvie Chollet,et al.  Invited review Quick and dirty but still pretty good: a review of new descriptive methods in food science , 2012 .

[31]  Gastón Ares,et al.  Assessment of global and individual reproducibility of projective mapping with consumers , 2014 .

[32]  Jason Parcon,et al.  A method to investigate the stability of a sorting map , 2012 .

[33]  Gastón Ares,et al.  EXTERNAL PREFERENCE MAPPING OF COMMERCIAL ANTIAGING CREAMS BASED ON CONSUMERS' RESPONSES TO A CHECK‐ALL‐THAT‐APPLY QUESTION , 2011 .

[34]  S. Jaeger,et al.  CATA questions for sensory product characterization: Raising awareness of biases , 2013 .

[35]  Michelle K. Beresford,et al.  A Mendelian Trait for Olfactory Sensitivity Affects Odor Experience and Food Selection , 2013, Current Biology.

[36]  C. J. Findlay,et al.  Experimental consideration for the use of check‐all‐that‐apply questions to describe the sensory properties of orange juices , 2013 .

[37]  A. Plotto,et al.  Specific Anosmia Observed for β-Ionone, but not for α-Ionone: Significance for Flavor Research , 2006 .

[38]  Sébastien Lê,et al.  FactoMineR: An R Package for Multivariate Analysis , 2008 .

[39]  Gastón Ares,et al.  Investigation of the number of consumers necessary to obtain stable sample and descriptor configurations from check-all-that-apply (CATA) questions , 2014 .