Comparison of check-all-that-apply and forced-choice Yes/No question formats for sensory characterisation

The application of check-all-that-apply (CATA) questions for sensory product characterisation is gaining acceptance and popularity. This question format has been reported to be a quick and reliable means of gathering sensory profiles from consumers, concurrently with hedonic assessment. However, a limitation of CATA questions is that they do not encourage deep processing by respondents. Forced-choice questions, where respondents answer “yes” or “no” for each term, may encourage systematic processing and be useful when consumers undertake sensory profiling tasks. This research compared sensory profiles elicited by consumers using CATA questions or forced-choice Yes/No questions and contribute to ongoing investigations of CATA questions and related question formats with a view to developing guidelines for best practise. Across seven consumer studies with 600+ consumers and multiple product categories, consistent evidence was obtained that forced-choice Yes/No questions are associated with higher term citation frequencies. However, this did not consistently translate into greater product discrimination. Conclusions regarding similarities and differences amongst samples and the stability of sample and term configurations were generally independent of question format (i.e., whether the sensory data were elicited by CATA or forced-choice Yes/No questions). Overall, the comparison of CATA and forced-choice Yes/No questions for sensory characterisation suggested parity of the two question formats. This extended to consumers’ perceived difficulty and tediousness for completing the test. Regardless of question format, consumers, on average, perceived the tests as easy and not tedious.

[1]  Jason Parcon,et al.  A method to investigate the stability of a sorting map , 2012 .

[2]  S. Jaeger,et al.  Check-all-that-apply questions: Influence of attribute order on sensory product characterization , 2013 .

[3]  Conor M. Delahunty,et al.  Descriptive sensory analysis: past, present and future , 2001 .

[4]  Gastón Ares,et al.  Investigation of the number of consumers necessary to obtain stable sample and descriptor configurations from check-all-that-apply (CATA) questions , 2014 .

[5]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[6]  Daniel M. Ennis,et al.  Analysis and Thurstonian Scaling of Applicability Scores , 2013 .

[7]  Sébastien Lê,et al.  FactoMineR: An R Package for Multivariate Analysis , 2008 .

[8]  Gastón Ares,et al.  APPLICATION OF A CHECK‐ALL‐THAT‐APPLY QUESTION TO THE DEVELOPMENT OF CHOCOLATE MILK DESSERTS , 2010 .

[9]  Young-Seung Lee,et al.  The application of check-all-that-apply (CATA) consumer profiling to preference mapping of vanilla ice cream and its comparison to classical external preference mapping , 2010 .

[10]  Gastón Ares,et al.  Check-all-that-apply (CATA) responses elicited by consumers: Within-assessor reproducibility and stability of sensory product characterizations , 2013 .

[11]  R. Fisher,et al.  Statistical Methods for Research Workers. , 1955 .

[12]  Gastón Ares,et al.  CONSUMERS' TEXTURE PERCEPTION OF MILK DESSERTS. II – COMPARISON WITH TRAINED ASSESSORS' DATA , 2012 .

[13]  Edward B. Manoukian,et al.  Mathematical nonparametric statistics , 1986 .

[14]  Zata M Vickers,et al.  7th Pangborn Sensory Science Symposium , 2008 .

[15]  John C. Castura,et al.  Existing and new approaches for the analysis of CATA data , 2013 .

[16]  Sylvie Chollet,et al.  Invited review Quick and dirty but still pretty good: a review of new descriptive methods in food science , 2012 .

[17]  Gastón Ares,et al.  Sensory profiling, the blurred line between sensory and consumer science. A review of novel methods for product characterization , 2012 .

[18]  S. Jaeger,et al.  CATA questions for sensory product characterization: Raising awareness of biases , 2013 .

[19]  Gastón Ares,et al.  Visual attention by consumers to check-all-that-apply questions: Insights to support methodological development , 2014 .

[20]  Jenni Romaniuk,et al.  Comparing Methods of Brand Image Measurement , 2006 .

[21]  P. Robert,et al.  A Unifying Tool for Linear Multivariate Statistical Methods: The RV‐Coefficient , 1976 .

[22]  Norman M. Bradburn,et al.  DO RESPONDENTS REALLY “MARK ALL THAT APPLY” ON SELF-ADMINISTERED QUESTIONS? , 1994 .

[23]  S. Jaeger,et al.  Lack of evidence that concurrent sensory product characterisation using CATA questions bias hedonic scores , 2014 .

[24]  S. Jaeger,et al.  Investigation of bias of hedonic scores when co-eliciting product attribute information using CATA questions , 2013 .

[25]  Jérôme Pagès,et al.  Testing the significance of the RV coefficient , 2008, Comput. Stat. Data Anal..

[26]  Harry T. Lawless,et al.  Sensory Evaluation of Food: Principles and Practices , 1998 .

[27]  C. J. Findlay,et al.  Experimental consideration for the use of check‐all‐that‐apply questions to describe the sensory properties of orange juices , 2013 .

[28]  Jolene D. Smyth,et al.  Comparing Check-All and Forced-Choice Question Formats in Web Surveys , 2006 .