How to use C-OAR-SE to design optimal standard measures

Purpose This paper aims to extend Rossiter’s C-OAR-SE method of measure design (IJRM, 2002, p. 19, p. 4, pp. 305-335; EJM, 2011, p. 45, p. 11, p. 12, pp. 1561-1588) by proposing five distinct construct models for designing optimally content-valid multiple-item and single-item measures. Design/methodology/approach The paper begins by dismissing convergent validation, the core procedure in Nunnally’s (1978) and Churchill’s (1979) psychometric method of measure design which allows alternative measures of the same construct. The method of dismissal is the mathematical demonstration that an alternative measure, no matter how highly its scores converge with those from the original measure, will inevitably produce different findings. The only solution to this knowledge-threatening problem is to agree on an optimal measure of each of our major constructs and to use only that measure in all future research, as is standard practice in the physical sciences. The paper concludes by proposing an extension of Rossiter’s C-OAR-SE method to design optimal standard measures of judgment constructs, the most prevalent type of construct in marketing. Findings The findings are, first, the mathematical dismissal of the accepted practice of convergent validation of alternative measures of the same construct, which paves the way for, second, the proposal of five new C-OAR-SE-based construct models for designing optimal standard measures of judgment constructs, three of which require a multiple-item measure and two of which a single-item measure. Practical implications The common practice of accepting alternative measures of the same construct causes major problems for the social sciences: when different measures are used, it becomes impossible, except by remote chance, to replicate findings; meta-analyses become meaningless because the findings are averaged over different measures; and empirical generalizations cannot be trusted when measures are changed. These problems mean that we cannot continue to accept alternative measures of the constructs and that, for each construct, an optimal standard measure must be found. Originality/value The ideas in this paper, which have untold value for the future of marketing as a legitimate science, are unique to Rossiter’s C-OAR-SE method of measure design.

[1]  J. Forgas Don’t Worry, Be Sad! On the Cognitive, Motivational, and Interpersonal Benefits of Negative Mood , 2013 .

[2]  John R. Rossiter,et al.  The Importance of Choosing One Good Item for Single-Item Measures of Attitude towards the Ad and Attitude towards the Brand and Its Generalization to All Measures , 2009 .

[3]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[4]  John R. Rossiter,et al.  Marketing measurement revolution: the C-OAR-SE method and why it must replace psychometrics , 2011 .

[5]  J. Rossiter Further Comment on “Market Orientation” , 2012 .

[6]  John R. Rossiter,et al.  ‘Pick Any’ Measures Contaminate Brand Image Studies , 2012 .

[7]  Ruth N. Bolton Pretesting Questionnaires: Content Analyses of Respondents' Concurrent Verbal Protocols , 1993 .

[8]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[9]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[10]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[11]  C. L. Hull,et al.  A Behavior System , 1954 .

[12]  John R. Rossiter,et al.  Measurement for the Social Sciences: The C-OAR-SE Method and Why It Must Replace Psychometrics , 2010 .

[13]  D. G. Morrison,et al.  Do We Really Need Multiple-Item Measures in Service Research? , 2001 .

[14]  Kevin D. Carlson,et al.  Understanding the Impact of Convergent Validity on Research Results , 2012 .

[15]  G. Hofstede,et al.  Culture′s Consequences: International Differences in Work-Related Values , 1980 .

[16]  Gilbert A. Churchill A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[17]  John R. Rossiter,et al.  Scientific progress in measurement theory? , 2013 .

[18]  B. Wansink,et al.  Asking Questions: The Definitive Guide to Questionnaire Design -- For Market Research, Political Polls, and Social and Health Questionnaires , 2004 .

[19]  J. Rossiter A new C-OAR-SE-based content-valid and predictively valid measure that distinguishes brand love from brand liking , 2012 .

[20]  John R. Rossiter,et al.  The C-OAR-SE procedure for scale development in marketing , 2002 .

[21]  Frederick G. Conrad,et al.  Sample Size for Cognitive Interview Pretesting , 2011 .

[22]  H. Triandis The analysis of subjective culture , 1973 .

[23]  G. Yule On the Theory of Correlation , 1897 .

[24]  John R. Rossiter,et al.  ER-SERVCOMPSQUAL: A Measure of E-Retailing Service Components Quality , 2009 .

[25]  Frederick G. Conrad,et al.  Sources of Error in Cognitive Interviews , 2009 .

[26]  John R. Rossiter,et al.  Emotional Branding Pays Off , 2012, Journal of Advertising Research.

[27]  J. Stanley,et al.  Restrictions on the Possible Values of r12, Given r13 and r23 , 1969 .

[28]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[29]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[30]  J. Rossiter,et al.  The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs , 2007 .

[31]  J. Rossiter,et al.  Store atmosphere: an environmental psychology approach , 1982 .