Marketing measurement revolution: the C-OAR-SE method and why it must replace psychometrics

Purpose – New measures in marketing are invariably created by using a psychometric approach based on Churchill's “scale development” procedure. This paper aims to compare and contrast Churchill's procedure with Rossiter's content‐validity approach to measurement, called C‐OAR‐SE.Design/methodology approach – The comparison of the two procedures is by rational argument and forms the theoretical first half of the paper. In the applied second half of the paper, three recent articles from the Journal of Marketing (JM) that introduce new constructs and measures are criticized and corrected from the C‐OAR‐SE perspective.Findings – The C‐OAR‐SE method differs from Churchill's method by arguing for: total emphasis on achieving high content validity of the item(s) and answer scale – without which nothing else matters; use of single‐item measures for “basic” constructs and for the first‐order components of “abstract” constructs; abandonment of the “reflective” measurement model, along with its associated statistica...

[1]  J. Armstrong,et al.  Derivation of Theory by Means of Factor Analysis or Tom Swift and His Electric Factor Analysis Machine , 2015 .

[2]  J. Farley,et al.  Corporate Culture, Customer Orientation, and Innovativeness in Japanese Firms: A Quadrad Analysis , 1993 .

[3]  Jan Wieseke,et al.  Implementing the Marketing Concept at the Employee–Customer Interface: The Role of Customer Need Knowledge , 2009 .

[4]  Wendy Wood,et al.  Habit and intention in everyday life: The multiple processes by which past behavior predicts future behavior. , 1998 .

[5]  C. Spearman.  General intelligence Objectively Determined and Measured , 1904 .

[6]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[7]  John C. Narver,et al.  The Effect of a Market Orientation on Business Profitability , 1990 .

[8]  M. Gelfand,et al.  Cross-cultural organizational behavior. , 2007, Annual review of psychology.

[9]  Larry Percy,et al.  Advertising and Promotion Management , 1987 .

[10]  John R. Rossiter,et al.  Measurement for the Social Sciences: The C-OAR-SE Method and Why It Must Replace Psychometrics , 2010 .

[11]  Dominique M. Hanssens,et al.  Creating lift versus building the base: current trends in marketing dynamics , 2009 .

[12]  R. Deshpandé,et al.  Organizational Culture and Marketing: Defining the Research Agenda , 1989 .

[13]  R. Bagozzi.  Principles of marketing research , 1994 .

[14]  Glen L. Urban.  Advanced Marketing Strategy , 2009 .

[15]  John R. Rossiter,et al.  Reminder: A horse is a horse , 2005 .

[16]  John R. Rossiter,et al.  ER-SERVCOMPSQUAL: A Measure of E-Retailing Service Components Quality , 2009 .

[17]  F. Mosteller,et al.  Quantifying Probabilistic Expressions , 1990 .

[18]  John R. Rossiter,et al.  The C-OAR-SE procedure for scale development in marketing , 2002 .

[19]  D. N. Sparks,et al.  Data Reduction: Analysing and Interpreting Statistical Data , 1976 .

[20]  L. Cronbach.  Essentials of psychological testing , 1960 .

[21]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[22]  J. Rossiter,et al.  The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs , 2007 .

[23]  G. Albaum,et al.  A Meta-Analysis of Effect Sizes in Consumer Behavior Experiments , 1985 .

[24]  W. Bearden,et al.  The use of expert judges in scale development: Implications for improving face validity of measures of unobservable constructs , 2004 .

[25]  Richard G. Netemeyer,et al.  Handbook of Marketing Scales: Multi-Item Measures for Marketing and Consumer Behavior Research , 1993 .

[26]  J. Rossiter.  What Is Marketing Knowledge? , 2001 .

[27]  Richard G. Netemeyer,et al.  Handbook of Marketing Scales , 1999 .

[28]  Gilbert A. Churchill.  A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[29]  John R. Rossiter,et al.  Toward a Valid Measure of E-Retailing Service Quality , 2007, J. Theor. Appl. Electron. Commer. Res..

[30]  J. Rossiter,et al.  Marketing Communications: theory and applications , 2005 .

[31]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[32]  Frank S. Freeman,et al.  Interpretation of educational measurements , 1928 .

[33]  A. Sockloff,et al.  Statistical power analysis for the behavioral sciences: (revised edition), by Jacob Cohen. New York: Academic Press, 1977, xv + 474 pp., $24.50. , 1978 .

[34]  A. Parasuraman,et al.  Alternative scales for measuring service quality: A comparative assessment based on psychometric and diagnostic criteria , 1994 .

[35]  J. Rossiter,et al.  Advertising communications & promotion management , 1997 .

[36]  Peer Soelberg,et al.  On the Interpretation of Factor Analysis , 1968 .

[37]  Bernd H. Schmitt,et al.  Brand Experience: What is It? How is it Measured? Does it Affect Loyalty? , 2009 .

[38]  J. Rossiter.  The Five Forms of Transmissible, Usable marketing Knowledge , 2002 .

[39]  S. J. Kraus,et al.  Attitudes and the Prediction of Behavior: A Meta-Analysis of the Empirical Literature , 1990 .

[40]  Jane F. Gentleman.  Data Reduction. Analysing and Interpreting Statistical Data , 1977 .

[41]  Seymour Sudman,et al.  Maximum versus Meaningful Discrimination in Scale Response: Implications for Validity of Measurement of Consumer Perceptions about Products , 2004 .

[42]  C. Osgood,et al.  The Measurement of Meaning , 1958 .

[43]  R. Sitgreaves.  Psychometric theory (2nd ed.). , 1979 .

[44]  Judy A. Siguaw,et al.  Formative versus Reflective Indicators in Organizational Measure Development: A Comparison and Empirical Illustration , 2006 .

[45]  Rajesh Chandy,et al.  Radical Innovation across Nations: The Preeminence of Corporate Culture , 2009 .

[46]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[47]  John R. Rossiter,et al.  Qualitative marketing research: Theory and practice , 2009 .

[48]  A. Mitchell,et al.  Radical Innovation , 2001 .

[49]  John R. Rossiter,et al.  The Importance of Choosing One Good Item for Single-Item Measures of Attitude towards the Ad and Attitude towards the Brand and Its Generalization to All Measures , 2009 .

[50]  W Revelle,et al.  Hierarchical Cluster Analysis And The Internal Structure Of Tests. , 1979, Multivariate behavioral research.

[51]  A. Sias.  Interpretation of educational measurements. , 1928 .

[52]  John R. Rossiter,et al.  Content Validity of Measures of Abstract Constructs in Management and Organizational Research , 2008 .

[53]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .