Characteristics of Single-Item Measures in Likert Scale Format

1. IntroductionThe dominant paradigm of multiple-item scale development in marketing, as advanced by Churchill Jr. (1979), has been challenged by several authors (Drolet and Morrison 2001; Rossiter 2002; Bergkvist and Rossiter 2007). The main argument is that multiple-item measures are not always necessary and can be substituted by single-item measures in many cases. The C-OAR-SE procedure suggested by Rossiter (2002) has become the focal point of the recent debate. C-OAR-SE is a comprehensive methodology for the development of multiple- and single-item measures claiming to surmount some of the current pitfalls in scale development in marketing. The focus in C-OAR-SE is content validity. Rossiter (2005; 2008) claims that this is the only validity needed in scale development, and the typical item purification through statistical procedures is unnecessary because it can change the meaning of the measured concepts. Therefore, according to Rossiter (2005; 2008), if a scale has a precise definition, there is no need to examine other types of validities. An important practical assertion advanced by C-OAR-SE is that most concepts (e.g., purchase intentions) are concrete and understood unequivocally by raters and there is no need to use multiple-item scales to measure them; a single-item measure is sufficient.Although the C-OAR-SE procedure is a solid argument in defense of single-item measures, it opens the door for a possible misconception. Specifically, Rossiter (2002; 2008) argues that the only appropriate scale for single-item measures is the semantic-differential scale. The Likert scale was called problematic and its use was discouraged because of the lack of a neutral point. According to Rossiter (2008, p.383), the Likert scale "produces hopelessly fuzzy scores." The danger with this assertion is that it annihilates a whole category of scales from the marketing research. It seems that the new attempt to relax scale development was restricted again. Furthermore, Rossiter does not provide comprehensive empirical or theoretical justification for his recommendation, except the lack of "psychological zero" and conceptual meaning.Addressing some of the raised concerns, the purpose of this study is to clarify the use of single-item measures in Likert scale format. The Likert scale is one of the most popular scales in marketing and its status is unlikely to change. Therefore, as more researchers may decide to use it as a single-item measure, it becomes necessary to examine the characteristics of the Likert scale more closely. The intention of this study is not to avow the superiority of the Likert scale to any other scales, but to describe its behavior and provide practical recommendations. The research question this study answers is: Are single-item measures in Likert format usable?2. Review of positive-negative asymmetryNunnally (1978) suggested that positively-worded items in Likert scales can be transformed into negatively-worded items and their scores can be reversed symmetrically afterwards. This practice continues even today, although it has been known that negatively-worded items introduce problems in multiple-item scales. Negatively-worded items often form a separate factor, independent of the main factor, and change the dimensionality of the construct (Herche and Engelland 1996; Mook et al. 1991; Tomas and Oliver 1999). Factors based on negatively-worded items have strong method effects and exhibit longitudinal invariance (Motl and DiStefano 2002; Horan et al. 2003). Negatively-worded items tend to lower the reliability of multi-item scales as measured by Cronbach's alpha by as much as 20% (Schriesheim et al. 1991; Barnette 2000), and confound measures in cross-cultural research, hampering measurement invariance (Wong et al. 2003). All of the above contribute to the positive-negative asymmetry, which is reviewed in the following section.Positivity and negativity are not symmetrical: negative information weights more than positive information (Anderson 1965; Rodin 1978), and positive and negative affective states have low correlation (Diener and Emmons 1984; Watson et al. …

[1]  I. Richards The Philosophy of Rhetoric , 1936 .

[2]  R. Merton The unanticipated consequences of purposive social action , 1936 .

[3]  T. Pollock,et al.  A Grammar of Motives. , 1945 .

[4]  A. L. Edwards A critique of 'neutral' items in attitude scales constructed by the method of equal appearing intervals. , 1946 .

[5]  J. Becker,et al.  The Aim and Structure of Physical Theory , 1955 .

[6]  Norman Robert Campbell,et al.  Foundations of science : the philosophy of theory and experiment , 1957 .

[7]  H. Gadamer,et al.  Truth and Method , 1960 .

[8]  T. Kuhn,et al.  The Structure of Scientific Revolutions. , 1964 .

[9]  W. Quine From a Logical Point of View: 9 Logico-Philosophical Essays , 1963 .

[10]  N. Anderson Averaging versus adding as a stimulus-combination rule in impression formation. , 1965, Journal of experimental psychology.

[11]  P. Berger,et al.  Social Construction of Reality , 1991, The SAGE International Encyclopedia of Mass Media and Society.

[12]  D. Aderman Effects of anticipating future interaction on the preference for balanced states. , 1969 .

[13]  Ludwig von Bertalanffy,et al.  General system theory, New York (George Braziller) 1969. , 1969 .

[14]  Ch. Perelman,et al.  The New Rhetoric: A Treatise on Argumentation , 1971 .

[15]  G. Peeters,et al.  The positive-negative asymmetry: On cognitive consistency and positivity bias , 1971 .

[16]  Roman Jakobson,et al.  Two Aspects of Language and Two Types of Aphasic Disturbances , 1971 .

[17]  H. White,et al.  Metahistory: The Historical Imagination in Nineteenth-Century Europe , 1975 .

[18]  Derrida,et al.  White Mythology: Metaphor in the Text of Philosophy , 1974 .

[19]  Structural analysis and Biblical exegesis : interpretational essays , 1974 .

[20]  Modern dogma and the rhetoric of assent , 1974 .

[21]  A. Ortony Why Metaphors Are Necessary and Not Just Nice , 1975 .

[22]  R. Brown Social theory as metaphor On the logic of discovery for the sciences of conduct , 1976 .

[23]  Richard Harvey Brown A Poetic for Sociology: Toward a Logic of Discovery for the Human Sciences , 1976 .

[24]  M. Hannan,et al.  The Population Ecology of Organizations , 1977, American Journal of Sociology.

[25]  A. Giddens,et al.  New Rules of Sociological Method: A Positive Critique of Interpretative Sociologies. , 1977 .

[26]  David Lodge,et al.  The Modes of Modern Writing: Metaphor, Metonymy, and the Typology of Modern Literature , 1978 .

[27]  M. Rodin Liking and Disliking: Sketch of an Alternative View , 1978 .

[28]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[29]  H. White Tropics of discourse : essays in cultural criticism , 1979 .

[30]  R. Sitgreaves Psychometric theory (2nd ed.). , 1979 .

[31]  Peter K. Manning,et al.  Metaphors of the Field: Varieties of Organizational Discourse. , 1979 .

[32]  Gilbert A. Churchill A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[33]  G. Lakoff,et al.  Metaphors We Live By , 1980 .

[34]  I. Ajzen,et al.  Understanding Attitudes and Predicting Social Behavior , 1980 .

[35]  A Reply To Morgan , 1980 .

[36]  E. Berscheid The Pollyanna Principle: Selectivity in Language, Memory, and Thought , 1981 .

[37]  J. Diffenbach Influence diagrams for complex strategic issues , 1982 .

[38]  C. Pinder,et al.  Controlling Tropes in Administrative Science. , 1982 .

[39]  K. Silverman,et al.  The subject of semiotics , 1983 .

[40]  Karl Raimund Sir Popper,et al.  Realism and the aim of science , 1983 .

[41]  G. Morgan More on Metaphor: Why We Cannot Control Tropes in Administrative Science. , 1983 .

[42]  C. Pinder,et al.  Contrasting Philosophical Perspectives in Administrative Science: A Reply to Morgan. , 1983 .

[43]  R. Burgess In the Field: An Introduction to Field Research , 1984 .

[44]  E. Diener,et al.  The independence of positive and negative affect. , 1984, Journal of personality and social psychology.

[45]  J. Benjafield A Review of Recent Research on the Golden Section , 1985 .

[46]  E. Sapir,et al.  Selected Writings in Language, Culture, and Personality , 1985 .

[47]  P. Ricoeur,et al.  Time and Narrative , 1989 .

[48]  Janusz Czapiński Informativeness of evaluations in interpersonal communication: Effects of valence, extremity of evaluations, and ego-involvement of evaluator. , 1986 .

[49]  Everett M. Rogers,et al.  Communication Technology: The New Media in Society , 1986 .

[50]  Richard Harvey Brown Society as Text: Essays on Rhetoric, Reason, and Reality , 1987 .

[51]  David E. Kanouse,et al.  Negativity in evaluations. , 1987 .

[52]  The Death of Dead Metaphor , 1987 .

[53]  Judith .QBell Judith Bell,et al.  Doing Your Research Project: A Guide for First-time Researchers , 1993 .

[54]  William Samuelson,et al.  Status quo bias in decision making , 1988 .

[55]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[56]  Norbert Schwarz,et al.  What triggers causal attributions? The impact of valence and subjective probability. , 1988 .

[57]  Edward Toomer,et al.  Qualitative Methods in Management Research , 1989 .

[58]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[59]  G. Peeters,et al.  Positive-Negative Asymmetry in Evaluations: The Distinction Between Affective and Informational Negativity Effects , 1990 .

[60]  Carl A. Gunter,et al.  Semantic Domains , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[61]  G. Lakoff The Invariance Hypothesis: is abstract reason based on image-schemas? , 1990 .

[62]  Sharan B. Merriam,et al.  Case Study Research in Education : A Qualitative Approach , 1991 .

[63]  C. Guarneri Cornell University Press , 1991 .

[64]  H. M. van der Ploeg,et al.  Symptom-Positively and -Negatively Worded Items in Two Popular Self-Report Inventories of Anxiety and Depression , 1991, Psychological reports.

[65]  Chester A. Schriesheim,et al.  The Effect of Negation and Polar Opposite Item Reversals on Questionnaire Reliability and Validity: An Experimental Investigation , 1991 .

[66]  A. Tversky,et al.  Loss Aversion in Riskless Choice: A Reference-Dependent Model , 1991 .

[67]  Daniel Kahneman,et al.  Anomalies: The Endowment Effect, Loss Aversion, and Status Quo Bias , 1991 .

[68]  H. Tsoukas The Missing Link: A Transformational View of Metaphors in Organizational Science , 1991 .

[69]  M. Easterby-Smith,et al.  Management Research: An Introduction , 1991 .

[70]  George P. Richardson,et al.  Model-building for group decision support: Issues and alternatives in knowledge elicitation , 1992 .

[71]  A. N. Oppenheim,et al.  Questionnaire Design, Interviewing and Attitude Measurement , 1992 .

[72]  Jac A. M. Vennix,et al.  Knowledge elicitation in conceptual model building: A case study in modeling a regional Dutch health care system , 1992 .

[73]  A. Tversky,et al.  Choice in Context: Tradeoff Contrast and Extremeness Aversion , 1992 .

[74]  M. Patton,et al.  Qualitative evaluation and research methods , 1992 .

[75]  A. Rainone Feyerabend Paul K. , 1992 .

[76]  Robert K. Kazanjian,et al.  Applying the Del Technique to the Analysis of Cross-Classification Data: A Test of Ceo Succession and Top Management Team Development , 1993 .

[77]  Donald A. Schön Metaphor and Thought: Generative metaphor: A perspective on problem-setting in social policy , 1993 .

[78]  P. Bobko,et al.  Toward Innovation and Diversity in Management Research Methods , 1993 .

[79]  A. Rainone,et al.  Kuhn Thomas S. , 1993 .

[80]  Haridimos Tsoukas,et al.  Analogical Reasoning and Knowledge Generation in Organization Theory , 1993 .

[81]  Eric F. Wolstenholme,et al.  A Hypermedia-based Delphi Tool for Knowledge Acquisition in Model Building , 1994 .

[82]  J. Cacioppo,et al.  Relationship between attitudes and evaluative space: A critical review, with emphasis on the separability of positive and negative substrates. , 1994 .

[83]  George P. Richardson,et al.  Teamwork in group model building , 1995 .

[84]  Joel Herche,et al.  Reversed-polarity items and scale unidimensionality , 1996 .

[85]  Kevin Quinn A Rhetorical Conception of Practical Rationality , 1996 .

[86]  Theresa Enos,et al.  Encyclopedia of rhetoric and composition : communication from ancient times to the information age , 1996 .

[87]  C. Oswick,et al.  Metaphor and organizations , 1996 .

[88]  Theo van Leeuwen,et al.  Reading Images: The Grammar of Visual Design , 1996 .

[89]  Jac A. M. Vennix,et al.  Group model‐building to facilitate organizational change: an exploratory study , 1996 .

[90]  George P. Richardson,et al.  Scripts for group model building , 1997 .

[91]  George P. Richardson,et al.  Foreword: Group model building, art, and science , 1997 .

[92]  J. Laurila Promoting research access and informant rapport in corporate settings: Notes from research on a crisis company , 1997 .

[93]  B. Richmond The Strategic Forum: aligning objectives, strategy and process , 1997 .

[94]  George P. Richardson,et al.  Group model building: adding more science to the craft , 1997 .

[95]  J. Adams-Webber Positive-negative asymmetry in the evaluation of familiar versus unfamiliar persons and objects , 1997 .

[96]  Simon Peck,et al.  Group Model Building: Facilitating Team Learning Using System Dynamics , 1996, J. Oper. Res. Soc..

[97]  J. O'Neill Rhetoric, Science, and Philosophy , 1998 .

[98]  Michael D. Myers,et al.  Interpretive research in information systems , 1998 .

[99]  D. Rennie Grounded Theory Methodology , 1998 .

[100]  David N. Ford,et al.  Expert knowledge elicitation to improve formal and mental models , 1998 .

[101]  José M. Tomás,et al.  Rosenberg's Self-Esteem Scale: Two Factors or Method Effects. , 1999 .

[102]  Jac A. M. Vennix,et al.  Group model-building: tackling messy problems , 1999 .

[103]  P. Davies,et al.  Drivers of quality in health services: different worldviews of clinicians and policy managers revealed , 1999 .

[104]  J. Cacioppo,et al.  The affect system has parallel and integrative processing components: Form follows function. , 1999 .

[105]  Jac A. M. Vennix,et al.  Group Model Building: A Decision Room Approach , 2000 .

[106]  John D. Sterman,et al.  System Dynamics: Systems Thinking and Modeling for a Complex World , 2002 .

[107]  M. Alvesson,et al.  Taking the Linguistic Turn in Organizational Research , 2000 .

[108]  J. Jackson Barnette,et al.  Effects of Stem and Likert Response Option Reversals on Survey Internal Consistency: If You Feel the Need, There is a Better Alternative to Using those Negatively Worded Stems , 2000 .

[109]  S. Green Rhetoric and the institutionalization of takeover defenses in the S&P 1500 from 1975-1998 , 2001 .

[110]  Edward B. Royzman,et al.  Negativity Bias, Negativity Dominance, and Contagion , 2001 .

[111]  D. G. Morrison,et al.  Do We Really Need Multiple-Item Measures in Service Research? , 2001 .

[112]  Daniel Chandler,et al.  Semiotics: The Basics , 2001 .

[113]  R. Motl,et al.  Longitudinal Invariance of Self-Esteem and Method Effects Associated With Negatively Worded Items , 2002 .

[114]  J. Lowe Cherokee Self-Reliance , 2002, Journal of transcultural nursing : official journal of the Transcultural Nursing Society.

[115]  Peter Milling,et al.  Understanding and managing innovation processes , 2002 .

[116]  N. Repenning,et al.  Disaster Dynamics: Understanding the Role of Quantity in Organizational Collapse , 2002 .

[117]  K. Stave Using system dynamics to improve public participation in environmental decisions , 2002 .

[118]  Jac A. M. Vennix,et al.  Group model building effectiveness: a review of assessment studies † , 2002 .

[119]  John R. Rossiter,et al.  The C-OAR-SE procedure for scale development in marketing , 2002 .

[120]  R. O'Neill,et al.  Complex systems and valuation , 2002 .

[121]  Luis F. Luna-Reyes,et al.  Collecting and analyzing qualitative data for system dynamics: methods and models , 2003 .

[122]  Christine DiStefano,et al.  Wording Effects in Self-Esteem Scales: Methodological Artifact or Response Style? , 2003 .

[123]  James E. Burroughs,et al.  Do Reverse-Worded Items Confound Measures in Cross-Cultural Consumer Research? The Case of the Material Values Scale , 2003 .

[124]  Iqbal Adjali,et al.  Complex Systems Models for Strategic Decision Making , 2003 .

[125]  U. Danner,et al.  Positive-Negative Asymmetry in the Evaluation of Trivial Stimuli , 2003, The Journal of social psychology.

[126]  S. E. Green,et al.  A Rhetorical Theory of Diffusion , 2004 .

[127]  Jac A. M. Vennix,et al.  Exploring influencing factors on rationality: A literature review of dynamic decision making studies in system dynamics , 2004 .

[128]  P. Herr,et al.  Asymmetric Association of Liking and Disliking Judgments: So What’s Not to Like? , 2004 .

[129]  Rajesh Kumar,et al.  National Cultural Values and the Evolution of Process and Outcome Discrepancies in International Strategic Alliances , 2004 .

[130]  S. Friedman Learning to Make More Effective Decisions: Changing Beliefs as a Prelude to Action. , 2004 .

[131]  Ulrich Schimmack,et al.  Response latencies of pleasure and displeasure ratings: Further evidence for mixed feelings , 2005 .

[132]  Göktuğ Morçöl A New Systems Thinking: Implications of the Sciences of Complexity for Public Policy and Administration , 2005 .

[133]  John R. Rossiter,et al.  Reminder: A horse is a horse , 2005 .

[134]  Anthony M. Cresswell,et al.  Anatomy of a group model‐building intervention: building dynamic theory from case study research , 2006 .

[135]  Morvin Savio Martis Validation of simulation based models: A theoretical outlook , 2006 .

[136]  Fran Ackermann,et al.  Linking event thinking with structural thinking: Methods to improve client value in projects , 2006 .

[137]  Jennifer K. Bosson,et al.  Interpersonal chemistry through negativity: Bonding by sharing negative attitudes about others , 2006 .

[138]  D. Boyd,et al.  A systems thinking study of retention and recruitment issues for the New Zealand Army electronic technician trade group , 2007 .

[139]  Fevzi Okumus,et al.  GAINING ACCESS FOR RESEARCH Reflections from Experience , 2007 .

[140]  Max Visser System dynamics and group facilitation: contributions from communication theory , 2007 .

[141]  G. Hodgkinson The cognitive perspective , 2007 .

[142]  Donella H. Meadows The Electronic Oracle: Computer Models and Social Decisions , 2007 .

[143]  S. Colcombe,et al.  Eliciting mixed feelings with the paired-picture paradigm: A tribute to Kellogg (1915) , 2007 .

[144]  J. Rossiter,et al.  The Predictive Validity of Multiple-Item versus Single-Item Measures of the Same Constructs , 2007 .

[145]  John R. Rossiter,et al.  Content Validity of Measures of Abstract Constructs in Management and Organizational Research , 2008 .

[146]  Céline Bérard,et al.  Group Model Building Using System Dynamics: An Analysis of Methodological Frameworks , 2010 .

[147]  I. Mitroff,et al.  Organizational Inquiry as a Rhetorical Process: The Role of Tropes in Organizational Theory and Methods , 2010 .

[148]  Japhet Eke Lawrence The Factors That Influence Adoption and Usage Decision in SMEs: Evaluating Interpretive Case Study Research in Information Systems , 2010 .

[149]  S. K. Johl,et al.  Strategies for Gaining Access in Doing Fieldwork: Reflection of Two Researchers , 2010 .

[150]  Ian I. Mitroff,et al.  Creating a Dialectical Social Science: "Concepts, Methods, and Models" , 2011 .

[151]  David Scott,et al.  Researching Education: Data, Methods and Theory in Educational Enquiry (2nd Edition) , 2011 .

[152]  D. Chandler Semiotics For Beginners , 2011 .

[153]  F. Nietzsche On Truth and Lies in a Nonmoral Sense , 2012 .