Using Shortened Scales in Sales Research: Risks, Benefits, and Strategies

Increasing the number of items in a scale may increase reliability and reduce measurement error while revealing finer distinctions between respondents and stronger relationships between constructs. However, longer scales take more effort to complete, which may reduce response rates and data quality or limit the number of constructs that can be measured in a survey. To address this conundrum, many researchers have begun to reduce the number of items collected forindividual scales. This paper reviews the trade-offs associated with short-form scales, both pro and con, along with strategies for employing or developing shortened scales. Empirical examples illustrate multiple approaches to the analysis ofsplit surveys, which use multiple forms to include more total items while limiting the burden on respondents in each group.

[1]  Marsha L. Richins The Material Values Scale: Measurement Properties and Development of a Short Form , 2004 .

[2]  Greg W. Marshall,et al.  Toward a Shortened Measure of Adaptive Selling , 2002 .

[3]  Barton A. Weitz,et al.  The SOCO Scale: A measure of the customer orientation of salespeople. , 1982 .

[4]  Gilbert A. Churchill A Paradigm for Developing Better Measures of Marketing Constructs , 1979 .

[5]  Dawn Iacobucci,et al.  Results on the Standard Error of the Coefficient Alpha Index of Reliability , 2005 .

[6]  Klaas Sijtsma,et al.  Future of Psychometrics: Ask What Psychometrics Can Do for Psychology , 2012 .

[7]  Maria M. Ryan,et al.  The Selling Orientation-Customer Orientation (S.O.C.O.) Scale: A Proposed Short Form , 2001 .

[8]  T. Dickhaus,et al.  Estimation in Linear Models , 2015 .

[9]  Karen A. Machleit,et al.  Psychometric assessment of a reduced version of INDSALES , 1989 .

[10]  Raymond B. Cattell,et al.  The Importance of Factor-Trueness and Validity, Versus Homogeneity and Orthogonality, in Test Scales1 , 1964 .

[11]  Karl G. Jöreskog,et al.  Recent Developments in Structural Equation Modeling , 1982 .

[12]  W. Balzer,et al.  ISSUES AND STRATEGIES FOR REDUCING THE LENGTH OF SELF‐REPORT SCALES , 2002 .

[13]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[14]  N. Panagopoulos,et al.  Sales Force Control Systems: A Review of Measurement Practices and Proposed Scale Refinements , 2008 .

[15]  P. Allison Estimation of Linear Models with Incomplete Data , 1987 .

[16]  D. Torgerson,et al.  Increasing response rates to postal questionnaires , 2002, BMJ : British Medical Journal.

[17]  Craig K. Enders,et al.  A Primer on Maximum Likelihood Algorithms Available for Use With Missing Data , 2001 .

[18]  W. Bearden,et al.  The use of expert judges in scale development: Implications for improving face validity of measures of unobservable constructs , 2004 .

[19]  A. Diamantopoulos,et al.  Guidelines for choosing between multi-item and single-item scales for construct measurement: a predictive validity perspective , 2012 .

[20]  M. Galesic,et al.  Effects of Questionnaire Length on Participation and Indicators of Response Quality in a Web Survey , 2009 .

[21]  H. Vorst,et al.  Reducing the Length of Questionnaires through Structurally Incomplete Designs: An Illustration. , 2007 .

[22]  A. Asare,et al.  The State of Research Methods in Personal Selling and Sales Management Literature , 2012 .

[23]  W. Moncrief,et al.  The Complexities of Sales and Sales Management Research: A Historical Analysis from 1990 to 2005 , 2008 .

[24]  M. Wedel,et al.  Split Questionnaire Design for Massive Surveys , 2008 .

[25]  L. Terman The Measurement of Intelligence An Explanation of and a Complete Guide for the Use of the Stanford Revision: and Extension of the Binet-Simon Intelligence Scale , 2008 .

[26]  M. Clarke,et al.  Increasing response rates to postal questionnaires: systematic review , 2002, BMJ : British Medical Journal.

[27]  John Hulland,et al.  Use of causal models in marketing research: A review , 1996 .

[28]  R. P. McDonald,et al.  Structural Equations with Latent Variables , 1989 .

[29]  Herbert W Marsh,et al.  A short version of the Self Description Questionnaire II: operationalizing criteria for short-form evaluation with new applications of confirmatory factor analyses. , 2005, Psychological assessment.

[30]  D. G. Morrison,et al.  Do We Really Need Multiple-Item Measures in Service Research? , 2001 .

[31]  L. Hayduk,et al.  Should researchers use single indicators, best indicators, or multiple indicators in structural equation models? , 2012, BMC Medical Research Methodology.

[32]  Robert A Ping,et al.  On assuring valid measures for theoretical models using survey data , 2004 .

[33]  H. Cooper,et al.  A Quantitative Review of Research Design Effects on Response Rates to Questionnaires , 1983 .

[34]  John W Graham,et al.  Planned missing data designs in psychological research. , 2006, Psychological methods.

[35]  Dawn Iacobucci,et al.  Structural Equations Modeling: Fit Indices, Sample Size, and Advanced Topics , 2010 .

[36]  John R. Rossiter,et al.  Marketing measurement revolution: the C-OAR-SE method and why it must replace psychometrics , 2011 .

[37]  J. Hunter,et al.  On the Assessment of Unidimensional Measurement: Internal and External Consistency, and Overall Consistency Criteria , 1987 .