Cautions on the Use of the SERVQUAL Measure to Assess the Quality of Information Systems Services

The SERVQUAL questionnaire (Parasuraman, Zeithaml, & Berry, 1988) is one of the preeminent instruments for measuring the quality of services as perceived by the customer. In a recent Decision Sciences article, Kettinger and Lee (1995) suggested the use of a modified SERVQUAL instrument to assess the quality of the services supplied by an information services provider. However, a number of problems with the SERVQUAL instrument are discussed in the literature. This article provides an illustrative example utilizing data collected from 138 executive and information systems professional customers of a multibillion dollar information services provider in order to examine the validity and reliability of Kettinger and Lee's (1995) modified SERVQUAL instrument. Results of analyses do not confirm the findings of Kettinger and Lee. Moreover, it appears that the use of difference scores in calculating SERVQUAL contributes to problems with the reliability, discriminant validity, convergent validity, and predictive validity of the measure. These findings suggest that caution should be exercised in the use of SERVQUAL scores and that further work is needed in the development of measures for assessing the quality of information services.

[1]  L. Cronbach,et al.  Time-limit tests: Estimating their reliability and degree of speeding , 1951, Psychometrika.

[2]  F. Lord.  The utilization of unreliable difference scores. , 1958 .

[3]  H. Kaiser.  The Application of Electronic Computers to Factor Analysis , 1960 .

[4]  J. Stanley.  GENERAL AND SPECIAL FORMULAS FOR RELIABILITY OF DIFFERENCES , 1967 .

[5]  L. Cronbach,et al.  How we should measure "change": Or should we? , 1970 .

[6]  T. Wall,et al.  Are deficiency scores deficient , 1973 .

[7]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[8]  R. Bagozzi.  Evaluating Structural Equation Models with Unobservable Variables and Measurement Error: A Comment , 1981 .

[9]  G. Johns.  Difference score measures of organizational behavior variables: A critique. , 1981 .

[10]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[11]  A. Parasuraman,et al.  A Conceptual Model of Service Quality and Its Implications for Future Research , 1985 .

[12]  J. Bynner.  Factor Analysis and the Construct Indicator Relationship , 1988 .

[13]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[14]  Dennis F. Galletta,et al.  Some Cautions on the Measurement of User Information Satisfaction , 1989 .

[15]  J. Carman.  Consumer perceptions of service quality: an assessment of the SERVQUAL dimensions , 1990 .

[16]  James C. Anderson,et al.  Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. , 1991 .

[17]  Emin Babakus,et al.  An empirical assessment of the SERVQUAL scale , 1992 .

[18]  Steven A. Taylor,et al.  Measuring Service Quality: A Reexamination and Extension , 1992 .

[19]  A. Parasuraman,et al.  The nature and determinants of customer expectations of service , 1993 .

[20]  V. Zeithaml,et al.  A Dynamic Process Model of Service Quality: From Expectations to Behavioral Intentions , 1993 .

[21]  Gilbert A. Churchill,et al.  Improving the measurement of service quality , 1993 .

[22]  Gilbert A. Churchill,et al.  Caution in the Use of Difference Scores in Consumer Research , 1993 .

[23]  R. Teas,et al.  Expectations, Performance Evaluation, and Consumers’ Perceptions of Quality , 1993 .

[24]  A. Parasuraman,et al.  Reassessment of expectations as a comparison standard in measuring service quality: Implications , 1994 .

[25]  A. Parasuraman,et al.  Alternative scales for measuring service quality: A comparative assessment based on psychometric and diagnostic criteria , 1994 .

[26]  Steven A. Taylor,et al.  Servperf versus Servqual: Reconciling Performance-Based and Perceptions-Minus-Expectations Measurement of Service Quality , 1994 .

[27]  R. Teas,et al.  Expectations as a Comparison Standard in Measuring Service Quality: An Assessment of a Reassessment , 1994 .

[28]  William J. Kettinger,et al.  Perceived Service Quality and User Satisfaction with the Information Services Function , 1994 .