Measuring Service Quality in the Process of Delivering a Simulation Study: The Customer's Perspective

Little research has been performed into the assessment of simulation models and even less into the assessment of simulation studies. The purpose of this paper is to describe an instrument (known as SimQual) that has been developed to assess the quality of a simulation study in which the customers are highly involved. The instrument is founded on the principles of quality measurement, and in particular service quality. From the perspective that a simulation project is a service, delivered by providers to customers, it is argued that the customers' quality perceptions are based not only on the outcome of the work (technical quality), but also on the way in which the project is delivered (functional quality). Through a series of interviews with providers and customers a set of technical and functional factors have been identified that relate to the quality of a simulation study. Based on these factors the SimQual instrument has been developed to measure simulation project quality. The paper concludes by reporting the results of empirical tests with the instrument and discussing its application as well as areas for further research.

[1]  Lee W. Schruben,et al.  Establishing the credibility of simulations , 1980 .

[2]  Paul K. Davis,et al.  Generalizing Concepts and Methods of Verification, Validation, and Accreditation (VV&A) for Military Simulations, , 1992 .

[3]  Ruth N. Bolton,et al.  A Multistage Model of Customers' Assessments of Service Quality and Value , 1991 .

[4]  A. M. Law,et al.  Pitfalls to avoid in the simulation of manufacturing systems , 1989 .

[5]  B. Lewis,et al.  Defining and Measuring the Quality of Customer Service , 1990 .

[6]  J. Carman.  Consumer perceptions of service quality: an assessment of the SERVQUAL dimensions , 1990 .

[7]  Saul I. Gass,et al.  An Assessment Procedure for Simulation Models: A Case Study , 1991, Oper. Res..

[8]  Tuncer I. Ören,et al.  Quality Assurance in Modelling and Simulation: A Taxonomy , 1984 .

[9]  A. Parasuraman,et al.  A Conceptual Model of Service Quality and Its Implications for Future Research , 1985 .

[10]  A. Parasuraman,et al.  SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. , 1988 .

[11]  Saul I. Gass,et al.  Model accreditation: A rationale and process for determining a numerical rating , 1993 .

[12]  Steven A. Taylor,et al.  Measuring Service Quality: A Reexamination and Extension , 1992 .

[13]  Saul I. Gass,et al.  Concepts of model confidence , 1981, Comput. Oper. Res..

[14]  Tuncer Ören,et al.  Concepts and criteria to assess acceptability of simulation studies: a frame of reference , 1981, CACM.

[15]  Michael Pidd,et al.  Provider and customer expectations of successful simulation projects , 1998, J. Oper. Res. Soc..

[16]  Guy G. Gable,et al.  A multidimensional model of client success when engaging external consultants , 1996 .

[17]  Averill M. Law,et al.  Secrets of successful simulation studies , 1991, 1991 Winter Simulation Conference Proceedings..

[18]  A. Parasuraman,et al.  Refinement and reassessment of the SERVQUAL scale. , 1991 .

[19]  Gerald T. Mackulak,et al.  Simulation Project Characteristics in Industrial Settings , 1995 .

[20]  C. Grönroos.  A Service Quality Model and its Marketing Implications , 1984 .

[21]  Richard E. Nance,et al.  A specification language to assist in analysis of discrete event simulation models , 1985, CACM.

[22]  Saul I. Gass,et al.  Evaluation of complex models , 1977, Comput. Oper. Res..

[23]  Saul I. Gass,et al.  Feature Article - Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis , 1983, Oper. Res..

[24]  Osman Balci.  Validation, verification, and testing techniques throughout the life cycle of a simulation study , 1994, WSC '94.

[25]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[26]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[27]  Milam W. Aiken,et al.  A model of user information satisfaction , 1994, DATB.

[28]  Edward C. Russell,et al.  The Ten Most Frequent Causes of Simulation Analysis Failure- and How To Avoid Them ! , 1979 .

[29]  R. Oliver.  Measurement and evaluation of satisfaction processes in retail settings. , 1981 .