Mind The Gap: Importance-Performance Gaps As Determinants Of User Satisfaction With Information Systems

This paper develops a new explanation for user satisfaction with IS. Combining insights from expectation (dis)confirmation theory (ECT) and importance-performance analysis (IPA), we focus on the gaps between the importance of particular IS attributes, and the performance of a system on those attributes, as an explanation for user satisfaction. We identify 12 relevant system attributes and theoretically argue how the gap between importance and performance with regard to these attributes may affect user satisfaction. Our empirical study is based on a survey (N=298) among student users of a newly implemented Student Information System (SIS). The results empirically support the relationship between importance-performance gaps and user satisfaction. For five out of 12 attributes, we find a significant negative influence of a negative gap (i.e., high importance, low performance) on user satisfaction. Our main contribution to the literature is that we provide an integrated perspective on ECT and IPA and empirically validate the relevance of importance-performance gaps for explaining IS user satisfaction. Our second contribution is that we make use of the difference score technique to measure the importance-performance gaps for user satisfaction. Thus, our contribution to the IS literature is both theoretical and methodological.

[1]  J. Dietz.  Satisfaction: A Behavioral Perspective on the Consumer , 1997 .

[2]  Stephen H. Wagner,et al.  Adaptation-level theory, opponent process theory, and dispositions: an integrated approach to the stability of job satisfaction. , 2005, The Journal of applied psychology.

[3]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[4]  Fred D. Davis,et al.  A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies , 2000, Management Science.

[5]  Chris W. Clegg,et al.  Users' reactions to information technology: some multivariate models and their implications , 1997, J. Inf. Technol..

[6]  Jerald Greenberg,et al.  The College Sophomore as Guinea Pig: Setting the Record Straight , 1987 .

[7]  John P. Meyer,et al.  On Using Direct Measures of Met Expectations: A Methodological Note , 1995 .

[8]  Izak Benbasat,et al.  An Experimental Investigation of the Impact of Computer Based Decision Aids on Decision Making Strategies , 1991, Inf. Syst. Res..

[9]  Sulaiman Ainin,et al.  Applying Importance-Performance Analysis to Information Systems: An Exploratory Case Study , 2008 .

[10]  Andy Bytheway,et al.  Understanding user perceptions of information systems success , 1997, J. Strateg. Inf. Syst..

[11]  Dan Remenyi,et al.  A user-satisfaction approach to IS effectiveness measurement , 1991, J. Inf. Technol..

[12]  Tibert Verhagen,et al.  Satisfaction with virtual worlds: An integrated model of experiential value , 2011, Inf. Manag..

[13]  Leyland F. Pitt,et al.  Potential Research Space in MIS: A Framework for Envisioning and Evaluating Research Replication, Extension, and Generation , 2002, Inf. Syst. Res..

[14]  Andrea Everard,et al.  How Presentation Flaws Affect Perceived Site Quality, Trust, and Intention to Purchase from an Online Store , 2005, J. Manag. Inf. Syst..

[15]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[16]  Fred Niederman,et al.  Sources of dissatisfaction in end-user support: an empirical study , 2002, DATB.

[17]  Fred D. Davis,et al.  User Acceptance of Computer Technology: A Comparison of Two Theoretical Models , 1989 .

[18]  A. Parasuraman,et al.  Reassessment of Expectations as a Comparison Standard in Measuring Service Quality: Implications for Further Research , 1994 .

[19]  Confirmation Model.  UNDERSTANDING INFORMATION SYSTEMS CONTINUANCE: AN EXPECTATION- , 2001 .

[20]  Peter B. Seddon.  A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..

[21]  Izak Benbasat,et al.  An experimental investigation of the interactive effects of interface style, instructions, and task familiarity on user performance , 1996, TCHI.

[22]  A. Parasuraman,et al.  A Conceptual Model of Service Quality and Its Implications for Future Research , 1985 .

[23]  Ian Richardson,et al.  Diagnosing information systems success: importance-performance maps in the health club industry , 2001, Inf. Manag..

[24]  Barbara Wixom,et al.  Antecedents of Information and System Quality: An Empirical Examination Within the Context of Data Warehousing , 2005, J. Manag. Inf. Syst..

[25]  John A. Martilla,et al.  Importance-Performance Analysis , 1977 .

[26]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[27]  J. Hair.  Multivariate data analysis : a global perspective , 2010 .

[28]  Parag Kosalge,et al.  Using importance performance analysis to understand and guide e-business decision making in SMEs , 2009, J. Enterp. Inf. Manag..

[29]  M. Markus,et al.  The Enterprise System Experience— From Adoption to Success , 2000 .

[30]  Sirkka L. Jarvenpaa,et al.  The effect of task demands and graphical format on information processing strategies , 1989 .

[31]  Kurt Matzler,et al.  The asymmetric relationship between attribute-level performance and overall customer satisfaction: a reconsideration of the importance–performance analysis , 2004 .

[32]  Kar Yan Tam,et al.  Understanding Continued Information Technology Usage Behavior: A Comparison of Three Models in the Context of Mobile Internet , 2006, Decis. Support Syst..

[33]  Juhani Iivari,et al.  An empirical test of the DeLone-McLean model of information system success , 2005, DATB.

[34]  Viswanath Venkatesh,et al.  E XPECTATION D ISCONFIRMATION AND T ECHNOLOGY A DOPTION : P OLYNOMIAL M ODELING AND R ESPONSE S URFACE A NALYSIS 1 , 2010 .

[35]  R. Nash,et al.  A critical evaluation of importance - performance analysis , 2013 .

[36]  Stephen W. Brown,et al.  A Gap Analysis of Professional Service Quality , 1989 .

[37]  Fatemeh Zahedi,et al.  The Measurement of Web-Customer Satisfaction: An Expectation and Disconfirmation Approach , 2002, Inf. Syst. Res..

[38]  Richard T. Watson,et al.  Service Quality: A Measure of Information System Effectiveness , 1995, MIS Q..

[39]  Darshana Sedera,et al.  Re-conceptualizing Information System Success: The IS-Impact Measurement Model , 2008, J. Assoc. Inf. Syst..

[40]  T. C. Edwin Cheng,et al.  Extending the Understanding of End User Information Systems Satisfaction Formation: An Equitable Needs Fulfillment Model Approach , 2008, MIS Q..

[41]  Ephraim R. McLean,et al.  Measuring information systems success: models, dimensions, measures, and interrelationships , 2008, Eur. J. Inf. Syst..

[42]  Jesús A. Varela,et al.  Importance values for Importance–Performance Analysis: A formula for spreading out values derived from preference rankings , 2007 .

[43]  A. Parasuraman,et al.  Delivering quality service : balancing customer perceptions and expectations , 1990 .

[44]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..