Perceptual Congruence between IS Users and Professionals on IS Service Quality - Insights from Response Surface Analysis

Despite the importance of matching different viewpoints on IS service quality in organizations, there is still little understanding about how perceptual congruence between IS professionals and users affects user satisfaction. Drawing on cognitive dissonance theory and perceptual congruence research, our study examines 169 matched-pair survey responses using polynomial regression and response surface analysis. We demonstrate that perceptual congruence on IS service quality between IS professionals and users can have a nonlinear relationship with user satisfaction. We find that greater perceptual congruence is associated with higher user satisfaction and that user satisfaction increases when congruent perceptions of both IS professionals and users are high compared to when they are low. Moreover, the rate in the decrease of user satisfaction away from perfect congruence is dependent on the direction of incongruence, highlighting the importance of developing awareness of congruent perceptions to increase user satisfaction. Implications for research and practice are discussed.

[1]  Gary Klein,et al.  Communication skills importance and proficiency: perception differences between IS staff and IS users , 2005, Int. J. Inf. Manag..

[2]  Leyland F. Pitt,et al.  Gaps within the IS department: barriers to service quality , 1998, J. Inf. Technol..

[3]  Gary Klein,et al.  Performance ratings and importance of performance measures for IS staff: the different perceptions of IS users and IS staff , 2000, IEEE Trans. Engineering Management.

[4]  Eric D. Heggestad,et al.  Polynomial Regression with Response Surface Analysis: A Powerful Approach for Examining Moderation and Overcoming Limitations of Difference Scores , 2010 .

[5]  Gilbert A. Churchill,et al.  Improving the measurement of service quality , 1993 .

[6]  John C. Henderson,et al.  The Value of Strategic IS Planning: Understanding Consistency, Validity, and IS Markets , 1988, MIS Q..

[7]  R. Oliver.  Customer delight: Foundations, findings, and managerial insight☆ , 1997 .

[8]  J. Edwards.  Alternatives to difference scores: Polynomial regression analysis and response surface methodology. , 2002 .

[9]  Gary Klein,et al.  Closing the user and provider service quality gap , 2003, CACM.

[10]  William J. Kettinger,et al.  Perceived Service Quality and User Satisfaction with the Information Services Function , 1994 .

[11]  William R. King,et al.  An assessment of perceptual differences between informants in information systems research , 1997 .

[12]  Gary Klein,et al.  Measuring Information System Service Quality: SERVQUAL from the Other Side , 2002, MIS Q..

[13]  Juhani Iivari,et al.  Deployment of systems development methodologies: Perceptual congruence between IS managers and systems developers , 2006, Inf. Manag..

[14]  Gary Klein,et al.  Perception and expectation gaps of information systems provider skills: the impact on user satisfaction , 2005, Inf. Syst. J..

[15]  Gary Klein,et al.  Perceptions of system development failures , 1998, Inf. Softw. Technol..

[16]  R. Rust,et al.  Should we delight the customer? , 2000 .

[17]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[18]  R. A. Wicklund,et al.  Perspectives on cognitive dissonance , 1976 .

[19]  Terry S. Overton,et al.  Estimating Nonresponse Bias in Mail Surveys , 1977 .

[20]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[21]  Jeffrey R. Edwards,et al.  Regression Analysis as an Alternative to Difference Scores , 1994 .

[22]  Viswanath Venkatesh,et al.  Expectation Confirmation in Technology Use , 2012, Inf. Syst. Res..

[23]  Francis J. Yammarino,et al.  SELF‐OTHER AGREEMENT: DOES IT REALLY MATTER? , 1998 .

[24]  M. Deaton,et al.  Response Surfaces: Designs and Analyses , 1989 .

[25]  J. Fox,et al.  Applied Regression Analysis and Generalized Linear Models , 2008 .

[26]  Steven A. Taylor,et al.  Servperf versus Servqual: Reconciling Performance-Based and Perceptions-Minus-Expectations Measurement of Service Quality , 1994 .

[27]  Urvashi Rathod,et al.  Defining ‘success’ for software projects: An exploratory revelation , 2006 .

[28]  Robert J. Kauffman,et al.  An Interdisciplinary Perspective on IT Services Management and Service Science , 2010, J. Manag. Inf. Syst..

[29]  Richard W. Scamell,et al.  The Effects of Information System User Expectations on Their Performance and Perceptions , 1993, MIS Q..

[30]  Marcia J. Simmering,et al.  A Tale of Three Perspectives , 2009 .

[31]  Steven A. Taylor,et al.  Measuring Service Quality: A Reexamination and Extension , 1992 .

[32]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .

[33]  T WatsonRichard,et al.  Measuring information systems service quality , 1997 .

[34]  Viswanath Venkatesh,et al.  E XPECTATION D ISCONFIRMATION AND T ECHNOLOGY A DOPTION : P OLYNOMIAL M ODELING AND R ESPONSE S URFACE A NALYSIS 1 , 2010 .

[35]  J. F. Dashiell,et al.  Theories of perception and the concept of structure. , 1955 .

[36]  Dennis F. Galletta,et al.  Some Cautions on the Measurement of User Information Satisfaction , 1989 .

[37]  Kenneth A. Bollen,et al.  Regression Diagnostics , 1985 .

[38]  Gary Klein,et al.  Discrepancies between desired and perceived measures of performance of IS professionals: Views of the IS professionals themselves and the users , 2007, Inf. Manag..

[39]  Floyd H. Allport,et al.  Theories of Perception and the Concept of Structure: A Review and Critical Analysis with an Introduction to a Dynamic-Structural Theory of Behavior. , 1955 .

[40]  Wonseok Oh,et al.  On the Assessment of the Strategic Value of Information Technologies: Conceptual and Analytical Approaches , 2007, MIS Q..

[41]  Gary Klein,et al.  Perception differences of software success: provider and user views of system metrics , 2002, J. Syst. Softw..

[42]  Linda G. Wallace,et al.  Understanding developer and manager perceptions of function points and source lines of code , 2009, J. Syst. Softw..

[43]  Jeffrey R. Edwards,et al.  On the Use of Polynomial Regression Equations As An Alternative to Difference Scores in Organizational Research , 1993 .

[44]  P. M. Podsakoff,et al.  Self-Reports in Organizational Research: Problems and Prospects , 1986 .

[45]  Richard T. Watson,et al.  Measuring Information Systems Service Quality: Lessons From Two Longitudinal Case Studies , 1998, MIS Q..

[46]  Gary Klein,et al.  Seeking consonance in information systems , 2001, J. Syst. Softw..

[47]  James Montier,et al.  Behavioural Finance: Insights into Irrational Minds and Markets , 2002 .

[48]  Anol Bhattacherjee,et al.  Understanding Information Systems Continuance: An Expectation-Confirmation Model , 2001, MIS Q..

[49]  Rolph E. Anderson,et al.  Multivariate data analysis with readings (2nd ed.) , 1986 .

[50]  J. Edwards.  The Study of Congruence in Organizational Behavior Research: Critique and a Proposed Alternative , 1994 .

[51]  Thomas Hess,et al.  The Role of SaaS Service Quality for Continued SaaS Use: Empirical Insights from SaaS Using Firms , 2010, ICIS.

[52]  William J. Kettinger,et al.  Zones of Tolerance: Alternative Scales for Measuring Information Systems Service Quality , 2005, MIS Q..

[53]  Michael J. Ginzberg,et al.  Early Diagnosis of MIS Implementation Failure: Promising Results and Unanswered Questions , 1981 .