User satisfaction and system success: an empirical exploration of user involvement in software development

For over four decades user involvement has been considered intuitively to lead to user satisfaction, which plays a pivotal role in successful outcome of a software project. The objective of this paper is to explore the notion of user satisfaction within the context of the user involvement and system success relationship. We have conducted a longitudinal case study of a software development project and collected qualitative data by means of interviews, observations and document analysis over a period of 3 years. The analysis of our case study data revealed that user satisfaction significantly contributes to the system success even when schedule and budget goals are not met. The case study data analysis also presented additional factors that contribute to the evolution of user satisfaction throughout the project. Users’ satisfaction with their involvement and the resulting system are mutually constituted while the level of user satisfaction evolves throughout the stages of software development process. Effective management strategies and user representation are essential elements of maintaining an acceptable level of user satisfaction throughout software development process.

[1]  Muneera Bano,et al.  A systematic review on the relationship between user involvement and system success , 2015, Inf. Softw. Technol..

[2]  Gabriele Piccoli,et al.  Moving beyond user participation to achieve successful IS design , 2007, CACM.

[3]  Bruce A. Reinig,et al.  Toward an Understanding of Satisfaction with the Process and Outcomes of Teamwork , 2003, J. Manag. Inf. Syst..

[4]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[5]  Liisa von Hellens,et al.  Qualitative Research in Information Systems , 2007, Australas. J. Inf. Syst..

[6]  June M. Verner,et al.  Case study: factors for early prediction of software development success , 2002, Inf. Softw. Technol..

[7]  Sammy W. Pearson,et al.  Development of a Tool for Measuring and Analyzing Computer User Satisfaction , 1983 .

[8]  K. Eason.  Information Technology and Organizational Change , 1989 .

[9]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[10]  Peter B. Seddon.  A Respecification and Extension of the DeLone and McLean Model of IS Success , 1997, Inf. Syst. Res..

[11]  George M. Marakas,et al.  The Impact of Operational User Participation on Perceived System Implementation Success: An Empirical Investigation , 2006, J. Comput. Inf. Syst..

[12]  June M. Verner,et al.  Defining and contributing to software development success , 2006, CACM.

[13]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[14]  Tor Guimaraes,et al.  The Relationship Between User Participation and User Satisfaction: An Investigation of Four Contingency Factors , 1994, MIS Q..

[15]  Tore Dybå,et al.  Applying Systematic Reviews to Diverse Study Types: An Experience Report , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[16]  Angèle L. M. Cavaye,et al.  User participation in system development revisited , 1995, Inf. Manag..

[17]  BaruaAnitesh,et al.  Understanding the service component of application service provision , 2003 .

[18]  Kamel Rouibah,et al.  Effect of management support, training, and user involvement on system usage and satisfaction in Kuwait , 2009, Ind. Manag. Data Syst..

[19]  Graham C. Low,et al.  Exploring Individual User Satisfaction Within User-Led Development , 1993, MIS Q..

[20]  Jane E. Klobas,et al.  The role of involvement in learning management system success , 2010, J. Comput. High. Educ..

[21]  Juhani Iivari,et al.  The user – the great unknown of systems development: reasons, forms, challenges, experiences and intellectual contributions of user involvement , 2010, Inf. Syst. J..

[22]  Jarmo J. Ahonen,et al.  Software development project success and failure from the supplier's perspective: A systematic literature review , 2012 .

[23]  Kunsoo Suh,et al.  End-User's Disconfirmed Expectations and the Success of Information Systems , 1994 .

[24]  Geoff Walsham,et al.  Doing interpretive research , 2006, Eur. J. Inf. Syst..

[25]  Anol Bhattacherjee,et al.  Understanding Information Systems Continuance: An Expectation-Confirmation Model , 2001, MIS Q..

[26]  Roger McHaney,et al.  A validation of the end-user computing satisfaction instrument in Taiwan , 2002, Inf. Manag..

[27]  Darren Dalcher.  Software Project Success : Moving Beyond Failure , 2009 .

[28]  Rudy Hirschheim,et al.  Four paradigms of information systems development , 1989, CACM.

[29]  T. C. Edwin Cheng,et al.  Extending the Understanding of End User Information Systems Satisfaction Formation: An Equitable Needs Fulfillment Model Approach , 2008, MIS Q..

[30]  C WetherbeJames,et al.  The relationship between user participation and user satisfaction , 1994 .

[31]  David A. Griffith,et al.  An emerging model of Web site design for marketing , 1998, CACM.

[32]  Mark I. Hwang,et al.  The effect of user engagement on system success: A meta-analytical integration of research findings , 1999, Inf. Manag..

[33]  Shirley Gregor,et al.  The Nature of Theory in Information Systems , 2006, MIS Q..

[34]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[35]  Fatemeh Zahedi,et al.  The Measurement of Web-Customer Satisfaction: An Expectation and Disconfirmation Approach , 2002, Inf. Syst. Res..

[36]  Muneera Bano,et al.  Users' involvement in requirements engineering and system success , 2013, 2013 3rd International Workshop on Empirical Requirements Engineering (EmpiRE).

[37]  Andrew B. Whinston,et al.  Understanding the Service Component of Application Service Provision: An Empirical Analysis of Satisfaction with ASP Services , 2003, MIS Q..

[38]  Mark Speece,et al.  Satisfaction drivers for Internet service technology among stock brokerage customers in Thailand , 2002 .

[39]  Guenther Ruhe,et al.  Impact Analysis of Missing Values on the Prediction Accuracy of Analogy-based Software Effort Estimation Method AQUA , 2007, ESEM 2007.

[40]  Ann-Marie K. Baronas,et al.  Restoring a Sense of Control During Implementation: How User Involvement Leads to System Acceptance , 1988, MIS Q..

[41]  Robert O. Briggs,et al.  The Yield Shift Theory of Satisfaction and Its Application to the IS/IT Domain , 2008, J. Assoc. Inf. Syst..

[42]  Henri Barki,et al.  Rethinking the Concept of User Involvement , 1989, MIS Q..

[43]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Dependent Variable , 1992, Inf. Syst. Res..

[44]  Andrew Martin,et al.  The 3-D Model of Information Systems Success: The Search for the Dependent Variable Continues , 1996 .

[45]  K. Charmaz,et al.  Constructing Grounded Theory , 2014 .

[46]  Paul Ralph,et al.  The dimensions of software engineering success , 2014, ICSE.

[47]  N. Melone.  A theoretical assessment of the user-satisfaction construct in information systems research , 1990 .

[48]  Mohamed Khalifa,et al.  Determinants of Satisfaction at Different Adoption Stages of Internet-Based Services , 2003, J. Assoc. Inf. Syst..

[49]  Magid Igbaria,et al.  Organizational Experiences and Career Success of MIS Professionals and Managers: An Examination of Race Differences , 1992, MIS Q..

[50]  Antonio Carlos Gastaud Maçada,et al.  Measuring user satisfaction with information security practices , 2015, Comput. Secur..

[51]  William J. Doll,et al.  A Confirmatory Factor Analysis of the End-User Computing Satisfaction Instrument , 1994, MIS Q..

[52]  Mark A. Harris,et al.  A New Look at the Relationship between User Involvement in Systems Development and System Success , 2009, Communications of the Association for Information Systems.

[53]  R. Yin.  Case Study Research: Design and Methods , 1984 .

[54]  Barbara Paech,et al.  Understanding the Influence of User Participation and Involvement on System Success – a Systematic Mapping Study , 2015, Empirical Software Engineering.

[55]  Tom Dayton,et al.  Participatory Practices in the Software Lifecycle , 1997 .

[56]  Barbara H Wixom,et al.  A Theoretical Integration of User Satisfaction and Technology Acceptance , 2005, Inf. Syst. Res..

[57]  Richard Baskerville,et al.  Generalizing Generalizability in Information Systems Research , 2003, Inf. Syst. Res..

[58]  Daniela Cruzes,et al.  Recommended Steps for Thematic Synthesis in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[59]  Hee-Ok Jun.  The Role of User Participation in Information Systems Development : Implications from a Meta-Analysis , 2008 .

[60]  Sari Kujala,et al.  User involvement: A review of the benefits and challenges , 2003, Behav. Inf. Technol..

[61]  R. Briggs,et al.  Meeting Satisfaction for Technology-Supported Groups , 2006 .

[62]  Tor Guimaraes,et al.  Successful Strategies for User Participation in Systems Development , 1997, J. Manag. Inf. Syst..

[63]  Ephraim R. McLean,et al.  Measuring information systems success: models, dimensions, measures, and interrelationships , 2008, Eur. J. Inf. Syst..

[64]  Muneera Bano,et al.  Problems and challenges of user involvement in software development: an empirical study , 2015, EASE.

[65]  R. Oliver.  Varieties of Value in the Consumption Satisfaction Response , 1996 .

[66]  Daniel Robey,et al.  User Involvement in Information System Development: A Conflict Model and Empirical Test , 1982 .

[67]  Avi Rushinek,et al.  What makes users happy? , 1986, CACM.

[68]  Khaled El Emam,et al.  A Replicated Survey of IT Software Project Failures , 2008, IEEE Software.

[69]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[70]  Henri Barki,et al.  Explaining the Role of User Participation in Information System Use , 1994 .

[71]  Tor Guimaraes,et al.  Exploring the Factors Associated with Expert Systems Success , 1995, MIS Q..

[72]  Geoff Walsham,et al.  The Emergence of Interpretivism in IS Research , 1995, Inf. Syst. Res..

[73]  Netta Iivari,et al.  'Representing the User' in software development - a cultural analysis of usability work in the product development context , 2006, Interact. Comput..