Measuring the Perceived Effectiveness of Decision Support Systems and Their Impact on Performance

This study investigates decision support systems (DSS) by assessing the factors that enhance their perceived effectiveness and their impact on performance. This was achieved by using a simulation exercise with 652 senior graduate students who developed DSS and reported on the systems created. Our analysis shows that DSS users who perceive the system as effective correlate to improved company performance. However, investing significant human resources in developing a system does not necessarily guarantee enhanced performance. In addition, the study exemplifies how user traits can impact perceived effectiveness.

[1]  Paula M. C. Swatman,et al.  An Internet-Mediated Business Simulation: Developing and Using TRECS , 1999 .

[2]  Joan S. Ash,et al.  Viewpoint Paper: People and Organizational Issues in Research Systems Implementation , 2008, J. Am. Medical Informatics Assoc..

[3]  이훈,et al.  지각된 유용성(Perceived Usefulness)의 영향분석 , 2004 .

[4]  Jerry Fjermestad,et al.  Electronic Customer Relationship Management , 2006 .

[5]  Cheri Speier,et al.  The Influence of Query Interface Design on Decision-Making Performance , 2003, MIS Q..

[6]  U. Dulleck,et al.  μ-σ Games , 2012, Games.

[7]  D. Sandy Staples,et al.  Dimensions of Information Systems Success , 1999, Commun. Assoc. Inf. Syst..

[8]  Arnold Kamis,et al.  Using an Attribute-Based Decision Support System for User-Customized Products Online: An Experimental Investigation , 2008, MIS Q..

[9]  George M. Kasper,et al.  The Effect of User-Developed DSS Applications of Forecasting Decision-Making Performance in an Experimental Setting , 1985, J. Manag. Inf. Syst..

[10]  Dale Goodhue,et al.  Task-Technology Fit and Individual Performance , 1995, MIS Q..

[11]  Bruce A. Reinig,et al.  Toward an Understanding of Satisfaction with the Process and Outcomes of Teamwork , 2003, J. Manag. Inf. Syst..

[12]  Ephraim R. McLean,et al.  The DeLone and McLean Model of Information Systems Success: A Ten-Year Update , 2003, J. Manag. Inf. Syst..

[13]  Mohd Hasan Selamat,et al.  The impact of technological factors on information systems success in the electronic-government context , 2007, Bus. Process. Manag. J..

[14]  Rémi Desmeules,et al.  The Impact of Variety on Consumer Happiness: Marketing and the Tyranny of Freedom , 2002 .

[15]  Chang Lin,et al.  DSS Interaction: A Simulation Experiment , 2009 .

[16]  Helana Scheepers,et al.  Increasing Student Interaction in Learning Activities: Using a Simulation to Learn about Project Failure and Escalation , 2001, J. Inf. Syst. Educ..

[17]  Edward J. Garrity,et al.  Information systems success measurement , 1998 .

[18]  Casper Draijer,et al.  Best Practices of Business Simulation with SAP R/3 , 2004, J. Inf. Syst. Educ..

[19]  David B. Paradice,et al.  Studies in managerial problem formulation systems , 1993, Decis. Support Syst..

[20]  Timo Lainema,et al.  Applying constructivist approach to educational business games: Case REALGAME , 2003 .

[21]  Gerrit van Bruggen,et al.  DSS Effectiveness in Marketing Resource Allocation Decisions: Reality vs. Perception , 2004, Inf. Syst. Res..

[22]  Blake Ives,et al.  An empirical study of the impact of user involvement on system usage and information satisfaction , 1986, CACM.

[23]  Ananth Srinivasan,et al.  Alternative Measures of Systems Effectiveness: Associations and Implications , 1985, MIS Q..

[24]  D. Khazanchi,et al.  Evaluating decision support systems: a dielectrical perspective , 1991, Proceedings of the Twenty-Fourth Annual Hawaii International Conference on System Sciences.

[25]  Edward J. Garrity,et al.  An experimental investigation of web-based information systems success in the context of electronic commerce , 2005, Decis. Support Syst..

[26]  Andrew Martin,et al.  The Design and Evolution of a Simulation/Game for Teaching Information Systems Development , 2000 .

[27]  Constantin Zopounidis,et al.  Designing a DSS for the assessment of company performance and viability , 1992 .

[28]  Martin D. Goslar,et al.  Decision support systems: an empirical assessment for decision making , 1986 .

[29]  Robert Fildes,et al.  Influence of user participation on DSS use and decision accuracy , 2002 .

[30]  Nigel W.T. Quinn,et al.  Environmental decision support system development for seasonal wetland salt management in a river basin subjected to water quality regulation , 2009 .

[31]  Tal Ben-Zvi,et al.  The Efficacy of Business Simulation Games in Creating Decision Support Systems: An Experimental Investigation , 2010, Decis. Support Syst..

[32]  Izak Benbasat,et al.  Evaluating the Impact of DSS, Cognitive Effort, and Incentives on Strategy Selection , 1999, Inf. Syst. Res..

[33]  Marcus O'Connor,et al.  The effectiveness of Decision Support Systems: the implications of task complexity and DSS sophistication , 1994, J. Inf. Technol..

[34]  Jerry Fjermestad,et al.  Electronic customer relationship management: Revisiting the general principles of usability and resistance - an integrative implementation framework , 2003, Bus. Process. Manag. J..

[35]  Pietro Romano,et al.  Co-ordination and integration mechanisms to manage logistics processes across supply networks , 2003 .

[36]  Kevin Crowston,et al.  Information systems success in free and open source software development: theory and measures , 2006, Softw. Process. Improv. Pract..

[37]  P. Schroeder The Goal: A Process of Ongoing Improvement , 1994 .

[38]  Abhijit Chaudhury,et al.  An empirical investigation of decision-making satisfaction in web-based decision support systems , 2004, Decis. Support Syst..

[39]  R. O’Brien,et al.  A Caution Regarding Rules of Thumb for Variance Inflation Factors , 2007 .

[40]  H. G. Wind,et al.  From Design to Application of a Decision-support System for Integrated River-basin Management , 2009 .

[41]  Kevin F. R. Liu,et al.  Decision-support for environmental impact assessment: A hybrid approach using fuzzy logic and fuzzy analytic network process , 2009, Expert Syst. Appl..

[42]  Arnold Kamis,et al.  Parametric search engines: What makes them effective when shopping online for differentiated products? , 2006, Inf. Manag..

[43]  Andy Neely,et al.  Designing performance measures: a structured approach , 1997 .

[44]  Gee Kin Yeo,et al.  Toward a Multilingual, Experiential Environment for Learning Decision Technology , 1999 .

[45]  Tal Ben-Zvi,et al.  Simulation Gaming in Technology Management , 2008, AMCIS.

[46]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[47]  Robin S. Poston,et al.  Effective Use of Knowledge Management Systems: A Process Model of Content Ratings and Credibility Indicators , 2005, MIS Q..

[48]  Richard T. Watson,et al.  Service Quality: A Measure of Information System Effectiveness , 1995, MIS Q..

[49]  James E. Driskell,et al.  Games, Motivation, and Learning: A Research and Practice Model , 2002 .

[50]  B. Kahn,et al.  Variety for sale: Mass customization or mass confusion? , 1998 .