Towards an assessment model of end user satisfaction and data quality in Business Intelligence systems

While substantial business investment in business intelligence systems (BIS) is continuing to accelerate, there is an urgent need of specific and rigorous methods to assess their performance and effectiveness. There are some scholars that have handled the measurement of Business Intelligence (BI) from a value perspective; others have chosen to assess the BI process, while some have tried to rather evaluate the performance of BI systems. However, there are practically no empirical research papers at hand concerning the measurement of BI systems seen from a product perspective. Therefore, we propose in this paper a product oriented evaluation of two major aspects of BIS: end user satisfaction with the intelligence produced by BIS and the quality of the data conveyed to end users. By exploiting the lessons learned from prior attempts to measure those two dimensions in information systems, we present a new evaluation model that is based on an understanding of the characteristics and the intelligence produced by BIS. We then propose a list of dimensions to be assessed in an examination of the relationship between end user's satisfaction and the quality of data conveyed to them. In this paper, multiple definitions of business intelligence in the literature are presented; besides, business intelligence systems measurement from different points of view is addressed. The purpose of this paper is to present an assessment model of end user satisfaction and data quality in BIS that participates towards the development of an evaluation approach of business intelligence systems seen from a product perspective.

[1]  Reinhard Schütte,et al.  The Guidelines of Modeling - An Approach to Enhance the Quality in Information Models , 1998, ER.

[2]  Aleš Popovič,et al.  Conceptual Model of Business Value of Business Intelligence Systems , 2010 .

[3]  Verónika Peralta,et al.  Data Quality Evaluation in Data Integration Systems , 2006 .

[4]  David Parmenter,et al.  Key Performance Indicators: Developing, Implementing,and Using Winning KPIs , 2007 .

[5]  Vesna Bosilj-Vuksic,et al.  Supporting Performance Management with Business Process Management and Business Intelligence: A Case Analysis of Integration and Orchestration , 2013, Int. J. Inf. Manag..

[6]  Erne Suzila Kassim,et al.  Information System Acceptance and User Satisfaction: The Mediating Role of Trust , 2012 .

[7]  Nancy Williams,et al.  The business value of business intelligence , 2007 .

[8]  Tobias Bucher,et al.  Process-centric business intelligence , 2009, Bus. Process. Manag. J..

[9]  Aleš Popovič,et al.  Towards business intelligence systems success: Effects of maturity and culture on analytical decision making , 2012, Decis. Support Syst..

[10]  Zhan Cui,et al.  Benefits of Ontologies in Real Time Data Access , 2007, 2007 Inaugural IEEE-IES Digital EcoSystems and Technologies Conference.

[11]  Eric W.T. Ngai,et al.  A critical review of end-user information system satisfaction research and a new research framework , 2002 .

[12]  Anna Sidorova,et al.  Business intelligence success: The roles of BI capabilities and decision environments , 2013, Inf. Manag..

[13]  William Yeoh,et al.  Critical Success Factors for Business Intelligence Systems , 2010, J. Comput. Inf. Syst..

[14]  Zhongzhi Shi,et al.  Techniques, Process, and Enterprise Solutions of Business Intelligence , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[15]  Michael J. Davern,et al.  Measuring the effects of business intelligence systems: The relationship between business process and organizational performance , 2008, Int. J. Account. Inf. Syst..

[16]  Antti Lönnqvist,et al.  Measurement of Business Intelligence in a Finnish Telecommunications Company , 2005, ECKM.

[17]  Chih-Hung Tsai,et al.  Research on using ANP to establish a performance assessment model for business intelligence systems , 2009, Expert Syst. Appl..

[18]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[19]  M. Bahrami,et al.  Innovation In Market Management By Utilizing Business Intelligence: Introducing Proposed Framework , 2012 .

[20]  Harris Wu,et al.  Assessing the quality of large-scale data standards: A case of XBRL GAAP Taxonomy , 2014, Decis. Support Syst..

[21]  Mostafa Jafari,et al.  A tool to evaluate the business intelligence of enterprise systems , 2011 .

[22]  Peralta Costabel,et al.  Data quality evaluation in data integration systems , 2006 .

[23]  James J. Cappel,et al.  CEO and CIO perspectives on competitive intelligence , 1999, CACM.

[24]  Samira Si-Said Cherfi,et al.  A Framework for Quality Evaluation in Data Integration Systems , 2007, ICEIS.

[25]  Antti Lönnqvist,et al.  The Measurement of Business Intelligence , 2005, Inf. Syst. Manag..