Research on using ANP to establish a performance assessment model for business intelligence systems

In order to compete in the rigorous environment, the electronization has enabled business to deploy business intelligence (BI) systems for the purpose of decision-making. However, to avoid the ineffective experiences during the deployment, it is important to clarify the impact factors of a BI system and find out a suitable assessment method to evaluate the performance of BI systems. In this paper, an analytic network process (ANP) based assessment model was constructed to assess the effectiveness of BI systems. Furthermore, an expert questionnaire was used to filter out useful performance matrices, used as the sub-criteria of the ANP model. Finally, a real case was analyzed using the constructed ANP-based effectiveness assessment model for Business Intelligence systems. The results indicate that the most critical factors that impact the effectiveness of a BI system are: output information accuracy, conformity to the requirements, and support of organizational efficiency. Utilizing this model to assess the BI performance of the studied case, it reveals that 24% improvement in effectiveness has been reached, which consists with the perception of the management level. Therefore, this effectiveness assessment model can be used to evaluate the performances of a BI system. It can also provide performance indices and improvement directions for BI users and vendors, respectively, for the total succession in system effectiveness and satisfaction.

[1]  S. Sumathi,et al.  Data Warehousing, Data Mining, and OLAP , 2006 .

[2]  Wayne W. Eckerson.  Performance Dashboards: Measuring, Monitoring, and Managing Your Business , 2005 .

[3]  Tan Boon Wan,et al.  Validation of a user satisfaction instrument for office automation success , 1990, Inf. Manag..

[4]  T. Saaty,et al.  Dependence and independence: From linear hierarchies to nonlinear networks , 1986 .

[5]  Wen-Chin Chen,et al.  A fuzzy AHP and BSC approach for evaluating performance of IT department in the manufacturing industry in Taiwan , 2008, Expert Syst. Appl..

[6]  Erik Thomsen,et al.  OLAP Solutions - Building Multidimensional Information Systems , 1997 .

[7]  Efraim Turban,et al.  Business Intelligence: Second European Summer School, eBISS 2012, Brussels, Belgium, July 15-21, 2012, Tutorial Lectures , 2013 .

[8]  Soung Hie Kim,et al.  Using analytic network process and goal programming for interdependent information system project selection , 2000, Comput. Oper. Res..

[9]  Reza Khorramshahgol,et al.  Delphic hierarchy process (DHP): A methodology for priority setting derived from the Delphi method and analytical hierarchy process , 1988 .

[10]  Thomas L. and Beltran Miguel H. Saaty,et al.  Architectural Design by the Analytic Hierarchy Process , 1980 .

[11]  Thomas L. Saaty,et al.  Decision making with dependence and feedback : the analytic network process : the organization and prioritization of complexity , 1996 .

[12]  Thomas L. Saaty,et al.  The Analytic Hierarchy Process: Decision Making in Complex Environments , 1984 .

[13]  Ravi Shankar,et al.  Selection of logistics service provider: An analytic network process (ANP) approach , 2007 .

[14]  Joseph Sarkis,et al.  Analyzing organizational project alternatives for agile manufacturing processes: An analytical network approach , 1999 .

[15]  J. Nilges,et al.  Strategic investment planning , 2005 .

[16]  Thomas L. Saaty,et al.  Theory and Applications of the Analytic Network Process: Decision Making With Benefits, Opportunities, Costs, and Risks , 2005 .

[17]  S. Zorzut,et al.  Use of Key Performance Indicators in Production Management , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[18]  Blake Ives,et al.  The measurement of user information satisfaction , 1983, CACM.

[19]  Thomas Bäck,et al.  Adaptive business intelligence based on evolution strategies: some application examples of self-adaptive software , 2002, Inf. Sci..

[20]  Chih-Hung Tsai,et al.  The study of applying ANP model to assess dispatching rules for wafer fabrication , 2008, Expert Syst. Appl..

[21]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[22]  Wen Lea Pearn,et al.  Analytic network process (ANP) approach for product mix planning in semiconductor fabricator , 2005 .

[23]  John M. Ward,et al.  A framework for addressing the organisational issues of enterprise systems implementation , 2005, J. Strateg. Inf. Syst..