Metrics and Models for Evaluating the Quality of ERP Software

ERP system provides a central system that integrates most of the core business processes such as human resources, finance, production, and so on. Due to the integration of such complicated functionalities and rapidly evolving customers expectation, ERP systems evaluation has an important impact on organization business success. The aim of this chapter is to understand the evaluation approaches of the ERP systems, and then to map the identified primary studies into a classification scheme to answer the research questions. A systematic mapping study was employed. A total of 36 studies published between the years 2002 and 2018 were collected, analyzed, classified, and discussed. A list of relevant ERP quality attributes that have been measured is identified. Reliability of the metrics methodology and the validity of indicator generated by the metric are two major issues in the current research. It is worth noting that while both the academic and professional literature has shown a great interact in ERP, there does not exist an evaluation approach that is widely accepted. Metrics and Models for Evaluating the Quality of ERP Software: Systematic Mapping Review

[1]  Yvonne Dittrich,et al.  ERP Customization as Software Engineering: Knowledge Sharing and Cooperation , 2009, IEEE Software.

[2]  Mohammad I. Muhairat,et al.  Evaluating the Quality of Software in ERP Systems Using the ISO 9126 Model , 2013 .

[3]  Veena Bansal,et al.  A Metric for ERP Complexity , 2008, BIS.

[4]  Saumyendu Ghosh,et al.  Understanding End-Users’ Acceptance of Enterprise Resource Planning (ERP) System in Project-Based Sectors , 2012, IEEE Transactions on Engineering Management.

[5]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[6]  Jawad Javed Akbar Baig,et al.  Measuring reusability during requirement engineering of an ERP implementation , 2017, 2017 Eighth International Conference on Intelligent Computing and Information Systems (ICICIS).

[7]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A tertiary study , 2010, Inf. Softw. Technol..

[8]  Akash Singh,et al.  Evaluation criteria for assessing the usability of ERP systems , 2009, SAICSIT '09.

[9]  Gyusun Hwang.  Operational Performance Metrics in Manufacturing Process: Based on SCOR Model and RFID Technology , 2014 .

[10]  G. T. Thampi,et al.  Investigation of Quality Benefits of ERP Implementation in Indian SMEs , 2015 .

[11]  Stefan Koch,et al.  ERP Implementation Effort Estimation Using Data Envelopment Analysis , 2006, BIS.

[12]  Abdul Azim Abdul Ghani,et al.  A mapping study to investigate component-based software system metrics , 2013, J. Syst. Softw..

[13]  Jawad Javed Akbar Baig,et al.  Evaluation of agile methods for quality assurance and quality control in ERP implementation , 2017, 2017 Eighth International Conference on Intelligent Computing and Information Systems (ICICIS).

[14]  Srinarayan Sharma,et al.  Impact of customization over software quality in ERP projects: an empirical study , 2016, Software Quality Journal.

[15]  Kridanto Surendro,et al.  Academic Cloud ERP Quality Assessment Model , 2016 .

[16]  Gheorghe Sabau,et al.  An evaluation framework for higher education ERP systems , 2009 .

[17]  Eric Bouwers,et al.  Multidimensional Software Monitoring Applied to ERP , 2009, Electron. Notes Theor. Comput. Sci..

[18]  S. Parthasarathy,et al.  Significance of Software Metrics in ERP Projects , 2006, 2006 Annual IEEE India Conference.

[19]  Lerina Aversano,et al.  Evaluating the Quality of Free/Open Source ERP Systems , 2010, ICEIS.

[20]  Diane M. Strong,et al.  A framework for evaluating ERP implementation choices , 2004, IEEE Transactions on Engineering Management.

[21]  Michela Montesi,et al.  From conference to journal publication: How conference papers in software engineering are extended for publication in journals , 2008 .

[22]  Ali Sellami,et al.  Complexity Metrics for Component-based Software Systems: Developer Perspective , 2018 .

[23]  Rodney Gleghorn.  Enterprise application integration: a manager's perspective , 2005, IT Professional.

[24]  Seyyed Mohammad Tabatabaei Mehrizi,et al.  ERP software quality assessment using fuzzy VIKOR , 2015 .

[25]  Rusli Abdullah,et al.  Developing general view of quality models for e-learning from developers perspective , 2010 .

[26]  Maya Daneva.  Complementing approaches in ERP effort estimation practice: an industrial study , 2008, PROMISE '08.

[27]  C. Guido,et al.  A Methodological Proposal to Assess the Feasibility of ERP Systems Implementation Strategies , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[28]  Carlos Soubervielle-Montalvo,et al.  Source code metrics: A systematic mapping study , 2017, J. Syst. Softw..

[29]  Alexandros Garefalakis,et al.  Healthcare Firms and the ERP Systems , 2016 .

[30]  Björn Johansson,et al.  Software tools for requirements management in an ERP system context , 2010, SAC '10.

[31]  Yan Xu,et al.  A review of literature on Enterprise Resource Planning systems , 2008, 2008 International Conference on Service Systems and Service Management.

[32]  Sokyna M. Al-Qatawneh,et al.  Evaluation of ERP Systems Quality Model Using Analytic Hierarchy Process (AHP) Technique , 2014 .

[33]  Wang Huifen,et al.  Evaluation ERP II Application Performance from Institutional Theory View , 2010, 2010 Second World Congress on Software Engineering.

[34]  Srinarayan Sharma,et al.  Efficiency analysis of ERP packages - A customization perspective , 2016, Comput. Ind..

[35]  Attila Selmeci,et al.  Key Performance Indicators used in ERP performance measurement applications , 2012, 2012 IEEE 10th Jubilee International Symposium on Intelligent Systems and Informatics.

[36]  Krasimira Stoilova,et al.  Functional analysis of enterprise resource planning systems , 2008, CompSysTech.

[37]  Onur Demirörs,et al.  Effort estimation methods for ERP projects based on function points: a case study , 2017, IWSM-Mensura.

[38]  Charlie C. Chen,et al.  Managing ERP Implementation Failure: A Project Management Perspective , 2009, IEEE Transactions on Engineering Management.

[39]  Irfan Ertugrul,et al.  The Usage of Fuzzy Quality Control Charts to Evaluate Product Quality and an Application , 2007, Analysis and Design of Intelligent Systems using Soft Computing Techniques.

[40]  Shari Lawrence Pfleeger,et al.  Towards a Framework for Software Measurement Validation , 1995, IEEE Trans. Software Eng..

[41]  José Esteves,et al.  MEASURING SUSTAINED MANAGEMENT SUPPORT IN ERPIMPLEMENTATION PROJECTS: A GQM APPROACH , 2002 .

[42]  Aldo Quelopana,et al.  Understanding the landscape of research in Enterprise Resource Planning (ERP) systems adoption , 2018, ICCMB '18.

[43]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[44]  Touseef Tahir,et al.  A Systematic Mapping Study on Software Measurement Programs in SMEs , 2018, e Informatica Softw. Eng. J..

[45]  N. Anbazhagan,et al.  Evaluating ERP Implementation Choices Using AHP , 2007, Int. J. Enterp. Inf. Syst..

[46]  Anil Kumar,et al.  Metric based efficiency analysis of educational ERP system usability-using fuzzy model , 2015, 2015 Third International Conference on Image Information Processing (ICIIP).

[47]  Rogério Atem de Carvalho,et al.  Development Support Tools for Enterprise Resource Planning , 2008, IT Professional.

[48]  Lerina Aversano,et al.  Quality evaluation of floss projects: Application to ERP systems , 2013, Inf. Softw. Technol..

[49]  Jon Patrick,et al.  A Framework for Assessing ERP Systems' Functionality for the SMEs in Australia , 2002 .

[50]  Charmain Cilliers,et al.  Qualitative techniques for evaluating enterprise resource planning (ERP) user interfaces , 2010, SAICSIT '10.