EMPIRICAL STUDIES ON THE IMPACT OF SOFTWARE CUSTOMIZATION ON QUALITY ATTRIBUTES: A SYSTEMATIC REVIEW

Software needs to deliver acceptable levels of quality, whilst meeting the functional demands of users. This need is gaining more consideration in Enterprise Resource Planning (ERP) and multi-tenant software. This study investigated the effect of software customization on external quality attributes via four pertinent primary studies, which were summarized, aggregated, discussed and presented through a systematic literature review. The primary studies in this review were chosen through the application of inclusion and exclusion criteria to applicable articles published during the period 2000-2016; they were analysed using research questions that focused on software customization, software quality attributes and measures, approaches, and impact results. The results revealed that each primary study had been applied in the context of ERP and demonstrated that different types of customizations can have various effects on particular quality attributes. Accordingly, further research is needed to determine the impact of customization on each external quality attribute.

[1]  Guilherme Horta Travassos,et al.  Cross versus Within-Company Cost Estimation Studies: A Systematic Review , 2007, IEEE Transactions on Software Engineering.

[2]  Mona Misfer Al-Shardan,et al.  Configuration as a Service in Multi-Tenant Enterprise Resource Planning System , 2015 .

[3]  Zhongbo Jiang,et al.  Study of Software as a Service Support Platform for Small and Medium Businesses , 2011 .

[4]  Srinarayan Sharma,et al.  Impact of customization over software quality in ERP projects: an empirical study , 2016, Software Quality Journal.

[5]  Félix García,et al.  Requirements and constructors for tailoring software processes: a systematic literature review , 2012, Software Quality Journal.

[6]  Abdul Azim Abd Ghani,et al.  The five Ws taxonomy on customization of software as a service applications , 2018 .

[7]  Rodina Binti Ahmad,et al.  A systematic literature review on Enterprise Architecture Implementation Methodologies , 2015, Inf. Softw. Technol..

[8]  Houari A. Sahraoui,et al.  Analyzing Change Impact in Object-Oriented Systems , 2006, 32nd EUROMICRO Conference on Software Engineering and Advanced Applications (EUROMICRO'06).

[9]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[10]  Stefan Walraven,et al.  Middleware and Methods for Customizable SaaS , 2014 .

[11]  François Lustman,et al.  A change impact model for changeability assessment in object-oriented software systems , 2002, Sci. Comput. Program..

[12]  Rachel Harrison,et al.  Experimental assessment of the effect of inheritance on the maintainability of object-oriented systems , 2000, J. Syst. Softw..

[13]  Salma Imtiaz,et al.  Causes of requirement change - A systematic literature review , 2012, EASE.

[14]  Ben Light,et al.  The maintenance implications of the customization of ERP software , 2001, J. Softw. Maintenance Res. Pract..

[15]  Celeste See Pui Ng.  A Case Study on the Impact of Customization, Fitness, and Operational Characteristics on Enterprise-Wide System Success, User Satisfaction, and System Use , 2013, J. Glob. Inf. Manag..

[16]  Stefanie Rinderle-Ma,et al.  A systematic review on security in Process-Aware Information Systems - Constitution, challenges, and future directions , 2014, Inf. Softw. Technol..

[17]  Rodina Binti Ahmad,et al.  Impact analysis and change propagation in service-oriented enterprises: A systematic review , 2015, Inf. Syst..

[18]  Martin Molina,et al.  A tenant-based resource allocation model for scaling Software-as-a-Service applications over cloud computing infrastructures , 2013, Future Gener. Comput. Syst..

[19]  John Moses,et al.  Should we try to measure software quality attributes directly? , 2009, Software Quality Journal.

[20]  David Mauricio,et al.  A Review of Software Quality Models for the Evaluation of Software Products , 2014, ArXiv.

[21]  Marijn Janssen,et al.  Design Choices Underlying the Software as a Service (SaaS) Business Model from the User Perspective: Exploring the Fourth Wave of Outsourcing , 2012, J. Univers. Comput. Sci..

[22]  Muhammad Ali Babar,et al.  Identifying relevant studies in software engineering , 2011, Inf. Softw. Technol..

[23]  Rachel Harrison,et al.  An exploratory study of the effect of aspect-oriented programming on maintainability , 2008, Software Quality Journal.

[24]  Mingdi Xin,et al.  Software-as-a-Service Model: Elaborating Client-Side Adoption Factors , 2008, ICIS.

[25]  Srinarayan Sharma,et al.  Efficiency analysis of ERP packages - A customization perspective , 2016, Comput. Ind..

[26]  Ijcsis.  Reusability Quality Attributes and Metrics of SaaS from Perspective of Business and Provider , 2016 .

[27]  R. Schlosser,et al.  ‘Empty’ reviews and evidence-based practice , 2009 .

[28]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[29]  Gyoo Gun Lim,et al.  Using balanced scorecards for the evaluation of "Software-as-a-service" , 2013, Inf. Manag..

[30]  Paris Avgeriou,et al.  Variability in quality attributes of service-based software systems: A systematic literature review , 2013, Inf. Softw. Technol..

[31]  Wei Sun,et al.  Software as a Service: Configuration and Customization Perspectives , 2008, 2008 IEEE Congress on Services Part II (services-2 2008).

[32]  Wen-Hsien Tsai,et al.  A Study of the Impact of Business Process on the ERP System Effectiveness , 2010 .

[33]  Jonathan I. Maletic,et al.  Automatically identifying changes that impact code-to-design traceability during evolution , 2010, Software Quality Journal.

[34]  Wei-Tek Tsai,et al.  OIC: Ontology-based intelligent customization framework for SaaS , 2010, 2010 IEEE International Conference on Service-Oriented Computing and Applications (SOCA).

[35]  Mohammed Khair,et al.  Architectural design metrics as indicators of changeability of component-based software systems , 2012 .

[36]  Abdul Azim Abd Ghani,et al.  Customization of Software as a Service Application: Problems and Objectives , 2018, Journal of Computer Science & Computational Mathematics.

[37]  Lianping Chen,et al.  Towards an Evidence-Based Understanding of Electronic Data Sources , 2010, EASE.

[38]  Miroslaw Staron,et al.  Measuring the impact of changes to the complexity and coupling properties of automotive software systems , 2013, J. Syst. Softw..

[39]  Wouter Joosen,et al.  Efficient customization of multi-tenant Software-as-a-Service applications with service lines , 2014, J. Syst. Softw..

[40]  Stacy J. Prowell,et al.  The impact of requirements changes on specifications and state machines , 2009, Softw. Pract. Exp..

[41]  André Vasconcelos,et al.  SaaS (Software as a Service) - Infrastructures and Applications in Real Scenarios , 2010 .

[42]  Virginia Maria Araujo,et al.  Business and technical requirements of Software-as-a-Service: Implications in portuguese enterprise business context , 2013, ArXiv.

[43]  Daniel Robey,et al.  An exploratory study of the impacts of upgrading packaged software: a stakeholder perspective , 2011, J. Inf. Technol..

[44]  Ho-Won Jung,et al.  Validating the external quality subcharacteristics of software products according to ISO/IEC 9126 , 2007, Comput. Stand. Interfaces.

[45]  Wouter Joosen,et al.  Variability middleware for multi-tenant SaaS applications: a research roadmap for service lines , 2015, SPLC.

[46]  Ashley R. Davis.  ERP CUSTOMIZATION IMPACTS ON STRATEGIC ALIGNMENT AND SYSTEM AGILITY , 2005 .

[47]  Andrea R Fleiszer,et al.  Empty systematic reviews: hidden perils and lessons learned. , 2007, Journal of clinical epidemiology.

[48]  A. Jefferson Offutt,et al.  Algorithmic analysis of the impacts of changes to object-oriented software , 2000, Proceedings. 34th International Conference on Technology of Object-Oriented Languages and Systems - TOOLS 34.