A Systematic Mapping Review of Software Quality Measurement: Research Trends, Model, and Method

Software quality is a key for the success in the business of information and technology. Hence, before be marketed, it needs the software quality measurement to fulfill the user requirements.  Some methods of the software quality analysis have been tested in a different perspective, and we have presented the software method in the point of view of users and experts. This study aims to map the method of software quality measurement in any models of quality. Using the method of Systematic Mapping Study, we did a searching and filtering of papers using the inclusion and exclusion criteria. 42 relevant papers have been obtained then. The result of the mapping showed that though the model of ISO SQuaRE has been widely used since the last five years and experienced the dynamics, the researchers in Indonesia still used ISO9126 until the end of 2016.The most commonly used method of the software quality measurement Method is the empirical method, and some researchers have done an AHP and Fuzzy approach in measuring the software quality.

[1]  Vidushi Sharma,et al.  Maintainability Analysis of Component Based Systems , 2011 .

[2]  Praveen Ranjan Srivastava,et al.  Quantification of Software Quality Parameters Using Fuzzy Multi Criteria Approach , 2011, 2011 International Conference on Process Automation, Control and Computing.

[3]  Luis Eduardo Mendoza,et al.  Quality Measurement Model for Analysis and Design Tools Based on FLOSS , 2008, 19th Australian Conference on Software Engineering (aswec 2008).

[4]  Min-Gyu Lee,et al.  Quality Evaluation Criteria Based on Open Source Mobile HTML5 UI Framework for Development of Cross-Platform , 2015 .

[5]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[6]  Kaan Kurtel,et al.  Measuring and Monitoring Software Maintenance Services: An Industrial Experience , 2013, 2013 Joint Conference of the 23rd International Workshop on Software Measurement and the 8th International Conference on Software Process and Product Measurement.

[7]  Eda Marchetti,et al.  A case of adoption of 25000 standards family establishing evaluation requirements in the audio-visual preservation context , 2014, 2014 9th International Conference on Software Engineering and Applications (ICSOFT-EA).

[8]  Bayu Hendradjaya,et al.  Software assessment model using metrics products for e-Government in the G2B model , 2016, 2016 4th International Conference on Information and Communication Technology (ICoICT).

[9]  Sanjay Misra,et al.  An empirical evaluation of software quality assurance practices and challenges in a developing country: a comparison of Nigeria and Turkey , 2016, SpringerPlus.

[10]  Rudolf Ferenc,et al.  A software quality model for RPG , 2015, 2015 IEEE 22nd International Conference on Software Analysis, Evolution, and Reengineering (SANER).

[11]  Haijun Yang.  Measuring Software Product Quality with ISO Standards Base on Fuzzy Logic Technique , 2012 .

[12]  Bruce McMillin,et al.  Software engineering: What is it? , 2018, 2018 IEEE Aerospace Conference.

[13]  Zhen Bai,et al.  Analytic review of usability evaluation in ISMAR , 2012, Interact. Comput..

[14]  Camelia Serban,et al.  An approach to assess maintainability change , 2016, 2016 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR).

[15]  Ajit Pratap Singh,et al.  Integrated Software Quality Evaluation: A Fuzzy Multi-Criteria Approach , 2011, J. Inf. Process. Syst..

[16]  Durga Prasad Mohapatra,et al.  Software Reliability Prediction using Fuzzy Min-Max Algorithm and Recurrent Neural Network Approach , 2016 .

[17]  Mario Piattini,et al.  Certification of IPavement applications for smart cities a case study , 2015, 2015 International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE).

[18]  Ying-xing Li,et al.  A Fuzzy Comprehensive Quality Evaluation for the Digitizing Software of Ethnic Antiquarian Resources , 2008, 2008 International Conference on Computer Science and Software Engineering.

[19]  R. Dromey,et al.  A Model for Software Product Quality , 1995, IEEE Trans. Software Eng..

[20]  Umi Laili Yuhana,et al.  Usability characteristic evaluation on administration module of Academic Information System using ISO/IEC 9126 quality model , 2015, 2015 International Seminar on Intelligent Technology and Its Applications (ISITIA).

[21]  Mohammad Kazem Akbari,et al.  Customizing ISO 9126 quality model for evaluation of B2B applications , 2009, Inf. Softw. Technol..

[22]  Wayne D. Gray,et al.  Damaged Merchandise? A Review of Experiments That Compare Usability Evaluation Methods , 1998, Hum. Comput. Interact..

[23]  Niels Jacobsen,et al.  Usability Evaluation Methods The Reliability and Usage of Cognitive Walkthrough and Usability Test , 1999 .

[24]  Chin-Tsai Lin,et al.  Model for measuring quality of software in DVRS using the gap concept and fuzzy schemes with GA , 2006, Inf. Softw. Technol..

[25]  Ali Idri,et al.  Using ISO 9126 with QoS DiffServ model for evaluating software quality in mobile environments , 2014, 2014 Second World Conference on Complex Systems (WCCS).

[26]  Eko Darwiyanto,et al.  Evaluation of academic website using ISO/IEC 9126 , 2015, 2015 3rd International Conference on Information and Communication Technology (ICoICT).

[27]  Ali Idri,et al.  Applying ISO/IEC 25010 on Mobile Personal Health Records , 2015, HEALTHINF.

[28]  Emad Kh,et al.  New Model to Achieve Software Quality Assurance (SQA) in Web Application , 2012 .

[29]  Luis Olsina,et al.  Improving Quality in Use of Web Applications in a Systematic Way , 2011, ICWE Workshops.

[30]  Sanjay Kumar Dubey,et al.  Reliability Evaluation of Software System Using AHP and Fuzzy TOPSIS Approach , 2015, SocProS.

[31]  K. K. F. Yuen,et al.  Evaluating software component quality from vendors using the primitive cognitive network process with ISO/IEC 9126 , 2012, 2012 Computing, Communications and Applications Conference.

[32]  Bayu Hendradjaya,et al.  The application model of learning management system quality in asynchronous blended learning system , 2014, 2014 International Conference on Electrical Engineering and Computer Science (ICEECS).

[33]  Mohammad I. Muhairat,et al.  A Quantitative Evaluation of ERP Systems Quality Model , 2014, 2014 11th International Conference on Information Technology: New Generations.

[34]  Yuli Fitrisia,et al.  Implementation of ISO 9126-1 quality model for asset inventory information system by utilizing object oriented metrics , 2014, 2014 International Conference on Electrical Engineering and Computer Science (ICEECS).

[35]  Peter Hegedus.  Revealing the Effect of Coding Practices on Software Maintainability , 2013, 2013 IEEE International Conference on Software Maintenance.

[36]  Aldo von Wangenheim,et al.  Software Quality Evaluation of the Laboratory Information System Used in the Santa Catarina State Integrated Telemedicine and Telehealth System , 2016, 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS).

[37]  Jim Warren,et al.  Assessment of Software Maintainability of openEHR Based Health Information Systems – A Case Study In Endoscopy , 2011 .

[38]  Sanjay Kumar,et al.  Assessment of Software Quality: Choquet Integral Approach , 2012 .

[39]  Václav Vostrovský,et al.  Agricultural E-Government: Design of Quality Evaluation Method Based on ISO SQuaRE quality Model , 2013 .

[40]  Nakornthip Prompoon,et al.  Evaluating software quality in use using user reviews mining , 2013, The 2013 10th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[41]  Umi Laili Yuhana,et al.  Academic information system quality measurement using quality instrument: A proposed model , 2014, 2014 International Conference on Data and Software Engineering (ICODSE).

[42]  Ana Belén Martínez Prieto,et al.  Sirius: A heuristic-based framework for measuring web usability adapted to the type of website , 2013, J. Syst. Softw..

[43]  David Mauricio,et al.  A Review of Software Quality Models for the Evaluation of Software Products , 2014, ArXiv.

[44]  Lukas Vojtech,et al.  Qualitative and security parameters inside middleware centric heterogeneous RFID/IoT networks, on-tag approach , 2015, 2015 38th International Conference on Telecommunications and Signal Processing (TSP).

[45]  Jörg Lenhard.  Towards Quantifying the Adaptability of Executable BPMN Processes , 2014, ZEUS.

[46]  Luis Olsina,et al.  Using Web Quality Models and Questionnaires for Web Applications Understanding and Evaluation , 2012, 2012 Eighth International Conference on the Quality of Information and Communications Technology.

[47]  Silvia Mara Abrahão,et al.  Integrating Usability Evaluation into Model-Driven Video Game Development , 2012, HCSE.

[48]  Aldo von Wangenheim,et al.  Quality Evaluation of Poison Control Information Systems: A Case Study of the DATATOX System , 2016, 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS).

[49]  V. Lakshmi Narasimhan,et al.  Some theoretical considerations for a suite of metrics for the integration of software components , 2007, Inf. Sci..

[50]  Xavier Franch,et al.  Quality models for web services: A systematic mapping , 2014, Inf. Softw. Technol..

[51]  L.S.V. Perez,et al.  MECRAD: Model and Tool for the Technical Quality Evaluation of Software Products in Visual Environment , 2008, 2008 The Third International Multi-Conference on Computing in the Global Information Technology (iccgi 2008).

[52]  Margaret Ross,et al.  Quality evaluation for Model-Driven Web Engineering methodologies , 2012, Inf. Softw. Technol..

[53]  Rafa E. Al-Qutaish.  An Investigation of the Weaknesses of the ISO 9126 International Standard , 2009, 2009 Second International Conference on Computer and Electrical Engineering.

[54]  nbspS.Sai Aparna,et al.  A Systematic Review on measuring and evaluating web usability in Model Driven Web Development , 2014 .

[55]  Muazzam Maqsood,et al.  HOW TO IMPROVE SOFTWARE QUALITY ASSURANCE IN DEVELOPING COUNTRIES , 2012 .

[56]  ISO / IEC 25010 : 2011 Systems and software engineering — Systems and software Quality Requirements and Evaluation ( SQuaRE ) — System and software quality models , 2013 .

[57]  Pieter Van Gorp,et al.  Evaluation of model transformation approaches for model refactoring , 2014, Sci. Comput. Program..