Experimental Studies in Software Inspection Process - A Systematic Mapping

Background: The interest in produce experimental knowledge about verification and validation techniques increases over the years. This kind of knowledge can be useful for researchers who develop studies in that area as well as for industry that can make decisions about verification and validation activities (V&V) on the basis of experimental results. Aim: This paper aims to map the empirical studies conducted in the software inspection process area. Method: Each step of the Systematic Mapping (SM) process was performed with the support of the StArt tool, and the papers from major databases, journals, conferences, and workshops were covered. Results: Seventy nine papers were accepted in this mapping and helped identifying the inspection processes, techniques and tools commonly referenced in that papers, as well as the artifacts usually inspected and the research groups and universities frequently involved in these papers. Conclusion: Different inspection processes have been investigated through experimental studies, and the Fagan’s process is the most investigated of them. To evaluate these different processes requirements document and source code were the artifacts more used. Besides, different tools and techniques have been used to support these processes. Some important lessons were learned, which are in accordance to explanations of others authors.

[1]  Stephen G. Eick,et al.  Estimating software fault content before coding , 1992, International Conference on Software Engineering.

[2]  Adam A. Porter,et al.  Reducing Inspection Interval in Large-Scale Software Development , 2002, IEEE Trans. Software Eng..

[3]  John M Colford,et al.  Systematic reviews and meta-analyses: an illustrated, step-by-step guide. , 2004, The National medical journal of India.

[4]  Audris Mockus,et al.  Understanding the sources of variation in software inspections , 1998, TSEM.

[5]  Stefan Biffl,et al.  Investigating the Impact of Active Guidance on Design Inspection , 2005, PROFES.

[6]  Peter J. Middleton,et al.  Software Inspection , 1994, J. Inf. Technol..

[7]  Paul Anderson,et al.  Design and Implementation of a Fine-Grained Software Inspection Tool , 2003, IEEE Trans. Software Eng..

[8]  Jeffrey C. Carver,et al.  Evaluation of capture-recapture models for estimating the abundance of naturally-occurring defects , 2008, ESEM '08.

[9]  Adam A. Porter,et al.  Comparing Detection Methods for Software Requirements Inspections: A Replicated Experiment , 1995, IEEE Trans. Software Eng..

[10]  Stefan Biffl,et al.  Investigating the impact of reading techniques on the accuracy of different defect content estimation techniques , 2001, Proceedings Seventh International Software Metrics Symposium.

[11]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[12]  Daniela Cruzes,et al.  Recommended Steps for Thematic Synthesis in Software Engineering , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[13]  Fredrik Törner,et al.  Defects in automotive use cases , 2006, ISESE '06.

[14]  Kasper Hornbæk,et al.  Metaphors of human thinking for usability inspection and design , 2008, TCHI.

[15]  Paul A. Strooper,et al.  Maximising the information gained from an experimental analysis of code inspection and static analysis for concurrent java components , 2006, ISESE '06.

[16]  L. Moonen,et al.  Prioritizing Software Inspection Results using Static Profiling , 2006, 2006 Sixth IEEE International Workshop on Source Code Analysis and Manipulation.

[17]  James Miller,et al.  Estimating the number of remaining defects after inspection , 1999, Softw. Test. Verification Reliab..

[18]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[19]  Jeffrey C. Carver,et al.  PBR vs. checklist: a replication in the n-fold inspection context , 2006, ISESE '06.

[20]  Michael E. Fagan Advances in software inspections , 1986, IEEE Transactions on Software Engineering.

[21]  Claes Wohlin,et al.  An Experimental Evaluation of an Experience-Based Capture-Recapture Method in Software Code Inspections , 1998, Empirical Software Engineering.

[22]  Michael E. Fagan Design and Code Inspections to Reduce Errors in Program Development , 1976, IBM Syst. J..

[23]  Craig K. Tyran,et al.  Improving software inspections with group process support , 2002, CACM.

[24]  Padmal Vitharana,et al.  Computer-Mediated Group Support, Anonymity, and the Software Inspection Process: An Empirical Investigation , 2003, IEEE Trans. Software Eng..

[25]  Carmelo Ardito,et al.  A tool to support usability inspection , 2006, AVI '06.

[26]  Frank Elberzhager,et al.  Unifying Inspection Processes to Create a Framework to Support Static Quality Assurance Planning , 2007, 33rd EUROMICRO Conference on Software Engineering and Advanced Applications (EUROMICRO 2007).

[27]  Natalia Juristo Juzgado,et al.  Developing search strategies for detecting relevant experiments , 2009, Empirical Software Engineering.

[28]  James Miller,et al.  A process for asynchronous software inspection , 1997, Proceedings Eighth IEEE International Workshop on Software Technology and Engineering Practice incorporating Computer Aided Software Engineering.

[29]  Pearl Brereton,et al.  Presenting software engineering results using structured abstracts: a randomised experiment , 2008, Empirical Software Engineering.

[30]  Thomas Thelin,et al.  Team-based fault content estimation in the software inspection process , 2004, Proceedings. 26th International Conference on Software Engineering.

[31]  Diane Kelly,et al.  Task-directed software inspection technique: an experiment and case study , 2000, CASCON.

[32]  Guilherme Horta Travassos,et al.  A computational framework for supporting software inspections , 2004, Proceedings. 19th International Conference on Automated Software Engineering, 2004..

[33]  Cleiton Silva,et al.  Managing Literature Reviews Information through Visualization , 2018, ICEIS.

[34]  Thomas Thelin,et al.  Empirical Evaluations of Usage-Based Reading and Fault Content Estimation for Software Inspections , 2003, Empirical Software Engineering.

[35]  Guilherme Horta Travassos,et al.  Introdução à Engenharia de Software Experimental , 2002 .

[36]  Chris Sauer,et al.  Technical Reviews: A Behaviorally Motivated Program of Research , 2022 .

[37]  Watts S. Humphrey,et al.  Managing the software process , 1989, The SEI series in software engineering.

[38]  Dietmar Pfahl,et al.  Reporting guidelines for controlled experiments in software engineering , 2005, 2005 International Symposium on Empirical Software Engineering, 2005..

[39]  Roel Wieringa,et al.  Requirements engineering paper classification and evaluation criteria: a proposal and a discussion , 2005, Requirements Engineering.

[40]  Stefan Biffl,et al.  A groupware-supported inspection process for active inspection management , 2002, Proceedings. 28th Euromicro Conference.

[41]  Manoel G. Mendonça,et al.  The Use of Reading Technique and Visualization for Program Understanding , 2009, SEKE.

[42]  Filippo Lanubile,et al.  Tool support for geographically dispersed inspection teams , 2003, Softw. Process. Improv. Pract..

[43]  Forrest Shull,et al.  The empirical investigation of Perspective-Based Reading , 1995, Empirical Software Engineering.

[44]  Wei-Tek Tsai,et al.  An experimental study of fault detection in user requirements documents , 1992, TSEM.

[45]  Pearl Brereton,et al.  Evidence relating to Object-Oriented software design: A survey , 2007, First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007).

[46]  Miguel Toro,et al.  A controlled experiment for evaluating a metric-based reading technique for requirements inspection , 2004, 10th International Symposium on Software Metrics, 2004. Proceedings..

[47]  Barbara Kitchenham,et al.  Procedures for Performing Systematic Reviews , 2004 .

[48]  Adam A. Porter,et al.  Anywhere, Anytime Code Inspections: Using the Web to Remove Inspection Bottlenecks in Large-Scale Software Development , 1997, Proceedings of the (19th) International Conference on Software Engineering.