A Systematic Mapping Study on Software Comments Analysis

Context: Mining software repositories has been used as an important tool to support software engineering research. Recent studies indicate that code comments are one of the most explored objects of analysis in the area. Objective: This work investigates how analysis of comments has been used to support software engineering activities by identifying its purposes, focuses, techniques, tools, evaluation methods, and the research type performed in the area. Method: We performed a systematic mapping study of the literature that considered papers from 1990 to 2016. Results: We analyzed 36 primary studies. The collected data pointed out that comment analysis has been used mainly for understanding and identifying the quality of software artifacts. The Dictionary/Vocabulary and Natural Language Processing are among the most used techniques, and most of them are performed in a semiautomatic way. We also organized a set of tools that have been used for mining software comments. Most of the primary studies are a solution proposal paper. Regarding evaluation methods, we found that experiments and case studies are the most considered. Conclusion: The results of this mapping study can help to identify points that still require further investigation in comment analysis research. Keywords-Code comment analysis; mining software repository; systematic mapping study.

[1]  Jonathan I. Maletic,et al.  A survey and taxonomy of approaches for mining software repositories in the context of software evolution , 2007, J. Softw. Maintenance Res. Pract..

[2]  Michael W. Godfrey,et al.  The MSR Cookbook: Mining a decade of research , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[3]  Mário André de Freitas Farias,et al.  Investigating the Use of a Contextualized Vocabulary in the Identification of Technical Debt: A Controlled Experiment , 2016, ICEIS.

[4]  Serge Demeyer,et al.  Happy Birthday! A trend analysis on past MSR papers , 2013, 2013 10th Working Conference on Mining Software Repositories (MSR).

[5]  A.E. Hassan,et al.  The road ahead for Mining Software Repositories , 2008, 2008 Frontiers of Software Maintenance.

[6]  Mário André de Freitas Farias,et al.  A systematic mapping study on mining software repositories , 2016, SAC.

[7]  Mário André de Freitas Farias,et al.  A Contextualized Vocabulary Model for identifying technical debt on code comments , 2015, 2015 IEEE 7th International Workshop on Managing Technical Debt (MTD).

[8]  Forrest Shull,et al.  Identification and management of technical debt: A systematic mapping study , 2016, Inf. Softw. Technol..

[9]  Roel Wieringa,et al.  Requirements engineering paper classification and evaluation criteria: a proposal and a discussion , 2005, Requirements Engineering.

[10]  Pearl Brereton,et al.  Lessons from applying the systematic literature review process within the software engineering domain , 2007, J. Syst. Softw..

[11]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.