Does the duration of rapid release cycles affect the bug handling activity?

Software projects are regularly updated with new functionality and bug fixes through so-called releases. In recent years, many software projects have been shifting to shorter release cycles and this can affect the bug handling activity. Past research has focused on the impact of switching from traditional to rapid release cycles with respect to bug handling activity, but the effect of the rapid release cycle duration has not yet been studied. We empirically investigate releases of 420 open source projects with rapid release cycles to understand the effect of variable and rapid release cycle durations on bug handling activity. We group the releases of these projects into five categories of release cycle durations. For each project, we investigate how the sequence of releases is related to bug handling activity metrics and we study the effect of the variability of cycle durations on bug fixing. Our results did not reveal any statistically significant difference for the studied bug handling activity metrics in the presence of variable rapid release cycle durations. This suggests that the duration of fast release cycles does not seem to impact bug handling activity.

[1]  Sarfraz Khurshid,et al.  Understanding the triaging and fixing processes of long lived bugs , 2015, Inf. Softw. Technol..

[2]  Maleknaz Nayebi,et al.  Mining Treatment-Outcome Constructs from Sequential Software Engineering Data , 2019, IEEE Transactions on Software Engineering.

[3]  L. V. Valen,et al.  The Statistics of Variation , 2005 .

[4]  Chandrasekar Subramaniam,et al.  Determinants of open source software project success: A longitudinal study , 2009, Decis. Support Syst..

[5]  Thomas D. Gautheir.  Detecting Trends Using Spearman's Rank Correlation Coefficient , 2001 .

[6]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[7]  Laurence Duchien,et al.  On the impact of release policies on bug handling activity: A case study of Eclipse , 2021, J. Syst. Softw..

[8]  Sarfraz Khurshid,et al.  An empirical study of long lived bugs , 2014, 2014 Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering (CSMR-WCRE).

[9]  Foutse Khomh,et al.  On rapid releases and software testing: a case study and a semi-systematic literature review , 2015, Empirical Software Engineering.

[10]  M. McHugh.  Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[11]  Barry W. Boehm,et al.  Understanding and Controlling Software Costs , 1988, IEEE Trans. Software Eng..

[12]  Roberto Almeida Bittencourt,et al.  Do Rapid Releases Affect Bug Reopening? A Case Study of Firefox , 2014, 2014 Brazilian Symposium on Software Engineering.

[13]  E. S. Pearson,et al.  Tests for departure from normality: Comparison of powers , 1977 .

[14]  Christoph Treude,et al.  The impact of rapid release cycles on the integration delay of fixed issues , 2018, Empirical Software Engineering.

[15]  Hao Hu,et al.  Effective Bug Triage Based on Historical Bug-Fix Information , 2014, 2014 IEEE 25th International Symposium on Software Reliability Engineering.

[16]  Foutse Khomh,et al.  Understanding the impact of rapid releases on software quality , 2015, Empirical Software Engineering.

[17]  Premkumar T. Devanbu,et al.  Fair and balanced?: bias in bug-fix datasets , 2009, ESEC/FSE '09.

[18]  Jacques Klein,et al.  Got issues? Who cares about it? A large scale investigation of issue trackers from GitHub , 2013, 2013 IEEE 24th International Symposium on Software Reliability Engineering (ISSRE).

[19]  Daniela E. Damian,et al.  The promises and perils of mining GitHub , 2009, MSR 2014.

[20]  Shane McIntosh,et al.  Modern Release Engineering in a Nutshell -- Why Researchers Should Care , 2016, 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER).

[21]  Z. Birnbaum.  On a Use of the Mann-Whitney Statistic , 1956 .

[22]  Karen Kafadar,et al.  Letter-Value Plots: Boxplots for Large Data , 2017 .

[23]  R. D'Agostino.  An omnibus test of normality for moderate and large size samples , 1971 .

[24]  Sridhar Chimalakonda,et al.  RapidRelease - A Dataset of Projects and Issues on Github with Rapid Releases , 2019, 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR).

[25]  Eleni Constantinou,et al.  A Longitudinal Analysis of Bug Handling Across Eclipse Releases , 2019, 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME).

[26]  Jing Liu,et al.  A Comparative Study of the Effects of Pull Request on GitHub Projects , 2016, 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC).