Predicting Release Time for Open Source Software Based on the Generalized Software Reliability Model

There is a significant challenge that how to predict the possible release date of the target software having enough reliability in agile development where incremental development and small software releases are key characteristics. Existing approaches targeting agile development usually use release backlogs for predicting and setting delivery windows, however these do not consider the reliability of software for release date prediction so that there is a possibility that software at the predicted release date have poor reliability. Previously we proposed a generalized software reliability model (GSRM) based on a stochastic process and compared it with other models to evaluate recent software developments. However, we, did not directly evaluate the accuracy of the predicted release time by model. In this paper, towards prediction of release dates in agile development, we focus on the release dates of open source software (OSS) developments and the number of detected issues (faults) since OSS developments comply well with the definition of the agile development in terms of incremental process and frequent releases We define the accuracy of the predicted release time using the given development terms and the number of issues. Additionally, we propose a method to evaluate the accuracy of the predicted release time. In the best case, GSRM shows only 0.572% Error Rate, which corresponds to a predicted release date of two days prior to the actual release date. We believe that our method should be applicable to agile developments too.

[1]  Hironori Washizaki,et al.  Predicting Release Time Based on Generalized Software Reliability Model (GSRM) , 2014, 2014 IEEE 38th Annual Computer Software and Applications Conference.

[2]  Shunji Osaki,et al.  Software Reliability Measurement and Assessment with Stochastic Differential Equations (Special Section on Reliability) , 1994 .

[3]  Tadashi Dohi,et al.  Towards quantitative software reliability assessment in incremental development processes , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[4]  T. Dohi,et al.  Software reliability assessment models based on cumulative Bernoulli trial process , 2003 .

[5]  Elisabeth A. Nguyen,et al.  The Importance of Data Quality in Software Reliability Modeling , 2010, 2010 IEEE 21st International Symposium on Software Reliability Engineering.

[6]  Hironori Washizaki,et al.  Estimate of the Appropriate Iteration Length in Agile Development by Conducting Simulation , 2012, 2012 Agile Conference.

[7]  Vinay Tiwari,et al.  Some Observations On Open Source Software Development On Software Engineering Perspectives , 2010 .

[8]  Siau-Cheng Khoo,et al.  A discriminative model approach for accurate duplicate bug report retrieval , 2010, 2010 ACM/IEEE 32nd International Conference on Software Engineering.

[9]  Amrit L. Goel,et al.  Software Reliability Models: Assumptions, Limitations, and Applicability , 1985, IEEE Transactions on Software Engineering.

[10]  Kazimierz Worwa,et al.  Control and Cybernetics a Discrete-time Software Reliability-growth Model and Its Application for Predicting the Number of Errors Encountered during Program Testing , 2022 .

[11]  Richard P. Gabriel,et al.  Innovation Happens Elsewhere , 2005 .

[12]  Shigeru Yamada,et al.  S-Shaped Reliability Growth Modeling for Software Error Detection , 1983, IEEE Transactions on Reliability.

[13]  Rajesh Jugulum The Importance of Data Quality , 2014 .

[14]  Norman F. Schneidewind,et al.  A Complexity Reliability Model , 2009, 2009 20th International Symposium on Software Reliability Engineering.

[15]  Hironori Washizaki,et al.  A Generalized Software Reliability Model Considering Uncertainty and Dynamics in Development , 2013, PROFES.

[16]  Nesar Ahmad,et al.  Analysis and Ranking of Software Reliability Models Based on Weighted Criteria Value , 2013 .

[17]  Tadashi Dohi,et al.  A Multi-factor Software Reliability Model Based on Logistic Regression , 2010, 2010 IEEE 21st International Symposium on Software Reliability Engineering.

[18]  Shigeru Yamada,et al.  Lognormal Process Software Reliability Modeling with Testing-Effort , 2013 .

[19]  Pekka Abrahamsson,et al.  Is Open Source Software Development Essentially an Agile Method , 2003 .

[20]  Yasuyuki Tanaka,et al.  Predicting Time Range of Development Based on Generalized Software Reliability Model , 2014, 2014 21st Asia-Pacific Software Engineering Conference.

[21]  Akito Monden,et al.  Empirical Evaluation of an SVM-based Software Reliability Model , 2006 .

[22]  Shigeru Yamada,et al.  TESTING-DOMAIN DEPENDENT SOFTWARE RELIABILITY MODELS , 1992 .

[23]  Richard P. Gabriel,et al.  Innovation happens elsewhere - open source as business strategy , 2005 .

[24]  Yoshinobu Tamura,et al.  A flexible stochastic differential equation model in distributed development environment , 2006, Eur. J. Oper. Res..

[25]  Richard Lai,et al.  A Detailed Study of NHPP Software Reliability Models (Invited Paper) , 2012, J. Softw..

[26]  Yves Le Traon,et al.  Testing Security Policies: Going Beyond Functional Testing , 2007, The 18th IEEE International Symposium on Software Reliability (ISSRE '07).

[27]  Takashi Sasaki,et al.  Multistage Growth Model for Code Change Events in Open Source Software Development: An Example Using Development of Nagios , 2014, 2014 40th EUROMICRO Conference on Software Engineering and Advanced Applications.