Multi-Objective Optimization Approaches to Software Release Time Determination

Optimal release time determination is a typical application of software reliability models. In this decision process, reliability and cost are the two important dimensions that are generally considered. Most existing research formulates this decision process as single-objective optimization problems. Although these formulations can greatly reduce the complexity, they can hardly reflect the nature of the decision process, which is essentially a multi-objective optimization problem. More specifically, maximizing reliability and minimizing cost should be achieved simultaneously. Due to this consideration, in this paper, software release time determination is investigated by various multi-objective optimization approaches, including the trade-off analysis, multi-attribute utility theory, and physical programming approach. Numerical examples are provided for illustrative purpose. The applicability and limitations of different multi-objective optimization approaches are also discussed, which can help management to make a more reasonable decision in practice.

[1]  W. Edwards,et al.  Decision Analysis and Behavioral Research , 1986 .

[2]  A. Weale Embedded Case Study Methods: Integrating Quantitative and Qualitative Knowledge , 2003 .

[3]  Xiang Li,et al.  Sensitivity analysis of release time of software reliability models incorporating testing effort with multiple change-points , 2010 .

[4]  Tadashi Dohi,et al.  Optimal software release scheduling based on artificial neural networks , 1999, Ann. Softw. Eng..

[5]  Xin Yao,et al.  Multi-Objective Approaches to Optimal Testing Resource Allocation in Modular Software Systems , 2010, IEEE Transactions on Reliability.

[6]  P. K. Kapur,et al.  A Unified Approach for Developing Software Reliability Growth Models in the Presence of Imperfect Debugging and Error Generation , 2011, IEEE Transactions on Reliability.

[7]  Min Xie,et al.  Software Reliability Modelling , 1991, Series on Quality, Reliability and Engineering Statistics.

[8]  Yiu-Wing Leung,et al.  Optimum software release time with a given cost budget , 1992, J. Syst. Softw..

[9]  Min Xie,et al.  A study of operational and testing reliability in software reliability analysis , 2000, Reliab. Eng. Syst. Saf..

[10]  Roland W. Scholz,et al.  Embedded Case Study Methods , 2002 .

[11]  Xiang Li,et al.  Reliability analysis and optimal version-updating for open source software , 2011, Inf. Softw. Technol..

[12]  Min Xie,et al.  Risk-based software release policy under parameter uncertainty , 2011 .

[13]  Fabio Sgarbossa,et al.  A Cost Analysis of Systems Subject to Random Field Environments and Reliability , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  Michael R. Lyu,et al.  Optimal release time for software systems considering cost, testing-effort, and test efficiency , 2005, IEEE Transactions on Reliability.

[15]  Hoang Pham,et al.  A Software Cost Model with Warranty and Risk Costs , 1999, IEEE Trans. Computers.

[16]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[17]  P. Boland,et al.  Optimal times for software release when repair is imperfect , 2007 .

[18]  P. Burger Embedded Case Study Methods: Integrating Quantitative and Qualitative Knowledge , 2001 .

[19]  Yeu-Shiang Huang,et al.  Bayesian updating of optimal release time for software systems , 2009, Software Quality Journal.

[20]  Amrit L. Goel,et al.  Optimum release time for software systems based on reliability and cost criteria , 1984, J. Syst. Softw..

[21]  Amrit L. Goel,et al.  Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures , 1979, IEEE Transactions on Reliability.

[22]  Bo Yang,et al.  A Study of Uncertainty in Software Cost and Its Impact on Optimal Software Release Time , 2008, IEEE Transactions on Software Engineering.

[23]  Tadashi Dohi,et al.  Determination of the optimal software release time based on proportional hazards software reliability growth models , 2003 .

[24]  Hoang Pham Software Reliability , 1999 .

[25]  Achille Messac,et al.  Physical programming - Effective optimization for computational design , 1996 .

[26]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[27]  Thong Ngee Goh,et al.  Adaptive ridge regression system for software cost estimating on multi-collinear datasets , 2010, J. Syst. Softw..

[28]  Michael R. Lyu,et al.  Estimation and Analysis of Some Generalized Multiple Change-Point Software Reliability Models , 2011, IEEE Transactions on Reliability.

[29]  Yeu-Shiang Huang,et al.  The determination of optimal software release times at different confidence levels with consideration of learning effects , 2008, Softw. Test. Verification Reliab..

[30]  Shigeru Yamada,et al.  Cost-Reliability Optimal Release Policies for Software Systems , 1985, IEEE Transactions on Reliability.

[31]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.