A Metrics-Guided Framework for Cost and Quality Management of Component-Based Software

The growing reliance on commercial-off-the-shelf (COTS) components for large-scale projects has introduced a new paradigm in software engineering, requiring the design of new software development methods and business processes. Large-scale component reuse leads to savings in development resources, but increases the system’s vulnerability to risks arising from third-party development, as well as integration difficulties, performance constraints, and incompatibility of components from multiple vendors. The framework discussed in this chapter aims to alleviate quality concerns for COTS-based systems by using software metrics to accurately quantify factors contributing to the overall quality of a component-based system, guiding quality and risk management by identifying and eliminating sources of risk. Tradeoffs between cost and quality in a component-based system are discussed, as well as analytical techniques and formal models for cost and quality decisions.

[1]  Robert B. Grady,et al.  Key lessons in achieving widespread inspection use , 1994, IEEE Software.

[2]  Roman B. Statnikov,et al.  Multicriteria Optimization and Engineering , 1995 .

[3]  John A. McDermid,et al.  The Cost of COTS (Interview). , 1998 .

[4]  Lionel C. Briand,et al.  A Unified Framework for Cohesion Measurement in Object-Oriented Systems , 2004, Empirical Software Engineering.

[5]  Lenos Trigeorgis,et al.  Real options and business strategy : applications to decision-making , 1999 .

[6]  Ming Zhao,et al.  Planning Models for Software Reliability and Cost , 1998, IEEE Trans. Software Eng..

[7]  Pearl Brereton,et al.  Component-Based Systems: A Classification of Issues , 2000, Computer.

[8]  Chris Abts COTS-Based Systems (CBS) Functional Density -- A Heuristic for Better CBS Design , 2002, ICCBSS.

[9]  E. Ziegel Juran's Quality Control Handbook , 1988 .

[10]  Tom Chávez,et al.  A Decision-Analytic Stopping Rule for Validation of Commercial Software Systems , 2000, IEEE Trans. Software Eng..

[11]  Mark C. Paulk,et al.  Capability Maturity Model , 1991 .

[12]  Bashar Nuseibeh Ariane 5: Who Dunnit? , 1997, IEEE Software.

[13]  Jawed I. A. Siddiqi,et al.  Challenging universal truths of requirements engineering , 1994, IEEE Software.

[14]  Robert B. Grady,et al.  Successfully applying software metrics , 1994, Computer.

[15]  R. Burnett,et al.  A trade-off method between cost and reliability , 1997, Proceedings 17th International Conference of the Chilean Computer Science Society.

[16]  Noushin Ashrafi,et al.  Software Reliability Allocation Based on Structure, Utility, Price, and Cost , 1991, IEEE Trans. Software Eng..

[17]  Jyrki Kontio,et al.  A case study in applying a systematic method for COTS selection , 1996, Proceedings of IEEE 18th International Conference on Software Engineering.

[18]  George E. Stark,et al.  Using metrics in management decision making , 1994, Computer.

[19]  Carol A. Sledge,et al.  Case Study: Evaluating COTS Products for DoD Information Systems , 1998 .

[20]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[21]  John Dean,et al.  COTS-Based Software Systems , 2001, Lecture Notes in Computer Science.

[22]  W. Wayt Gibbs,et al.  Software's Chronic Crisis , 1994 .

[23]  Barry W. Boehm,et al.  COTS-Based Systems Top 10 List , 2001, Computer.

[24]  Somesh Jha,et al.  Software Design as an Investment Activity: A Real Options Perspective , 1998 .

[25]  John A. McDermid,et al.  The Cost of COTS , 1998, Computer.

[26]  Norman F. Schneidewind Software metrics model for quality control , 1997, Proceedings Fourth International Software Metrics Symposium.

[27]  Ross D. Shachter Evaluating Influence Diagrams , 1986, Oper. Res..

[28]  Stephen Knox,et al.  Modeling the Cost of Software Quality , 1993, Digit. Tech. J..

[29]  Stephen P. Brooks,et al.  Markov Decision Processes. , 1995 .

[30]  Norman F. Schneidewind Methods for assessing COTS reliability, maintainability, and availability , 1998, Proceedings. International Conference on Software Maintenance (Cat. No. 98CB36272).

[31]  P. Utgoff,et al.  Multivariate Versus Univariate Decision Trees , 1992 .

[32]  Mayuram S. Krishnan,et al.  Evaluating the cost of software quality , 1998, CACM.

[33]  Matthew J. Fisher,et al.  Software Acquisition Capability Maturity Model (SA-CMM) Version 1.02 , 1999 .

[34]  Jon Hopkins,et al.  Component primer , 2000, CACM.

[35]  J. Schiller SECURE DISTRIBUTED COMPUTING , 1994 .

[36]  J. R J Rao,et al.  Nonlinear programming continuation strategy for one parameter design optimization problems , 1989 .

[37]  Raymond A. Paul,et al.  Object-oriented framework for metrics guided risk management , 1996, Proceedings of 20th International Computer Software and Applications Conference: COMPSAC '96.

[38]  Lionel C. Briand,et al.  Investigating quality factors in object-oriented designs: an industrial case study , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[39]  Hanscom Afb COTS Software Integration Cost Modeling Study , 1997 .

[40]  Hakan Erdogmus Comparative evaluation of software development strategies based on Net Present Value , 1999 .

[41]  Barry W. Boehm,et al.  Cost models for future software life cycle processes: COCOMO 2.0 , 1995, Ann. Softw. Eng..

[42]  Tosiyasu L. Kunii,et al.  Software Metrics Knowledge and Databases for Project Management , 1999, IEEE Trans. Knowl. Data Eng..

[43]  Jeffrey M. Voas,et al.  The Challenges Of Using COTS Software In Component-Based Development , 1998, Computer.

[44]  Barbara A. Kitchenham,et al.  An evaluation of the business object approach to software development , 2000, J. Syst. Softw..

[45]  Patricia Rodríguez-Dapena Software Safety Certification: A Multidomain Problem , 1999, IEEE Softw..

[46]  Barry W. Boehm,et al.  COTS Integration: Plug and Pray? , 1999, Computer.

[47]  Hirotaka Nakayama,et al.  Theory of Multiobjective Optimization , 1985 .

[48]  Jongmoon Baik,et al.  Empirical software simulation for COTS glue code development and integration , 2001, 25th Annual International Computer Software and Applications Conference. COMPSAC 2001.

[49]  R. T. Haftka,et al.  Tracing the Efficient Curve for Multi-objective Control-Structure Optimization , 1991 .

[50]  Michael R. Lyu,et al.  Achieving software quality with testing coverage measures , 1994, Computer.

[51]  Taghi M. Khoshgoftaar,et al.  Software Metrics: Charting the Course - Guest Editors' Introduction , 1994, Computer.

[52]  Thomas J. Haley,et al.  Software Process Improvement At Raytheon , 1996, IEEE Softw..

[53]  Min Xie On the determination of optimum software release time , 1991, Proceedings. 1991 International Symposium on Software Reliability Engineering.

[54]  J. Campanella Principles of Quality Costs: Principles, Implementation and Use , 1999 .

[55]  Nils J. Nilsson,et al.  Logic and Artificial Intelligence , 1991, Artif. Intell..

[56]  Clemens A. Szyperski,et al.  Component software - beyond object-oriented programming , 2002 .

[57]  Arne Sølvberg,et al.  Understanding quality in conceptual modeling , 1994, IEEE Software.