S.O.B (Save Our Budget) - A Simulation-Based Method for Prediction of Acquisition Costs of Constituents of a System-of-Systems

Software economics, acquisition, and pricing are important concerns for Systems-of-Systems (SoS). SoS are alliances of independent software-intensive systems combined to offer holistic functionalities as a result of the constituents interoperability. SoS engineering involves separately acquiring constituents and combining them to form the SoS. Despite the existence of cost prediction techniques, predicting SoS acquisition costs at design-time should also include the analysis of different suppliers of constituents, their respective prices and quality. However, known methods cover only two out of these three parameters. The main contribution of this article is to present the S.O.B. (Save Our Budget) method, a novel simulation-based method to predict, at design-time, the acquisition cost of constituents, while still considering quality attributes and different suppliers. Results of a case study in the Smart Building domain revealed that S.O.B. method supports a precise prediction of acquisition cost of constituents to build a SoS for that domain. Furthermore, it also contributes to estimate the cost based on a pre-established quality attribute (functional suitability), as well as to support the selection of coalition that exhibits better results through the analysis of cost-benefit ratio.

[1]  Iris Groher,et al.  The Architect's Role in Practice: From Decision Maker to Knowledge Manager? , 2016, IEEE Software.

[2]  Everton Cavalcante,et al.  A Study on Goals Specification for Systems-of-Information Systems: Design Principles and a Conceptual Model , 2018, SBSI.

[3]  Elisa Yumi Nakagawa,et al.  Model-based engineering & simulation of software-intensive systems-of-systems: experience report and lessons learned , 2018, ECSA.

[5]  Carolyn B. Seaman,et al.  Qualitative Methods in Empirical Studies of Software Engineering , 1999, IEEE Trans. Software Eng..

[6]  Jakob Axelsson An initial analysis of operational emergent properties in a platooning system-of-systems , 2018, 2018 Annual IEEE International Systems Conference (SysCon).

[7]  Bernard P. Zeigler,et al.  MBSE with/out Simulation: State of the Art and Way Forward , 2018, Syst..

[8]  Richard F. Paige,et al.  Solving Acquisition Problems Using Model-Driven Engineering , 2012, ECMFA.

[9]  Man-Tak Shing,et al.  Application of Real Options Theory to Software-intensive System Acquisitions , 2009 .

[10]  S. Lam,et al.  1.4.4 Towards a Collaborative Engineering Environment to Support Capability Engineering , 2005 .

[11]  Lina Maria Garcés Rodriguez,et al.  A process to establish, model and validate missions of systems-of-systems in reference architectures , 2017, SAC.

[12]  Akintola Akintoye,et al.  A survey of current cost estimating practices in the UK , 2000 .

[13]  Y. Asiedu,et al.  Simulation-based cost estimation under economic uncertainty using kernel estimators , 2000 .

[14]  Paul Clements,et al.  Software architecture in practice , 1999, SEI series in software engineering.

[15]  Claes Wohlin,et al.  Experimentation in software engineering: an introduction , 2000 .

[16]  I-Tung Yang,et al.  Simulation-based estimation for correlated cost elements , 2005 .

[17]  Everton Cavalcante,et al.  A Mission-Oriented Tool for System-of-Systems Modeling , 2015, 2015 IEEE/ACM 3rd International Workshop on Software Engineering for Systems-of-Systems.

[18]  Paul N. Lowe,et al.  System of systems complexity: modeling and simulation issues , 2008 .

[19]  David D Acker Defense Systems Acquisition Review Process: A History and Evaluation , 1983 .

[20]  Mark W. Maier,et al.  Architecting Principles for Systems‐of‐Systems , 1996 .

[21]  Jan Peleska,et al.  Systems of Systems Engineering , 2015 .

[22]  Paulo Cézar Stadzisz,et al.  A Brazilian survey on UML and model-driven practices for embedded software development , 2013, J. Syst. Softw..

[23]  Tayana Conte,et al.  A conceptual model to address threats to validity in controlled experiments , 2013, EASE '13.

[24]  Matthew E. Fitzgerald,et al.  Considering alternative strategies for value sustainment in systems-of-systems , 2013, 2013 IEEE International Systems Conference (SysCon).

[25]  Flávio Oquendo,et al.  Stimuli-SoS: a model-based approach to derive stimuli generators for simulations of systems-of-systems software architectures , 2017, Journal of the Brazilian Computer Society.

[26]  Antonia Bertolino,et al.  Do We Need New Strategies for Testing Systems-of-Systems? , 2018, 2018 IEEE/ACM 6th International Workshop on Software Engineering for Systems-of-Systems (SESoS).

[27]  Kai Ye,et al.  A survey on software cost estimation in the chinese software industry , 2008, ESEM '08.

[28]  Davi Viana,et al.  How Much Does It Cost? A Simulation-Based Method for Cost Prediction in Systems-of-Systems Acquisition Processes , 2018 .

[29]  Flávio Oquendo Formally describing the software architecture of Systems-of-Systems with SosADL , 2016, 2016 11th System of Systems Engineering Conference (SoSE).

[30]  Alan R. Hevner,et al.  POSITIONING AND PRESENTING DESIGN SCIENCE RESEARCH FOR MAXIMUM IMPACT 1 , 2013 .

[31]  Simon Smith,et al.  System of Systems Acquisition Trade-offs , 2014, CSER.

[32]  Barry W. Boehm,et al.  Software development cost estimation approaches — A survey , 2000, Ann. Softw. Eng..

[33]  Robert K. Yin,et al.  Case Study Research and Applications: Design and Methods , 2017 .

[34]  Flávio Oquendo,et al.  Supporting Dynamic Software Architectures: From Architectural Description to Implementation , 2015, 2015 12th Working IEEE/IFIP Conference on Software Architecture.

[35]  S. Takakuwa The Use Of Simulation In Activity-based Costing For Flexible Manufacturing Systems , 1997, Winter Simulation Conference Proceedings,.

[36]  Stephen B. Johnson,et al.  System Health Management , 2014 .

[37]  Elisa Yumi Nakagawa,et al.  Dynamic-SoS: An Approach for the Simulation of Systems-of-Systems Dynamic Architectures , 2020, Comput. J..

[38]  Flávio Oquendo,et al.  Investigating the Model-Driven Development for Systems-of-Systems , 2014, ECSAW '14.

[39]  Narendra Sharma,et al.  A comparison of software cost estimation methods : A Survey , 2012 .

[40]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[41]  Kjetil Moløkken-Østvold,et al.  A survey on software estimation in the Norwegian industry , 2004, 10th International Symposium on Software Metrics, 2004. Proceedings..

[42]  Mohamed Jmaiel,et al.  A tool for modeling SoS architectures using bigraphs , 2017, SAC.

[43]  Bernard P. Zeigler,et al.  Theory of modeling and simulation , 1976 .

[44]  Muhammad Ali Babar,et al.  Model Driven Software Security Architecture of Systems-of-Systems , 2016, 2016 23rd Asia-Pacific Software Engineering Conference (APSEC).

[45]  Flávio Oquendo,et al.  ASAS: An Approach to Support Simulation of Smart Systems , 2018, HICSS.

[46]  V. Basili Software modeling and measurement: the Goal/Question/Metric paradigm , 1992 .

[47]  John D. McGregor,et al.  The Architect's Role in Software Ecosystems Health , 2017, WASHES@ICSR.