Evaluating Australia's most complex system-of-systems, the future submarine: A case for using new Complex Systems Governance

As many systems grew in complexity and connected to other existing systems, the concept of Systems of Systems (SoS) was developed to explain the behavior, operation and design of these more complex and inter-connected systems. Early research recognized the difficulty in classic testing and evaluating (T&E) for these SoS. Much effort has been expended attempting to predict the emergent behaviors in SoSs, developing and executing T&E programs involving more sophisticated multi-factor and multi-response statistical techniques, and then recovering when some unpredicted emergent behaviors were discovered despite these efforts. Recently, an emerging concept of Complex System Governance (CSG) has been developed as yet another weapon in the armory for managing development of complex interdependent capability architectures. CSG is based on a firm grounding in System Theory and Management Cybernetics. The potential application of robust CSG structure to reduce or mitigate emergent T&E surprises is proposed in this paper. Using Australia's Future Submarine (FSM) program as an illustration, this paper has examined the need for such an application, examine several of the governance propositions focused on the developmental T&E regime and provided potential areas to leverage the efficacy of this approach to such major development programs.

[1]  Charles B. Keating,et al.  Complex system governance reference model , 2015, Int. J. Syst. Syst. Eng..

[2]  James S. Campbell C3 SYSTEMS LAND‐BASED TESTING , 1980 .

[3]  John A. Cairns DDG51 Class Land Based Engineering Site (LBES) – The Vision and the Value , 2011 .

[4]  Jo Ann Lane,et al.  Systems of systems test and evaluation challenges , 2010, 2010 5th International Conference on System of Systems Engineering.

[5]  Scott C. Truver,et al.  It is Not Just Hardware and Software, Anymore! Human Systems Integration in US Submarines , 2011 .

[6]  David B. McGUIGAN,et al.  SHIP SYSTEMS TEST PROCESS - CONCEPT AND APPLICATION: NAVSSES FULL SCALE SHIP SYSTEMS TESTING , 2011 .

[7]  Cynthia F. Kurtz,et al.  The new dynamics of strategy: sense-making in a complex and complicated world , 2003, IEEE Engineering Management Review.

[8]  F. S. Underwood,et al.  LAND BASED TEST SITE: A TOOL FOR SYSTEM INTEGRATION AND TEST , 1975 .

[9]  Joseph T. Threston The AEGIS Combat System , 2009 .

[10]  Keith F. Joiner,et al.  Australia’s future submarine: shaping early adaptive designs through test and evaluation , 2016 .

[11]  William M. Johnson The A‐RCI Process — Leadership and Management Principles , 2004 .

[12]  Michael Boudreau Acoustic Rapid COTS Insertion: A Case Study in Modular Open Systems Approach for Spiral Development , 2007, 2007 IEEE International Conference on System of Systems Engineering.

[13]  Elliot Axelband,et al.  Rapid Acquisition and Fielding for Information Assurance and Cyber Security in the Navy , 2013 .

[14]  Mahmoud Efatmaneshnik,et al.  Complexity and fragility in system of systems , 2016, Int. J. Syst. Syst. Eng..

[15]  Elena Sitnikova,et al.  Structuring defence cyber-survivability T and E to research best practice in cyber-resilient systems , 2016 .

[16]  Keith F. Joiner,et al.  How Australia can catch up to U.S. cyber resilience by understanding that cyber survivability test and evaluation drives defense investment , 2017, Inf. Secur. J. A Glob. Perspect..

[17]  Mahmoud Efatmaneshnik,et al.  A general framework for measuring system complexity , 2016, Complex..