Four Pillars for Improving the Quality of Safety-Critical Software- Reliant Systems

Studies of safety-critical software-reliant systems developed using the current practices of build-then-test show that requirements and architecture design defects make up approximately 70% of all defects, many system level related to operational quality attributes, and 80% of these defects are discovered late in the development life cycle [Redman 2010]. Exponential growth in software size and complexity has pushed the cost for the current generation of aircraft to the limit of affordability. We present four pillars of an improvement strategy for an integrate-then-build practice that result in early defect discovery and increased confidence through incremental end-to-end system validation and verification throughout the life cycle (Figure 1). • Capture of mission and safety-criticality requirements in analyzable form; • Virtual integration of the physical system, hardware platform, and software architectures through consistent analyzable architecture models; • Static analysis techniques applied to the models and actual system implementation to complement testing; and • Incremental assurance of justified confidence through consistent end-to-end evidence throughout the development life cycle.

[1]  Jörgen Hansson,et al.  Impact of Runtime Architectures on Control System Stability , 2007 .

[2]  Michael W. Whalen,et al.  A Methodology for the Design and Verification of Globally Asynchronous/Locally Synchronous Architectures , 2013 .

[3]  David Powell,et al.  Failure mode assumptions and assumption coverage , 1992, [1992] Digest of Papers. FTCS-22: The Twenty-Second International Symposium on Fault-Tolerant Computing.

[4]  Tim Kelly,et al.  The Goal Structuring Notation – A Safety Argument Notation , 2004 .

[5]  Whole Grain Label Statements Guidance for Industry and FDA Staff , 2006 .

[6]  John B. Goodenough,et al.  Reliability Validation and Improvement Framework , 2012 .

[7]  Peter H. Feiler,et al.  Challenges in Validating Safety-Critical Embedded Systems , 2009 .

[8]  Sagar Chaki,et al.  Combining Predicate and Numeric Abstraction for Software Model Checking , 2008, FMCAD.

[9]  Joost-Pieter Katoen Towards Trustworthy Aerospace Systems: An Experience Report , 2011, FMICS.

[10]  John B. Goodenough,et al.  Measuring assurance case confidence using Baconian probabilities , 2013, 2013 1st International Workshop on Assurance Cases for Software-Intensive Systems (ASSURE).

[11]  Jane Huffman Hayes Building a requirement fault taxonomy: experiences from a NASA verification and validation research project , 2003, 14th International Symposium on Software Reliability Engineering, 2003. ISSRE 2003..

[12]  G. B. Finelli,et al.  The Infeasibility of Quantifying the Reliability of Life-Critical Real-Time Software , 1993, IEEE Trans. Software Eng..

[13]  P.J. Prisaznuk,et al.  ARINC 653 role in Integrated Modular Avionics (IMA) , 2008, 2008 IEEE/AIAA 27th Digital Avionics Systems Conference.

[14]  Gregory Tassey,et al.  Prepared for what , 2007 .

[15]  Daniel Galin,et al.  Software Quality Assurance: From Theory to Implementation , 2003 .

[16]  Hoyt Lougee,et al.  SOFTWARE CONSIDERATIONS IN AIRBORNE SYSTEMS AND EQUIPMENT CERTIFICATION , 2001 .

[17]  Myron Hecht,et al.  Automated Generation of Failure Modes and Effects Analyses from AADL Architectural and Error Models , 2010 .

[18]  John B Goodenough Evaluating Software's Impact on System and System of Systems Reliability , 2010 .

[19]  Mark Klein,et al.  A practitioner's handbook for real-time analysis - guide to rate monotonic analysis for real-time systems , 1993, The Kluwer international series in engineering and computer science.

[20]  John Chilenski,et al.  Virtual Integration for Improved System Design , 2010 .

[21]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[22]  R. Timothy Stein,et al.  Software for Dependable Systems: Sufficient Evidence? , 2008 .

[23]  Darren D. Cofer,et al.  Software model checking takes off , 2010, Commun. ACM.

[24]  Barry W. Boehm,et al.  Some future trends and implications for systems and software engineering processes , 2006, Syst. Eng..

[25]  Nancy G. Leveson,et al.  Engineering a Safer World: Systems Thinking Applied to Safety , 2012 .

[26]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[27]  Ragunathan Rajkumar,et al.  Overload provisioning in mixed-criticality cyber-physical systems , 2012, TECS.

[28]  Nancy G. Leveson,et al.  A new accident model for engineering safer systems , 2004 .

[29]  L. Wrage,et al.  System Architecture Virtual Integration : A Case Study , 2010 .