A Validation Metrics Framework for safety-critical software-intensive Systems

As software complexity continues to increase in today's systems of systems, conveyance of stakeholder requirements, development to these requirements, and validation of these requirements has become exceedingly more difficult. Safety-critical software-intensive systems of systems require significant verification to ensure that they function as per requirements. Verification is only one portion of ensuring systems function correctly and is typically a well defined activity for software development. Validation is the other portion of ensuring that software is developed to the customer's satisfaction, however is not so well defined. The traditional validation model of matching system specification to stakeholder requirements and expectations does not cater for software safety, where stakeholder requirements and expectations are simply that of a “safe” system. We introduce a new model for validation of software safety requirements by proxy. Measurement of software safety is a relatively unexplored aspect of software engineering. Proactive validation of software safety requirements necessitates metrics acting as indicators of requirements validity. This paper presents the Validation Metrics Framework, which is based on a new model for validation of software safety requirements. We demonstrate the application of the framework with a representative safety-critical software-intensive system.

[1]  Victor R. Basili,et al.  A Methodology for Collecting Valid Software Engineering Data , 1984, IEEE Transactions on Software Engineering.

[2]  H. D. Rombach,et al.  The Goal Question Metric Approach , 1994 .

[3]  Tim Kelly,et al.  A Pragmatic Approach to Reasoning about the Assurance of Safety Arguments , 2003, SCS.

[4]  Kurt Keutzer,et al.  Coverage Metrics for Functional Validation of Hardware Designs , 2001, IEEE Des. Test Comput..

[5]  Wolter J. Fabrycky,et al.  Systems engineering and analysis , 1981 .

[6]  John C. Munson,et al.  Software Engineering Measurement , 2003 .

[7]  Barry Boehm,et al.  A collaborative spiral software process model based on Theory W , 1994, Proceedings of the Third International Conference on the Software Process. Applying the Software Process.

[8]  James Bret Michael,et al.  A framework for software reuse in safety-critical system-of-systems , 2008, 2008 IEEE International Conference on System of Systems Engineering.

[9]  Ajitha Rajan,et al.  Coverage metrics for requirements-based testing , 2006, ISSTA '06.

[10]  Patrik Berander,et al.  A goal question metric based approach for efficient measurement framework definition , 2006, ISESE '06.

[12]  Jeannette M. Wing.  A specifier's introduction to formal methods , 1990, Computer.

[13]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[14]  Robert Andrew Weaver,et al.  The Safety of Software - Constructing and Assuring Arguments , 2003 .

[15]  K. Gödel.  Über formal unentscheidbare Sätze der Principia Mathematica und verwandter Systeme I , 1931 .

[16]  K. Gödel.  Über formal unentscheidbare Sätze der Principia Mathematica und verwandter Systeme I , 1931 .

[17]  Of references. , 1966, JAMA.

[18]  Peter Neumann,et al.  Safeware: System Safety and Computers , 1995, SOEN.

[19]  Ieee Std,et al.  IEEE Standard for Software Verification and Validation , 2008 .

[20]  W. W. Royce,et al.  Managing the development of large software systems , 1970 .

[21]  Gerard J. Holzmann,et al.  Validation of mission critical software design and implementation using model checking [spacecraft] , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[22]  Victor R. Basili,et al.  The TAME Project: Towards Improvement-Oriented Software Environments , 1988, IEEE Trans. Software Eng..

[23]  Patrick J. Redmond.  A System of Systems Interface Hazard Analysis Technique , 2007 .

[24]  Craig Larman,et al.  Applying UML and Patterns: An Introduction to Object-Oriented Analysis and Design and Iterative Development (3rd Edition) , 1997 .

[25]  James Bret Michael,et al.  A framework for computer-aided validation , 2008, Innovations in Systems and Software Engineering.