A Combinatorial Approach for Exposing Off-Nominal Behaviors

Off-nominal behaviors (ONBs) have been a major concern in the areas of embedded systems and safety-critical systems. To address ONB problems, some researchers have proposed model-based approaches that can expose ONBs by analyzing natural language requirements documents. While these approaches produced promising results, they require a lot of human effort and time. In this paper, to reduce human effort and time, we propose a combinatorial–based approach, Combinatorial Causal Component Model (Combi-CCM), which uses structured requirements patterns and combinations generated using the IPOG algorithm. We conducted an empirical study using several requirements documents to evaluate our approach, and our results indicate that the proposed approach can reduce human effort and time while maintaining the same ONB exposure ability obtained by the control techniques.

[1]  Alistair Mavin,et al.  Easy Approach to Requirements Syntax (EARS) , 2009, 2009 17th IEEE International Requirements Engineering Conference.

[2]  David L. Iverson Inductive System Health Monitoring , 2004, IC-AI.

[3]  Norman E. Fenton,et al.  Decision Support Software for Probabilistic Risk Assessment Using Bayesian Networks , 2014, IEEE Software.

[4]  Jeff Yu Lei,et al.  Estimating t-Way Fault Profile Evolution During Testing , 2016, 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC).

[5]  Jeff Yu Lei,et al.  IPOG/IPOG‐D: efficient test generation for multi‐way combinatorial testing , 2008, Softw. Test. Verification Reliab..

[6]  Rene Hexel,et al.  Failure mode and effects analysis (FMEA) and model-checking of software for embedded systems by sequential scheduling of vectors of logic-labelled finite-state machines , 2012 .

[7]  Kirsten Winter,et al.  Slicing Behavior Tree Models for Verification , 2010, IFIP TCS.

[8]  Irem Y. Tumer,et al.  Modeling and Analysis of Safety in Early Design , 2013, CSER.

[9]  Daniel M. Berry,et al.  Ambiguity in Natural Language Requirements Documents , 2008, Monterey Workshop.

[10]  Andrew Kennedy,et al.  Modeling Off-Nominal Behavior in SysML , 2012, Infotech@Aerospace.

[11]  Doo-Hwan Bae,et al.  Deriving Data Dependence from/for UML State Machine Diagrams , 2011, 2011 Fifth International Conference on Secure Software Integration and Reliability Improvement.

[12]  Insup Lee,et al.  Assurance Cases in Model-Driven Development of the Pacemaker Software , 2010, ISoLA.

[13]  Nancy G. Leveson,et al.  Role of Software in Spacecraft Accidents , 2004 .

[14]  Ji Wang,et al.  Slicing Hierarchical Automata for Model Checking UML Statecharts , 2002, ICFEM.

[15]  Irem Y. Tumer,et al.  A Graph-Based Fault Identification and Propagation Framework for Functional Design of Complex Systems , 2008 .

[16]  Pierre-Yves Schobbens,et al.  State machine flattening, a mapping study and tools assessment , 2014, 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW).

[17]  Hyunsook Do,et al.  Exposing the susceptibility of off-nominal behaviors in reactive system requirements , 2015, 2015 IEEE 23rd International Requirements Engineering Conference (RE).

[18]  Kevin Lano Slicing of UML state machines , 2009 .

[19]  Luisa Mich,et al.  Market research for requirements analysis using linguistic tools , 2004, Requirements Engineering.

[20]  Alistair Mavin Listen, Then Use EARS , 2012, IEEE Software.

[21]  Antti Valmari,et al.  The State Explosion Problem , 1996, Petri Nets.

[22]  Giorgio Calanni Fraccone,et al.  Novel Air Traffic Procedures: Investigation of Off-Nominal Scenarios and Potential Hazards , 2011 .

[23]  Christine M. Belcastro,et al.  Validation and Verification (V&V) of Safety-Critical Systems Operating Under Off-Nominal Conditions , 2012 .

[24]  Yung-Ruei Chang,et al.  Reliability and Sensitivity Analysis of Embedded Systems with Modular Dynamic Fault Trees , 2005, TENCON 2005 - 2005 IEEE Region 10 Conference.

[25]  Marios M. Polycarpou,et al.  Neural network based fault detection in robotic manipulators , 1998, IEEE Trans. Robotics Autom..

[26]  Becky L. Hooey,et al.  IMPROVING EVALUATION AND SYSTEM DESIGN THROUGH THE USE OF OFF-NOMINAL TESTING: A METHODOLOGY FOR SCENARIO DEVELOPMENT , 2003 .

[27]  Alistair Mavin,et al.  Big Ears (The Return of "Easy Approach to Requirements Engineering") , 2010, 2010 18th IEEE International Requirements Engineering Conference.

[28]  Irem Y. Tumer,et al.  A functional failure reasoning methodology for evaluation of conceptual system architectures , 2010 .

[29]  Marcel Vinícius Medeiros Oliveira,et al.  Formal Development of a Cardiac Pacemaker: From Specification to Code , 2010, SBMF.

[30]  Zhihao Jiang,et al.  Model-Based Closed-Loop Testing of Implantable Pacemakers , 2011, 2011 IEEE/ACM Second International Conference on Cyber-Physical Systems.

[31]  Joost-Pieter Katoen,et al.  The COMPASS Approach: Correctness, Modelling and Performability of Aerospace Systems , 2009, SAFECOMP.

[32]  Jeff Yu Lei,et al.  ACTS: A Combinatorial Test Generation Tool , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation.

[33]  Michael Rossi,et al.  Failure Mode, Effects, and Criticality Analysis (FMECA) , 1993 .

[34]  S. Veram,et al.  Procedures for off-nominal cases: Very closely spaced parallel runway operations , 2008, 2008 IEEE/AIAA 27th Digital Avionics Systems Conference.

[35]  Hyunsook Do,et al.  Hierarchical Model Exploration for Exposing Off-nominal Behaviors , 2017, MODELS.

[36]  Robert Eschbach,et al.  Risk-Based Testing of Safety-Critical Embedded Systems Driven by Fault Tree Analysis , 2011, 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops.

[37]  Sheng‐Hsien Teng,et al.  Failure mode and effects analysis: An integrated approach for product design and process control , 1996 .

[38]  Man Chun Zheng,et al.  Modeling and Verification of Safety Critical Systems: A Case Study on Pacemaker , 2010, 2010 Fourth International Conference on Secure Software Integration and Reliability Improvement.

[39]  Yung-Tsan Jou,et al.  Multi-criteria failure mode effects and criticality analysis method: a comparative case study on aircraft braking system , 2016 .