Systematic scenario test case generation for nuclear safety systems

Context: The current validation tests for nuclear software are routinely performed by random testing, which leads to uncertain test coverage. Moreover, validation tests should directly verify the system's compliance with the original user's needs. Unlike current model-based testing methods, which are generally based on requirements or design models, the proposed model is derived from the original user's needs in text through domain-specific ontology, and then used to generate validation tests systematically. Objective: Our first goal is to develop an objective, repeatable, and efficient systematic validation test scheme that is effective for large systems, with analyzable test coverage. Our second goal is to provide a new model-based validation testing method that reflects the user's original safety needs. Method: A model-based scenario test case generation for nuclear digital safety systems was designed. This was achieved by converting the scenarios described in natural language in a Safety Analysis Report (SAR) prepared by the power company for licensing review, to Unified Modeling Language (UML) sequence diagrams based on a proposed ontology of a related regulatory standard. Next, we extracted the initial environmental parameters and the described operational sequences. We then performed variations on these data to systematically generate a sufficient number of scenario test cases. Results: Test coverage criteria, which are the equivalence partition coverage of initial environment, the condition coverage, the action coverage and the scenario coverage, were met using our method. Conclusion: The proposed model-based scenario testing can provide improved testing coverage than random testing. A test suite based on user needs can be provided.

[1]  Edward A. Lee,et al.  Overview of the Ptolemy project , 2001 .

[2]  R. Mall,et al.  Automatic Test Case Generation from UML Sequence Diagram , 2007, 15th International Conference on Advanced Computing and Communications (ADCOM 2007).

[3]  Juan-Zi Li,et al.  Ontology-Based Test Case Generation for Testing Web Services , 2007, Eighth International Symposium on Autonomous Decentralized Systems (ISADS'07).

[4]  Doo-Hwan Bae,et al.  A data flow-based structural testing technique for FBD programs , 2009, Inf. Softw. Technol..

[5]  James E. Rumbaugh,et al.  Unified Modeling Language (UML) , 2010, Encyclopedia of Software Engineering.

[6]  Hiroshi Sakamoto,et al.  A verification and validation method and its application to digital safety systems in ABWR nuclear power plants , 1998 .

[7]  Hong Zhu,et al.  Software unit test coverage and adequacy , 1997, ACM Comput. Surv..

[8]  Valeh H. Nasser,et al.  Ontology-based Unit Test Generation , 2009 .

[9]  Shuhui Zhang,et al.  Test Case Design Methods and Strategy for Software Component Test of Digital Safety System in Nuclear Power Plants , 2011 .

[10]  Ian Sommerville,et al.  Software engineering / Ian Sommerville. , 2011 .

[11]  Wei-Tek Tsai,et al.  Ontology-Based Test Modeling and Partition Testing of Web Services , 2008, 2008 IEEE International Conference on Web Services.

[12]  Robert B. France,et al.  Test adequacy criteria for UML design models , 2003, Softw. Test. Verification Reliab..

[13]  Weichang Du,et al.  An Ontology-based Software Test Generation Framework , 2010, SEKE.

[14]  Pericles Loucopoulos,et al.  Performing Requirements Elicitation Activities Supported by Quality Ontologies , 2006, SEKE.

[15]  Stefan Biffl,et al.  Ontology-Based Test Case Generation For Simulating Complex Production Automation Systems , 2010, SEKE.

[16]  Philip Samuel,et al.  A Novel Test Case Design Technique Using Dynamic Slicing of UML Sequence Diagrams , 2008, e Informatica Softw. Eng. J..

[17]  R. Mall,et al.  UML Sequence Diagram Based Testing Using Slicing , 2005, 2005 Annual IEEE India Conference - Indicon.

[18]  Thomas R. Gruber,et al.  Toward principles for the design of ontologies used for knowledge sharing? , 1995, Int. J. Hum. Comput. Stud..

[19]  Vladan Devedzic,et al.  Education and the Semantic Web , 2005, Int. J. Artif. Intell. Educ..

[20]  Elizabeth Chang,et al.  Software Engineering Ontology - the Instance Knowledge (Part I) , 2007 .

[21]  R. Bell,et al.  IEC 61508: functional safety of electrical/electronic/ programme electronic safety-related systems: overview , 1999 .

[22]  Hans Tompits,et al.  Random vs. Structure-Based Testing of Answer-Set Programs: An Experimental Comparison , 2011, LPNMR.

[23]  Debra J. Richardson,et al.  Specification-based test oracles for reactive systems , 1992, International Conference on Software Engineering.

[24]  Ana Regina Cavalcanti da Rocha,et al.  The use of an enterprise ontology to support knowledge management in software development environments , 2010, Journal of the Brazilian Computer Society.

[25]  Anna Perini,et al.  Ontology-based test generation for multiagent systems , 2008, AAMAS.

[26]  John H. R. May,et al.  The Effectiveness of Statistical Testing when Applied to Logic Systems , 2001, SAFECOMP.

[27]  R. Hamlet RANDOM TESTING , 1994 .

[28]  L. S. S. Reddy,et al.  Automated generation of test cases from output domain and critical regions of embedded systems using genetic algorithms , 2011, 2011 2nd National Conference on Emerging Trends and Applications in Computer Science.

[29]  Falk Fraikin,et al.  SeDiTeC-testing based on sequence diagrams , 2002, Proceedings 17th IEEE International Conference on Automated Software Engineering,.

[30]  Lionel C. Briand,et al.  A UML-Based Approach to System Testing , 2001, UML.

[31]  Pavel Vrba MAST: manufacturing agent simulation tool , 2003, EFTA 2003. 2003 IEEE Conference on Emerging Technologies and Factory Automation. Proceedings (Cat. No.03TH8696).