Model-based testing of software for automation systems using heuristics and coverage criterion

The aim of this work is to increase the confidence on software for automation systems defining a coverage criterion to measure the quality level of generated tests and the time interval needed to execute them. This coverage criterion called At Least N (ALN) is based on the Effect Predicate Heuristic (EPH) that provides all effect predicate for ISA 5.2 diagrams. The ALN and EPH have been incorporated into the Gungnir tool that was built using model-based testing concepts. The Gungnir uses timed automata to model the specification, in the ISA 5.2 diagrams, and the implementation, in the Ladder language. The timed automata models are automatically extracted, data tests are generated and the tool automatically verifies if the implementation is in conformance with the specification, given a quality level defined by the user.

[1]  J. Michael Spivey,et al.  The Z notation - a reference manual , 1992, Prentice Hall International Series in Computer Science.

[2]  Steven P. Miller,et al.  Applicability of modified condition/decision coverage to software testing , 1994, Softw. Eng. J..

[3]  Jan Peleska,et al.  Timed Moore Automata: Test Data Generation and Model Checking , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[4]  E. V. Kuzmin,et al.  On construction and verification of PLC programs , 2013, Automatic Control and Computer Sciences.

[5]  Paul Pettersson,et al.  Cover - A Real-Time Test Case Generation Tool , 2007 .

[6]  Robert M. Hierons,et al.  Testing Real-Time Embedded Systems using Timed Automata based approaches , 2013, J. Syst. Softw..

[7]  Yuen-Tak Yu,et al.  Comparing several coverage criteria for detecting faults in logical decisions , 2004, Fourth International Conference onQuality Software, 2004. QSIC 2004. Proceedings..

[8]  Stefan Kowalewski,et al.  Arcade.PLC: a verification platform for programmable logic controllers , 2012, 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering.

[9]  E. V. Kuzmin,et al.  Modeling, specification and construction of PLC-programs , 2014, Automatic Control and Computer Sciences.

[10]  Bogdan Korel,et al.  Requirement-based automated black-box test generation , 2001, 25th Annual International Computer Software and Applications Conference. COMPSAC 2001.

[11]  Kim G. Larsen,et al.  A Tutorial on Uppaal , 2004, SFM.

[12]  Lionel C. Briand,et al.  Environment modeling and simulation for automated testing of soft real-time embedded software , 2013, Software & Systems Modeling.

[13]  Chin-Yu Huang,et al.  A Study of Enhanced MC/DC Coverage Criterion for Software Testing , 2007, 31st Annual International Computer Software and Applications Conference (COMPSAC 2007).

[14]  Bruno Legeard,et al.  Boundary coverage criteria for test generation from formal models , 2004, 15th International Symposium on Software Reliability Engineering.

[15]  Kim G. Larsen,et al.  Testing real-time embedded software using UPPAAL-TRON: an industrial case study , 2005, EMSOFT.

[16]  Luis A. Bryan,et al.  Programmable Controllers: Theory and Implementation , 1997 .

[17]  Wang Yi,et al.  Timed Automata: Semantics, Algorithms and Tools , 2003, Lectures on Concurrency and Petri Nets.

[18]  J. C. Quezada,et al.  Simulation and validation of diagram ladder—petri nets , 2017 .

[19]  James Kapinski,et al.  Efficient Guiding Strategies for Testing of Temporal Properties of Hybrid Systems , 2015, NFM.

[20]  Tolga Ovatman,et al.  An overview of model checking practices on verification of PLC software , 2014, Software & Systems Modeling.

[21]  Jürgen Dingel,et al.  A survey of timed automata for the development of real-time systems , 2013, Comput. Sci. Rev..

[22]  Simon Wimmer,et al.  Timed Automata , 2016, Arch. Formal Proofs.

[23]  M. Khalil-Hani,et al.  Algorithm to convert programmable logic controller Ladder Logic Diagram models to Petri Net models , 2015, 2015 IEEE Student Conference on Research and Development (SCOReD).

[24]  Angelo Perkusich,et al.  Standard-based formal validation of Programmable Logic Controller programs , 2010, 2010 IEEE International Conference on Industrial Technology.

[25]  Stephan Merz,et al.  Model Checking , 2000 .

[26]  Angelo Perkusich,et al.  Automatic timed automata extraction from ladder programs for model-based analysis of control systems , 2010, 2010 IEEE International Symposium on Industrial Electronics.

[27]  Jian Bao,et al.  A fault diagnosis system-PLC design for system reliability improvement , 2014 .

[28]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[29]  Yvan Labiche,et al.  Automated state-based online testing real-time embedded software with RTEdge , 2015, 2015 3rd International Conference on Model-Driven Engineering and Software Development (MODELSWARD).

[30]  Kim G. Larsen,et al.  Testing Real-Time Systems Using UPPAAL , 2008, Formal Methods and Testing.

[31]  Jean-Raymond Abrial,et al.  The B-book - assigning programs to meanings , 1996 .