On Testing against Partial Non-observable Specifications

As the complexity of communication systems increases, new techniques and strategies should be developed for testing and verification of the system components. In this paper, we focus on testing software components that implement communication protocols at various levels. Such implementations can be considered as reactive systems and we discuss how Finite State Machines (FSMs) might be used when deriving high quality tests and which properties can be held for corresponding FSMs when increasing/decreasing an abstraction level for the protocol specification. At the high abstraction level, the specification machine can be partial and non-observable, and we propose a test derivation strategy against such specifications. Furthermore, we turn to debugging techniques and discuss how an implementation bug can be located when the specification is partial and non-observable.

[1]  Nina Yevtushenko,et al.  Extended Finite State Machine based test derivation strategies for telecommunication protocols , 2014 .

[2]  Nina Yevtushenko,et al.  Deriving Exhaustive Test Suits for Nondeterministic FSMs w.r.t. Non-separability Relation , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[3]  Robert M. Hierons,et al.  Testing from a nondeterministic finite state machine using adaptive state counting , 2004, IEEE Transactions on Computers.

[4]  A. Jefferson Offutt,et al.  Applying Mutation Testing to Web Applications , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[5]  Alexandre Petrenko,et al.  Confirming configurations in EFSM testing , 2004, IEEE Transactions on Software Engineering.

[6]  Yliès Falcone,et al.  A Compositional Testing Framework Driven by Partial Specifications , 2007, TestCom/FATES.

[7]  Xiaoxia Shi,et al.  Specification tests for partially identified models defined by moment inequalities , 2013 .

[8]  Ana R. Cavalli,et al.  FSM-based conformance testing methods: A survey annotated with experimental evaluation , 2010, Inf. Softw. Technol..