A Statistical Approach to Model-Based Robustness Testing

Recent massive research in the area of robustness testing of communication protocols have been driven by the fact that embedded systems are becoming more and more complex every day. Providing correct implementations of communication protocols is a key to successful interconnection of embedded system constituents. Test and verification is the last and the most critical phase in the production of the corresponding software artifacts. This paper contributes to the overall research effort in the area by proposing an original approach to model-based robustness testing of communication protocols. In the paper we introduce the notion of hidden FSM states and state transitions. We also show how to calculate the probabilities of detecting the existence of the hidden state transitions. Then we present our methodology of model-based robustness testing of communication protocols. The methodology is based on the special operational profiles, which are referred to as the stress operational profiles

[1]  Miroslav Popovic,et al.  A generic model-based test case generator , 2005, 12th IEEE International Conference and Workshops on the Engineering of Computer-Based Systems (ECBS'05).

[2]  Atif M. Memon,et al.  ASPIRE: automated systematic protocol implementation robustness evaluation , 2004, 2004 Australian Software Engineering Conference. Proceedings..

[3]  Jesse H. Poore,et al.  Application of statistical science to testing and evaluating software intensive systems , 1999, Proceedings. Science and Engineering for Software Development: A Recognition of Harlin D. Mills Legacy (Cat. No. PR00010).

[4]  Miroslav Popovic,et al.  A model-based statistical usage testing of communication protocols , 2006, 13th Annual IEEE International Symposium and Workshop on Engineering of Computer-Based Systems (ECBS'06).

[5]  Denise M. Woit.  Operational profile specification, test case generation, and reliability estimation for modules , 1994 .

[6]  Yu Lei,et al.  A Test Generation Strategy for Pairwise Testing , 2002, IEEE Trans. Software Eng..

[7]  M. Hübner,et al.  Statistical Usage Testing Based on UML , 2022 .

[8]  Shu Xiao,et al.  Integrated TCP/IP protocol software testing for vulnerability detection , 2003, 2003 International Conference on Computer Networks and Mobile Computing, 2003. ICCNMC 2003..

[9]  Miroslav Popovic,et al.  A concept of an integrated development environment for reactive systems , 2004, Proceedings. 11th IEEE International Conference and Workshop on the Engineering of Computer-Based Systems, 2004..

[10]  Huowang Chen,et al.  Deriving software statistical testing model from UML model , 2003, Third International Conference on Quality Software, 2003. Proceedings..

[11]  Miroslav Popovic,et al.  A formal software verification concept based on automated theorem proving and reverse engineering , 2002, Proceedings Ninth Annual IEEE International Conference and Workshop on the Engineering of Computer-Based Systems.

[12]  Pradipta De,et al.  VirtualWire: a fault injection and analysis tool for network protocols , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[13]  Miroslav Popovic.  Communication Protocol Engineering , 2006 .