Model-Driven Diagnostics of Underperforming Communicating Systems

This paper proposes methods for improving the performance of a communicatingsystem that has failed its performance test. The proposed methodsextend our earlier published model-driven performance testing method,which automatically determines whether the tested system is ableto serve the specified number of requests within a second in worstcase while serving a specified number of users simultaneously. Theunderperformance diagnostic methods presented in this paper are givenas an input the formal performance model representing the systemunder test, which was built up by our performance testing methodin the performance testing phase. The presented methods aim at improvingthe performance of the system under test to the desired level atminimal cost. One of the methods presented in this paper is a binarylinear program, while the other is a heuristic method which, accordingto our simulation results, performs efficiently.

[1]  Ferhat Khendek,et al.  Test Selection Based on Finite State Models , 1991, IEEE Trans. Software Eng..

[2]  Jens Grabowski,et al.  Timed TTCN-3 - A Real-time Extension for TTCN-3 , 2002, TestCom.

[3]  David Lee,et al.  Testing Finite-State Machines: State Identification and Verification , 1994, IEEE Trans. Computers.

[4]  R. Dssouli,et al.  Multiple fault diagnosis for finite state machines , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[5]  Jan Tretmans,et al.  A Framework for Test Selection , 1991, PSTV.

[6]  Jianping Wu,et al.  A formal approach to protocol performance testing , 2008, Journal of Computer Science and Technology.

[7]  Ina Schieferdecker,et al.  PerfTTCN, a TTCN language extension for performance testing , 1997 .

[8]  Ana R. Cavalli,et al.  FSM-based conformance testing methods: A survey annotated with experimental evaluation , 2010, Inf. Softw. Technol..

[9]  Krishan K. Sabnani,et al.  Formal methods for generating protocol conformance test sequences , 1990, Proc. IEEE.

[10]  M. Reda El-Karaksy,et al.  Performance analysis of timed Petri net models for communication protocols: a methodology and a package , 1990, Comput. Commun..

[11]  Marco Ajmone Marsan,et al.  Timed Petri net model for the accurate performance analysis of CSMA/CD bus LANs , 1987, Comput. Commun..

[12]  Falko Bause,et al.  SDL and Petri net performance analysis of communicating systems , 1995, PSTV.

[13]  David Lee,et al.  Principles and methods of testing finite state machines-a survey , 1996, Proc. IEEE.

[14]  Wail S. El-Kilani,et al.  A behavior and delay equivalent petri net model for performance evaluation of communication protocols , 2008, Comput. Commun..

[15]  Levente Eros,et al.  An automatic performance testing method based on a formal model for communicating systems , 2010, 2010 IEEE 18th International Workshop on Quality of Service (IWQoS).

[16]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[17]  Alfred V. Aho,et al.  Efficient Algorithms for Constructing Testing Sets, Covering Paths, and Minimum Flows , 2007 .

[18]  Marco Ajmone Marsan,et al.  Stochastic Petri nets: an elementary introduction , 1988, European Workshop on Applications and Theory in Petri Nets.

[19]  Zoltán Pap,et al.  Iterative automatic test generation method for telecommunication protocols , 2006, Comput. Stand. Interfaces.

[20]  Jan Tretmans,et al.  Test Generation with Inputs, Outputs, and Quiescence , 1996, TACAS.

[21]  Chul Kim,et al.  Test sequence generation methods for protocol conformance testing , 1994, Proceedings Eighteenth Annual International Computer Software and Applications Conference (COMPSAC 94).

[22]  Tadao Murata,et al.  Petri nets: Properties, analysis and applications , 1989, Proc. IEEE.