Passive performance testing of network protocols

Complementary to performance evaluation, performance testing of communicating protocols is a qualitative and quantitative test of a system, aiming at checking whether performance requirements of protocols have been satisfied under certain conditions. It raises an interesting issue of accurately formalizing specified performance requirements by taking consideration of data values of the protocol messages. In this paper, we present a novel logic-based testing approach to check protocol performance requirements through real execution traces and formally specified properties. In order to evaluate and assess our methodology, we develop a prototype and present experiments through a set of Session Initiation Protocol (SIP) properties. Finally, a performance benchmark method is proposed and relevant verdicts and discussions are provided.

[1]  Joseph Mendola,et al.  From the Good , 2014 .

[2]  Martin Leucker,et al.  Runtime Verification for LTL and TLTL , 2011, TSEM.

[3]  Roger Villemaire,et al.  Runtime Enforcement of Web Service Message Contracts with Data , 2012, IEEE Transactions on Services Computing.

[4]  Ana R. Cavalli,et al.  A passive testing approach based on invariants: application to the WAP , 2005, Comput. Networks.

[5]  Thomas Stricker,et al.  A performance monitor based on virtual global time for clusters of PCs , 2003, 2003 Proceedings IEEE International Conference on Cluster Computing.

[6]  Shueng-Han Gary Chan,et al.  Scalable Real-Time Monitoring for Distributed Applications , 2012, IEEE Transactions on Parallel and Distributed Systems.

[7]  Bernd Mohr,et al.  Distributed Performance Monitoring: Methods, Tools, and Applications , 1994, IEEE Trans. Parallel Distributed Syst..

[8]  Rance Cleaveland,et al.  Using formal specifications to support testing , 2009, CSUR.

[9]  Elaine J. Weyuker,et al.  Experience with Performance Testing of Software Systems: Issues, an Approach, and Case Study , 2000, IEEE Trans. Software Eng..

[11]  Ian T. Foster,et al.  DiPerF: an automated distributed performance testing framework , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[12]  Donald F. Towsley,et al.  Passive Online Detection of 802.11 Traffic Using Sequential Hypothesis Testing with TCP ACK-Pairs , 2009, IEEE Transactions on Mobile Computing.

[13]  Martin Leucker,et al.  A brief account of runtime verification , 2009, J. Log. Algebraic Methods Program..

[14]  Stéphane Maag,et al.  A Logic-based Passive Testing Approach for the Validation of Communicating Protocols , 2012, ENASE.

[15]  Krzysztof R. Apt,et al.  Contributions to the Theory of Logic Programming , 1982, JACM.

[16]  Ye Wu,et al.  Testing and Quality Assurance for Component-Based Software , 2003 .

[17]  Robert V. Binder,et al.  Testing Object-Oriented Systems: Models, Patterns, and Tools , 1999 .

[18]  Stéphane Maag,et al.  A Formal Data-Centric Approach for Passive Testing of Communication Protocols , 2013, IEEE/ACM Transactions on Networking.

[19]  Yanlei Diao,et al.  High-performance complex event processing over streams , 2006, SIGMOD Conference.

[20]  Scott O. Bradner,et al.  Benchmarking Terminology for Network Interconnection Devices , 1991, RFC.

[21]  Scott Pakin,et al.  The Design and Implementation of a Domain-Specific Language for Network Performance Testing , 2007, IEEE Transactions on Parallel and Distributed Systems.

[22]  Xiaoping Che,et al.  Data-centric property formulation for passive testing of communication protocols , 2011 .

[23]  Scott O. Bradner,et al.  Benchmarking Methodology for Network Interconnect Devices , 1999, RFC.

[24]  Mark Handley,et al.  SIP: Session Initiation Protocol , 1999, RFC.

[25]  Robert A. Kowalski,et al.  The Semantics of Predicate Logic as a Programming Language , 1976, JACM.

[26]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[27]  Paulo Marques,et al.  A framework for performance evaluation of complex event processing systems , 2008, DEBS.

[28]  Fusheng Wang,et al.  Complex RFID event processing , 2009, The VLDB Journal.

[29]  Robert Cole,et al.  Computer Communications , 1982, Springer New York.

[30]  David Lee,et al.  Network protocol system monitoring-a formal approach with passive testing , 2006, IEEE/ACM Transactions on Networking.

[31]  Marin Litoiu,et al.  Model-based performance testing: NIER track , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[32]  Martin Leucker,et al.  The Good, the Bad, and the Ugly, But How Ugly Is Ugly? , 2007, RV.

[33]  Pasquale Arpaia,et al.  A Model-Driven Domain-Specific Scripting Language for Measurement-System Frameworks , 2011, IEEE Transactions on Instrumentation and Measurement.