Accuracy Evaluation of Application-Level Performance Measurements

In many cases, application-level measurements can be the only way for an application to evaluate and adapt to the performance offered by the underlying networks. Applications perceive heterogeneous networking environments spanning over multiple administrative domains as "black boxes" being inaccessible for lower-level measurement instrumentation. However, application-level measurements can be inaccurate and differ significantly from the lower-level ones, amongst others due to the influence of the protocol stacks. In this paper we quantify and discuss such differences using the Distributed Passive Measurement Infrastructure (DPMI), with Measurement Points (MPs) instrumented with DAG 3.5E cards for the reference link-level measurements. We shed light on various impacts on timestamp accuracy of application-level measurements. Moreover, we quantify the accuracy of generating traffic with constant inter-packet-times (IPTs). The latter is essential for an accurate emulation of application-level streaming traffic and thus for obtaining realistic end-to-end performance measurements.

[1]  K. Wac,et al.  Goodput analysis of 3G wireless networks supporting m-health services , 2005, Proceedings of the 8th International Conference on Telecommunications, 2005. ConTEL 2005..

[2]  Markus Fiedler,et al.  A Distributed Passive Measurement Infrastructure , 2005, PAM.

[3]  Allen B. Downey.  Using pathchar to estimate Internet link characteristics , 1999, SIGCOMM '99.

[4]  Francis Lepage,et al.  Application-oriented network metrology: metrics and active measurement tools , 2005, IEEE Communications Surveys & Tutorials.

[5]  Patrik Arlos,et al.  On the Quality of Computer Network Measurements , 2005 .

[6]  Francis Lepage,et al.  End-to-End Available Bandwidth Measurement Tools : A Comparative Evaluation of Performances , 2007, ArXiv.

[7]  M. Fiedler,et al.  Generic communication requirements of ITS-related mobile services as basis for seamless communications , 2005, Next Generation Internet Networks, 2005.

[8]  B. A. Mar,et al.  pchar : A Tool for Measuring Internet Path Characteristics , 2000 .

[9]  Neal Seitz.  ITU-T QoS standards for IP-based networks , 2003, IEEE Commun. Mag..

[10]  K. Wac,et al.  Mobile patient monitoring: The MobiHealth system , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.