Accurate and efficient SLA compliance monitoring

Service level agreements (SLAs) define performance guarantees made by service providers, e.g, in terms of packet loss, delay, delay variation, and network availability. In this paper, we describe a new active measurement methodology to accurately monitor whether measured network path characteristics are in compliance with performance targets specified in SLAs. Specifically, (1) we describe a new methodology for estimating packet loss rate that significantly improves accuracy over existing approaches; (2) we introduce a new methodology for measuring mean delay along a path that improves accuracy over existing methodologies, and propose a method for obtaining confidence intervals on quantiles of the empirical delay distribution without making any assumption about the true distribution of delay; (3) we introduce a new methodology for measuring delay variation that is more robust than prior techniques; and (4) we extend existing work in network performance tomography to infer lower bounds on the quantiles of a distribution of performance measures along an unmeasured path given measurements from a subset of paths. We unify active measurements for these metrics in a discrete time-based tool called SLA M . The unified probe stream from SLA M consumes lower overall bandwidth than if individual streams are used to measure path properties. We demonstrate the accuracy and convergence properties of SLA M in a controlled laboratory environment using a range of background traffic scenarios and in one- and two-hop settings, and examine its accuracy improvements over existing standard techniques.

[1]  Randy H. Katz,et al.  An algebraic approach to practical and scalable overlay network monitoring , 2004, SIGCOMM 2004.

[2]  Yin Zhang,et al.  On the constancy of internet path properties , 2001, IMW '01.

[3]  Robert G. Cole,et al.  Voice over IP performance monitoring , 2001, CCRV.

[4]  Paul Barford,et al.  A Framework for Multi-Objective SLA Compliance Monitoring , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[5]  Vern Paxson,et al.  Measurements and analysis of end-to-end Internet dynamics , 1997 .

[6]  Donald F. Towsley,et al.  Multicast-based inference of network-internal delay distributions , 2002, TNET.

[7]  Bernd Girod,et al.  Adaptive playout scheduling and loss concealment for voice communication over IP networks , 2003, IEEE Trans. Multim..

[8]  Al Morton,et al.  Standardized active measurements on a tier 1 IP backbone , 2003, IEEE Commun. Mag..

[9]  Vern Paxson,et al.  IPPM Metrics for Measuring Connectivity , 1999, RFC.

[10]  Arne A. Nilsson,et al.  On service level agreements for IP networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[11]  Robert D. Nowak,et al.  Passive network tomography using EM algorithms , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[12]  Zhi-Li Zhang,et al.  Practical delay monitoring for ISPs , 2005, CoNEXT '05.

[13]  Donald F. Towsley,et al.  Measurement and modelling of the temporal dependence in packet loss , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[14]  Masaki Aida,et al.  A scalable and lightweight QoS monitoring technique combining passive and active approaches , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[15]  Matthew Roughan,et al.  Fundamental bounds on the accuracy of network performance measurements , 2005, SIGMETRICS '05.

[16]  Paul Barford,et al.  Comparing probe-and router-based packet-loss measurement , 2004, IEEE Internet Computing.

[17]  Matthew J. Zekauskas,et al.  A One-way Delay Metric for IPPM , 1999, RFC.

[18]  Philip F. Chimento,et al.  IP Packet Delay Variation Metric for IP Performance Metrics (IPPM) , 2002, RFC.

[19]  Matthew J. Zekauskas,et al.  A One-way Packet Loss Metric for IPPM , 1999, RFC.

[20]  Paul Barford,et al.  Self-configuring network traffic generation , 2004, IMC '04.

[21]  Jean-Chrysotome Bolot End-to-end packet delay and loss behavior in the internet , 1993, SIGCOMM 1993.

[22]  Donald F. Towsley,et al.  Multicast-based inference of network-internal loss characteristics , 1999, IEEE Trans. Inf. Theory.

[23]  Albert Greenberg,et al.  Operations and Management of IP Networks: What Researchers Should Know , 2005 .

[24]  Xin Wang,et al.  A scalable monitoring approach for service level agreements validation , 2000, Proceedings 2000 International Conference on Network Protocols.

[25]  Randy H. Katz,et al.  Tomography-based overlay network monitoring , 2003, IMC '03.

[26]  Paul Barford,et al.  Scalable network path emulation , 2005, 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[27]  Paul Barford,et al.  Improving accuracy in end-to-end packet loss measurement , 2005, SIGCOMM '05.

[28]  J. Sommers,et al.  A Geometric Approach to Improving Active Packet Loss Measurement , 2008, IEEE/ACM Transactions on Networking.

[29]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[30]  Donald F. Towsley,et al.  Inferring link loss using striped unicast probes , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[31]  Vern Paxson,et al.  Framework for IP Performance Metrics , 1998, RFC.

[32]  Dogu Arifler,et al.  Network tomography based on flow level measurements , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[33]  Nick G. Duffield,et al.  Network Tomography of Binary Network Performance Characteristics , 2006, IEEE Transactions on Information Theory.