The use of end-to-end multicast measurements for characterizing internal network behavior

We present a novel methodology for identifying internal network performance characteristics based on end-to-end multicast measurements. The methodology, solidly grounded on statistical estimation theory, can be used to characterize the internal loss and delay behavior of a network. Measurements on the MBone have been used to validate the approach in the case of losses. Extensive simulation experiments provide further validation of the approach, not only for losses, but also for delays. We also describe our strategy for deploying the methodology on the Internet. This includes the continued development of the National Internet Measurement Infrastructure to support RTP-based end-to-end multicast measurements and the development of software tools to analyze the traces. Once complete, this combined software/hardware infrastructure will provide a service for understanding and forecasting the performance of the Internet.

[1]  D. Widder,et al.  The Laplace Transform , 1943, The Mathematical Gazette.

[2]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[3]  R. Penrose.  A Generalized inverse for matrices , 1955 .

[4]  Robert B. Ash,et al.  Information Theory , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[5]  B. Efron,et al.  Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information , 1978 .

[6]  Ronald W. Wolff,et al.  Poisson Arrivals See Time Averages , 1982, Oper. Res..

[7]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[8]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[9]  David L. Mills,et al.  Network Time Protocol (Version 3) Specification, Implementation and Analysis , 1992, RFC.

[10]  Amarnath Mukherjee,et al.  On the Dynamics and Significance of Low Frequency Components of Internet Load , 1992 .

[11]  QUTdN QeO,et al.  Random early detection gateways for congestion avoidance , 1993, TNET.

[12]  Jean-Chrysostome Bolot,et al.  Characterizing End-to-End Packet Delay and Loss in the Internet , 1993, J. High Speed Networks.

[13]  Ashok K. Agrawala,et al.  Experimental assessment of end-to-end behavior on Internet , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[14]  Van Jacobson,et al.  Random early detection gateways for congestion avoidance , 1993, TNET.

[15]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[16]  George C. Polyzos,et al.  Measurement Considerations for Assessing Unidirectional Latencies � , 1993 .

[17]  Ashok K. Agrawala,et al.  Study of Network Dynamics , 1993, Comput. Networks ISDN Syst..

[18]  V. Jacobson.  Congestion avoidance and control , 1988, CCRV.

[19]  M. Schervish.  Theory of Statistics , 1995 .

[20]  Mark Crovella,et al.  Measuring Bottleneck Link Speed in Packet-Switched Networks , 1996, Perform. Evaluation.

[21]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[22]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[23]  Y. Vardi,et al.  Network Tomography: Estimating Source-Destination Traffic Intensities from Link Data , 1996 .

[24]  Don Towsley,et al.  Packet loss correlation in the MBone multicast network , 1996, Proceedings of GLOBECOM'96. 1996 IEEE Global Telecommunications Conference.

[25]  Sally Floyd,et al.  Why we don't know how to simulate the Internet , 1997, WSC '97.

[26]  Sanjoy Paul,et al.  Reliable Multicast Transport Protocol (RMTP) , 1997, IEEE J. Sel. Areas Commun..

[27]  Vern Paxson,et al.  Automated packet trace analysis of TCP implementations , 1997, SIGCOMM '97.

[28]  Vern Paxson,et al.  Measurements and analysis of end-to-end Internet dynamics , 1997 .

[29]  Vern Paxson,et al.  End-to-end routing behavior in the Internet , 1996, TNET.

[30]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[31]  Vern Paxson,et al.  An architecture for large-scale Internet measurement , 1998, IEEE Commun. Mag..

[32]  D. Towsley,et al.  Correlation of Packet Delay and Loss in the Internet TITLE2 , 1998 .

[33]  J. J. Garcia-Luna-Aceves,et al.  Organizing multicast receivers deterministically by packet-loss correlation , 1998, MULTIMEDIA '98.

[34]  Vern Paxson,et al.  On calibrating measurements of packet transit times , 1998, SIGMETRICS '98/PERFORMANCE '98.

[35]  David B. Makofske,et al.  MHealth : A Real-Time Multicast Tree Visualization and Monitoring Tool , 1999 .

[36]  Donald F. Towsley,et al.  Estimation and removal of clock skew from network delay measurements , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[37]  Allen B. Downey.  Using pathchar to estimate Internet link characteristics , 1999, SIGCOMM '99.

[38]  R. Caceres,et al.  Loss-based inference of multicast network topology , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[39]  Donald F. Towsley,et al.  Multicast-based inference of network-internal loss characteristics , 1999, IEEE Trans. Inf. Theory.

[40]  R. Caceres,et al.  Inference of internal loss rates in the MBone , 1999, Seamless Interconnection for Universal Services. Global Telecommunications Conference. GLOBECOM'99. (Cat. No.99CH37042).

[41]  Vern Paxson.  End-to-end internet packet dynamics , 1999, TNET.

[42]  Donald F. Towsley,et al.  Multicast-based inference of network-internal characteristics: accuracy of packet loss estimation , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[43]  Azer Bestavros,et al.  Robust identification of shared losses using end-to-end unicast probes , 2000, Proceedings 2000 International Conference on Network Protocols.

[44]  Robert Nowak,et al.  Network Loss Inference Using Unicast End-to-End Measurement , 2000 .

[45]  Mark Handley,et al.  The Reliable Multicast Design Space for Bulk Data Transfer , 2000, RFC.

[46]  Mary Baker,et al.  Measuring link bandwidths using a deterministic model of packet delay , 2000, SIGCOMM 2000.

[47]  Nick G. Duffield,et al.  Multicast inference of packet delay variance at interior network links , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[48]  Donald F. Towsley,et al.  Tree Layout for Internal Network Characterizations in Multicast Networks , 2001, Networked Group Communication.

[49]  Nick G. Duffield,et al.  Adaptive multicast topology inference , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[50]  Moshe Sidi,et al.  Estimating one-way delays from cyclic-path delay measurements , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[51]  Donald F. Towsley,et al.  Inferring link loss using striped unicast probes , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[52]  Donald F. Towsley,et al.  Network Delay Tomography from End-to-End Unicast Measurements , 2001, IWDC.

[53]  Donald F. Towsley,et al.  Multicast-based inference of network-internal delay distributions , 2002, TNET.