Network delay tomography using flexicast experiments

Summary.  Estimating and monitoring the quality of service of computer and communications networks is a problem of considerable interest. The paper focuses on estimating link level delay distributions from end‐to‐end path level data collected by using active probing experiments. This is an interesting large scale statistical inverse (deconvolution) problem. We describe a flexible class of probing experiments (‘flexicast’) for data collection and develop conditions under which the link level delay distributions are identifiable. Maximum likelihood estimation using the EM algorithm is studied. It does not scale well for large trees, so a faster algorithm based on solving for local maximum likehood estimators and combining their information is proposed. The usefulness of the methods is illustrated on real voice over Internet protocol data that were collected from the University of North Carolina campus network.

[1]  H. Chernoff Locally Optimal Designs for Estimating Parameters , 1953 .

[2]  Takeshi Hirai Appendix I. Proof of Proposition 2 , 1970 .

[3]  J. B. Kernan,et al.  An Information‐Theoretic Approach* , 1971 .

[4]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[5]  Y. Vardi,et al.  Network Tomography: Estimating Source-Destination Traffic Intensities from Link Data , 1996 .

[6]  Michael A. West,et al.  Bayesian Inference on Network Traffic Using Link Count Data , 1998 .

[7]  Donald F. Towsley,et al.  Multicast-based inference of network-internal loss characteristics , 1999, IEEE Trans. Inf. Theory.

[8]  B. Yu,et al.  Time-varying network tomography: router link data , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[9]  Donald F. Towsley,et al.  Multicast-based inference of network-internal delay distributions , 2002, TNET.

[10]  Alfred O. Hero,et al.  Unicast-based inference of network link delay distributions with finite mixture models , 2003, IEEE Trans. Signal Process..

[11]  Bin Yu,et al.  Maximum pseudo likelihood estimation in network tomography , 2003, IEEE Trans. Signal Process..

[12]  Robert D. Nowak,et al.  Network delay tomography , 2003, IEEE Trans. Signal Process..

[13]  Carsten Lund,et al.  An information-theoretic approach to traffic matrix estimation , 2003, SIGCOMM '03.

[14]  Robert Nowak,et al.  Network Tomography: Recent Developments , 2004 .

[15]  E. Lawrence Flexicast network delay tomography. , 2005 .

[16]  Vijayan N. Nair,et al.  Estimating Network Loss Rates Using Active Tomography , 2006 .

[17]  Lin Jun-wu,et al.  Multicast-based inference of network internal loss from end-to-end data , 2008, 2008 9th International Conference on Signal Processing.