Bayesian inference of network loss and delay characteristics with applications to TCP performance prediction

In large-scale dynamic communication networks, end systems cannot rely on the network itself to cooperate in characterizing its own behavior. This has prompted research activities on methods for inferring internal network behavior based on the external end-to-end network measurements. In particular, knowledge of the link losses and link delays inside the network is important for network management. However, it is impractical to directly measure packet losses or delays at every router. On the other hand, measuring end-to-end (from sources to destinations) losses or delays is relatively easy. We formulate the problems of link and delay estimation in a network based on end-to-end measurements as Bayesian inference problems and develop several Markov chain Monte Carlo (MCMC) algorithms to solve them. We show how these link loss and delay estimates can be used to predict point-to-point transfer control protocol (TCP) throughput in the network. We apply the proposed link loss and delay estimation algorithms, as well as the TCP throughput estimation algorithms, to data generated by the network simulator (ns-2) software and obtain good agreements between the theoretical results and the actual measurements.

[1]  Donald F. Towsley,et al.  Multicast-based inference of network-internal loss characteristics , 1999, IEEE Trans. Inf. Theory.

[2]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[3]  Mukul Goyal,et al.  Predicting TCP Throughput From Non-invasive Data , 2001 .

[4]  Michael A. West,et al.  Bayesian Inference on Network Traffic Using Link Count Data , 1998 .

[5]  Donald F. Towsley,et al.  Multicast topology inference from measured end-to-end loss , 2002, IEEE Trans. Inf. Theory.

[6]  Anurag Kumar,et al.  Comparative performance analysis of versions of TCP in a local network with a lossy link , 1998, TNET.

[7]  Wenyu Jiang,et al.  QoS Measurement of Internet Real-Time Multimedia Services , 1999 .

[8]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[9]  Y. Vardi,et al.  Network Tomography: Estimating Source-Destination Traffic Intensities from Link Data , 1996 .

[10]  Chuanyi Ji,et al.  Measurement-based network monitoring and inference: scalability and missing information , 2002, IEEE J. Sel. Areas Commun..

[11]  Robert Nowak,et al.  Network Loss Inference Using Unicast End-to-End Measurement , 2000 .

[12]  Georg Carle,et al.  Framework model for packet loss metrics based on loss runlengths , 1999, Electronic Imaging.

[13]  Alfred O. Hero,et al.  Unicast-based inference of network link delay distributions using mixed finite mixture models , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[14]  Robert D. Nowak,et al.  Sequential Monte Carlo inference of internal delays in nonstationary data networks , 2002, IEEE Trans. Signal Process..

[15]  Jun S. Liu,et al.  The Multiple-Try Method and Local Optimization in Metropolis Sampling , 2000 .

[16]  Donald F. Towsley,et al.  Multicast-based inference of network-internal delay distributions , 2002, TNET.

[17]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[18]  Robert Nowak,et al.  Internet tomography , 2002, IEEE Signal Process. Mag..

[19]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[20]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[21]  Bing Yu,et al.  Time-Varying Network Tomography: Router Link Data , 2000 .

[22]  Amarnath Mukherjee,et al.  On the Dynamics and Significance of Low Frequency Components of Internet Load , 1992 .

[23]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[24]  Donald F. Towsley,et al.  Inferring link loss using striped unicast probes , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[25]  Vern Paxson,et al.  End-to-end Internet packet dynamics , 1997, SIGCOMM '97.

[26]  Alfred O. Hero,et al.  Unicast-based inference of network link delay distributions with finite mixture models , 2003, IEEE Trans. Signal Process..

[27]  Nando de Freitas,et al.  Sequential Monte Carlo in Practice , 2001 .

[28]  Ramón Cáceres,et al.  Impromptu measurement infrastructures using RTP , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[29]  Rong Chen,et al.  Convergence analyses and comparisons of Markov chain Monte Carlo algorithms in digital communications , 2002, IEEE Trans. Signal Process..

[30]  Tim Hesterberg,et al.  Monte Carlo Strategies in Scientific Computing , 2002, Technometrics.

[31]  Robert Nowak,et al.  Sequential Monte Carlo Inference of Internal Delays in Nonstationary Communication Networks , 2002 .

[32]  Don Towsley,et al.  The use of end-to-end multicast measurements for characterizing internal network behavior , 2000, IEEE Commun. Mag..

[33]  Donald F. Towsley,et al.  Modeling TCP Reno performance: a simple model and its empirical validation , 2000, TNET.

[34]  Yves Lepage,et al.  MBONE, multicasting tomorrow's Internet , 1996 .

[35]  Charles J. Geyer,et al.  Practical Markov Chain Monte Carlo , 1992 .

[36]  B. Yu,et al.  Time-varying network tomography: router link data , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).