Real-time estimation of the parameters of long-range dependence

An on-line version of the Abry-Veitch (see IEEE GLOBECOM'98, Sydney, Australia,p.3716-21, 1998) wavelet-based estimator of the Hurst parameter is presented. It has very low memory and computational requirements and scales naturally to arbitrarily high data rates, enabling its use in real-time applications such as admission control, and avoiding the need to store huge data sets for off-line analysis. The performance of the estimator as a function of the length of data processed is demonstrated using simulated data. An implementation for 10-Mb/s Ethernet based on standard hardware supporting sampling rates of 1 data point per millisecond is described, and results of its operation presented, as is an implementation for 155-Mb/s asynchronous transfer mode networks. Finally we illustrate the power of on-line measurements by collecting measurements over a period of five months, and using them to look for diurnal trends in scaling properties of the data.

[1]  J. L. Wang,et al.  A measurement analysis of ATM cell-level aggregate traffic , 1997, GLOBECOM 97. IEEE Global Telecommunications Conference. Conference Record.

[2]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[3]  Patrice Abry,et al.  Long‐range Dependence: Revisiting Aggregation with Wavelets , 1998 .

[4]  Matthew Roughan,et al.  On-line estimation of the parameters of long-range dependence , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[5]  Matthew Roughan,et al.  A study of the daily variation in the self-similarity of real data trac , 1998 .

[6]  Anja Feldmann,et al.  Data networks as cascades: investigating the multifractal nature of Internet WAN traffic , 1998, SIGCOMM '98.

[7]  R. Wilder,et al.  Wide-area Internet traffic patterns and characteristics , 1997, IEEE Netw..

[8]  Anja Feldmann,et al.  The changing nature of network traffic: scaling phenomena , 1998, CCRV.

[9]  Walter Willinger,et al.  Statistical analysis of CCSN/SS7 traffic data from working CCS subnetworks , 1994, IEEE J. Sel. Areas Commun..

[10]  Richard G. Baraniuk,et al.  A Multifractal Wavelet Model with Application to Network Traffic , 1999, IEEE Trans. Inf. Theory.

[11]  R. F. Rey,et al.  Engineering and Operations in the Bell System , 1983 .

[12]  Patrice Abry,et al.  Wavelet Analysis of Long-Range-Dependent Traffic , 1998, IEEE Trans. Inf. Theory.

[13]  Matthew Roughan,et al.  Measuring long-range dependence under changing traffic conditions , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[14]  Patrice Abry,et al.  A Wavelet-Based Joint Estimator of the Parameters of Long-Range Dependence , 1999, IEEE Trans. Inf. Theory.

[15]  A. Antoniadis,et al.  Wavelets and Statistics , 1995 .

[16]  Patrice Abry,et al.  A statistical test for the time constancy of scaling exponents , 2001, IEEE Trans. Signal Process..

[17]  Arne A. Nilsson,et al.  Bottlenecks on the way towards fractal characterization of network traffic estimation and interpretation of the Hurst parameter , 1997, PMCCN.

[18]  Kimberly C. Claffy,et al.  OC3MON: Flexible, Affordable, High Performance Staistics Collection , 1996, LISA.

[19]  Rick Wilder,et al.  Wide-Area Internet Traffic Patterns and Characteristics ( Extended Version ) , 1997 .

[20]  Patrice Abry,et al.  Wavelets for the Analysis, Estimation, and Synthesis of Scaling Data , 2002 .

[21]  A. Erramilli,et al.  A connection admission control algorithm for self-similar traffic , 1999, Seamless Interconnection for Universal Services. Global Telecommunications Conference. GLOBECOM'99. (Cat. No.99CH37042).

[22]  P. Abry,et al.  Wavelets, spectrum analysis and 1/ f processes , 1995 .

[23]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[24]  Darryl Veitch,et al.  Heavy traffic analysis of a storage model with long range dependent On/Off sources , 1996, Queueing Syst. Theory Appl..

[25]  Patrice Abry,et al.  Estimation conjointe en ondelette des paramètres du phénomène de dépendance longue , 1997 .

[26]  Sally Floyd,et al.  Wide-area traffic: the failure of Poisson modeling , 1994 .

[27]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[28]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[29]  John F. Shoch,et al.  Measured performance of an Ethernet local network , 1980, CACM.

[30]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[31]  Ronald R. Coifman,et al.  In Wavelets and Statistics , 1995 .