Estimation of internet file-access/modification rates from indirect data

Consider an Internet file for which data on last time of access/modification (A/M) of the file are collected at periodic intervals, but for which direct A/M data are not available. Methodology is developed here that enables estimation of the A/M rates, in spite of having only indirect data of this nature. Both parametric and nonparametric methods are developed. Theoretical and empirical analyses are presented that indicate that the problem is indeed statistically tractable, and that the methods developed are of practical value. Behavior of the parametric estimators is examined when these assumptions are violated, and these estimators are found to be robust against some such violations.

[1]  Virgílio A. F. Almeida,et al.  Capacity Planning for Web Performance: Metrics, Models, and Methods , 1998 .

[2]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[3]  Luc Rey-Bellet,et al.  Ergodic properties of Markov processes , 2006 .

[4]  Paul S. Hethmon Illustrated Guide to Http , 1997 .

[5]  J. Kalbfleisch Statistical Inference Under Order Restrictions , 1975 .

[6]  E. Lehmann Elements of large-sample theory , 1998 .

[7]  Hector Garcia-Molina,et al.  Effective page refresh policies for Web crawlers , 2003, TODS.

[8]  Kishor S. Trivedi Probability and Statistics with Reliability, Queuing, and Computer Science Applications , 1984 .

[9]  Hector Garcia-Molina,et al.  Estimating frequency of change , 2003, TOIT.

[10]  Thomas D. Sandry,et al.  Introductory Statistics With R , 2003, Technometrics.

[11]  Peter Dalgaard,et al.  Introductory statistics with R , 2002, Statistics and computing.

[12]  Virgílio A. F. Almeida,et al.  Capacity planning for web performance: metrics , 1998 .

[13]  Mary C. Meyer AN ALTERNATIVE UNIMODAL DENSITY ESTIMATOR WITH A CONSISTENT ESTIMATE OF THE MODE , 1999 .

[14]  A. V. D. Vaart,et al.  Asymptotic Statistics: Frontmatter , 1998 .

[15]  Ing Rj Ser Approximation Theorems of Mathematical Statistics , 1980 .

[16]  Kishor S. Trivedi,et al.  Probability and Statistics with Reliability, Queuing and Computer Science Applications, Second Edition , 2002 .

[17]  Vincent Hodgson Probability Modeling and Computer Simulation , 1989 .

[18]  J. Simonoff Smoothing Methods in Statistics , 1998 .