Random walks with “back buttons” (extended abstract)

We introduce backoffprocesses, an idealized stochastic model o f browsing on the world-wide web, which incorporates both hyperlink traversals and use o f the "back button" With some probability the next state is generated by a distribution over out-edges from the current state, as in a traditional Markov chain. With the remaining probability, however, the next state is generated by clicking on the back button, and returning to the state from which the current state was entered by a "forward move". Repeated clicks on the back button require access to increasingly distant history. We show that this process has fascinating similarities to and differences from Markov chains. In particular, we prove that like Markov chains, backoff processes always have a limit distribution, and we give algorithms to compute this distribution. Unlike Markov chains, the limit distribution may depend on the start state.

[1]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[2]  J. Kemeny,et al.  Denumerable Markov chains , 1969 .

[3]  M. Lewin On nonnegative matrices , 1971 .

[4]  L. Lovász,et al.  Geometric Algorithms and Combinatorial Optimization , 1981 .

[5]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[6]  Ted Selker,et al.  COACH: a teaching agent that learns , 1994, CACM.

[7]  Henry Lieberman,et al.  Letizia: An Agent That Assists Web Browsing , 1995, IJCAI.

[8]  Paul P. Maglio,et al.  How to personalize the Web , 1997, CHI.

[9]  Ravi Kumar,et al.  On targeting Markov segments , 1999, STOC '99.

[10]  Russ Bubley,et al.  Randomized algorithms , 1995, CSUR.