Speeding up the FMMR perfect sampling algorithm: A case study revisited

In a previous paper by the second author, two Markov chain Monte Carlo perfect sampling algorithms--one called coupling from the past (CFTP) and the other (FMMR) based on rejection sampling--are compared using as a case study the move-to-front (MTF) self-organizing list chain. Here we revisit that case study and, in particular, exploit the dependence of FMMR on the user-chosen initial state. We give a stochastic monotonicity result for the running time of FMMR applied to MTF and thus identify the initial state that gives the stochastically smallest running time; by contrast, the initial state used in the previous study gives the stochastically largest running time. By changing from worst choice to best choice of initial state we achieve remarkable speedup of FMMR for MTF; for example, we reduce the running time (as measured in Markov chain steps) from exponential in the length n of the list nearly down to n when the items in the list are requested according to a geometric distribution. For this same example, tile running time for CFTP grows exponentially in n.

[1]  J. A. Fill The Move-to-Front Rule: A Case Study for two Perfect Sampling Algorithms , 1998, Probability in the Engineering and Informational Sciences.

[2]  David J. Aldous,et al.  Lower bounds for covering times for reversible Markov chains and random walks on graphs , 1989 .

[3]  Luc Devroye,et al.  Non-Uniform Random Variate Generation , 1986 .

[4]  T. Liggett Interacting Particle Systems , 1985 .

[5]  J. Propp,et al.  Exact sampling with coupled Markov chains and applications to statistical mechanics , 1996 .

[6]  David Bruce Wilson Layered Multishift Coupling for use in Perfect Sampling Algorithms (with a primer on CFTP) , 1999 .

[7]  J. A. Fill An interruptible algorithm for perfect sampling via Markov chains , 1998 .

[8]  James Allen Fill,et al.  An exact formula for the move-to-front rule for self-organizing lists , 1996 .

[9]  David Wilson,et al.  Coupling from the past: A user's guide , 1997, Microsurveys in Discrete Probability.

[10]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[11]  James Allen Fill,et al.  Extension of Fill's perfect rejection sampling algorithm to general chains (Extended abstract) , 2000 .

[12]  James Allen Fill,et al.  Analysis of Top To Random Shuffles , 1992, Combinatorics, Probability and Computing.

[13]  Wilfrid S. Kendall,et al.  Perfect Simulation for the Area-Interaction Point Process , 1998 .

[14]  David Bruce Wilson,et al.  Annotated bibliography of perfectly random sampling with Markov chains , 1997, Microsurveys in Discrete Probability.

[15]  W. J. Hendricks The stationary distribution of an interesting Markov chain , 1972, Journal of Applied Probability.

[16]  James Allen Fill,et al.  Extension of Fill's perfect rejection sampling algorithm to general chains , 2000, Random Struct. Algorithms.

[17]  David Bruce Wilson,et al.  How to Get a Perfectly Random Sample from a Generic Markov Chain and Generate a Random Spanning Tree of a Directed Graph , 1998, J. Algorithms.