Shuffling by Semi-random Transpositions

In the cyclic-to-random shuffle, we are given n cards arranged in a circle. At step k, we exchange the kth card along the circle with a uniformly chosen random card. The problem of determining the mixing time of the cyclic-to-random shuffle was raised by Aldous and Diaconis in 1986. Mironov used this shuffle as a model for the cryptographic system known as RC4, and proved an upper bound of O(n log n) for the mixing time. We prove a matching lower bound, thus establishing that the mixing time is indeed of order /spl Theta/(n log n). We also prove an upper bound of O(n log n) for the mixing time of any "semirandom transposition shuffle", i.e., any shuffle in which a random card is exchanged with another card chosen according to an arbitrary (deterministic or random) rule. To prove our lower bound, we exhibit an explicit complex-valued test function which typically takes very different values for permutations arising from few iterations of the cyclic-to-random-shuffle and for uniform random permutations. Perhaps surprisingly, the proof hinges on the fact that the function e/sup z/ - 1 has nonzero fixed points in the complex plane. A key insight from our work is the importance of complex analysis tools for uncovering structure in nonreversible Markov chains.

[1]  P. Diaconis,et al.  Analysis of systematic scan Metropolis algorithms using Iwahori-Hecke algebra techniques , 2004, math/0401318.

[2]  P. Diaconis,et al.  SHUFFLING CARDS AND STOPPING-TIMES , 1986 .

[3]  P. Diaconis,et al.  Generating a random permutation with random transpositions , 1981 .

[4]  P. Diaconis Group representations in probability and statistics , 1988 .

[5]  P. Diaconis,et al.  Trailing the Dovetail Shuffle to its Lair , 1992 .

[6]  Persi Diaconis,et al.  Applications of non-commutative fourier analysis to probability problems , 1988 .

[7]  Fang Chen,et al.  Lifting Markov chains to speed up mixing , 1999, STOC '99.

[8]  Elchanan Mossel,et al.  Mixing times of the biased card shuffling and the asymmetric exclusion process , 2002, math/0207199.

[9]  E. Thorp Nonrandom Shuffling with Applications to the Game of Faro , 1973 .

[10]  S. Lang Complex Analysis , 1977 .

[11]  D. Wilson Mixing times of lozenge tiling and card shuffling Markov chains , 2001, math/0102193.

[12]  Y. Amit On rates of convergence of stochastic relaxation for Gaussian and non-Gaussian distributions , 1991 .

[13]  L. A. Goldberg,et al.  Systematic scan for sampling colorings , 2006, math/0603323.

[14]  Y. Amit Convergence properties of the Gibbs sampler for perturbations of Gaussians , 1996 .

[15]  Goodman,et al.  Multigrid Monte Carlo method. Conceptual foundations. , 1989, Physical review. D, Particles and fields.

[16]  Ilya Mironov,et al.  (Not So) Random Shuffles of RC4 , 2002, IACR Cryptol. ePrint Arch..

[17]  J. Kahane Some Random Series of Functions , 1985 .

[18]  D. Aldous Random walks on finite groups and rapidly mixing markov chains , 1983 .

[19]  U. Grenander,et al.  Comparing sweep strategies for stochastic relaxation , 1991 .

[20]  David Bruce Wilson,et al.  Mixing Time of the Rudvalis Shuffle , 2002, math/0210469.