The Monte Carlo Algorithm With a Pseudorandom Generator

We analyze the Monte Carlo algorithm for the approximation of multivariate integrals when a pseudorandom generator is used. We establish lower and upper bounds on the error of such algorithms. We prove that as long as a pseudorandom generator is capable of producing only finitely many points, the Monte Carlo algorithm with such a pseudorandom generator fails for ?2 or continuous functions. It also fails for Lipschitz functions if the number of points does not depend on the number of variables. This is the case if a linear congruential generator is used with one initial seed. On the other hand, if a linear congruential generator of period m is used for each component, with independent uniformly distributed initial seeds, then the Monte Carlo algorithm with such a pseudorandom generator using n function values behaves as for the uniform distribution and its expected error is roughly n-1/2 as long as the number n of function values is less than m2 . X. Introduction Randomization is being widely used or proposed to solve both continuous and discrete problems. Examples include multivariate integration, algebraic eigenvalues, primality testing, byzantine agreement, and verification. When randomized algorithms are implemented on a computer, pseudorandom numbers must be used. In this paper we investigate whether the good properties of the Monte Carlo algorithm for multivariate integration hold if pseudorandom numbers are used. We suggest that such an analysis should be performed whenever randomization is used. One can identify two types of work regarding pseudorandom generators. In the first, they are studied in isolation from a particular problem. Excellent surveys are given in Knuth [11, Chapter 3] and Niederreiter [14, 15, 16]. More recently, polynomial-time unpredictability of pseudorandom generators has been studied by Yao [21], Blum and Micali [3], and others. In the second, the relation between pseudorandom generators and randomized algorithms is studied for a specific problem. Examples are provided by Bach [1], who studied finding square roots modulo a prime number and primality testing. Karloff and Raghavan [10] studied sorting, selection, and oblivious routing in networks. They showed that certain randomized algorithms work well with a linear congruential generator and a random seed. Received September 4, 1990. 1991 Mathematics Subject Classification. Primary 65C05, 65C10. ©1992 American Mathematical Society 0025-5718/92 $1.00+ $.25 per page

[1]  Henryk Wozniakowski,et al.  Information-based complexity , 1987, Nature.

[2]  N. Metropolis,et al.  The Monte Carlo method. , 1949 .

[3]  Eric Bach,et al.  Realistic analysis of some randomized algorithms , 1987, J. Comput. Syst. Sci..

[4]  Donald Ervin Knuth,et al.  The Art of Computer Programming , 1968 .

[5]  Harald Niederreiter,et al.  Quasi-Monte Carlo Methods for Multidimensional Numerical Integration , 1988 .

[6]  S. Haber A modified Monte-Carlo quadrature. II. , 1966 .

[7]  Henryk Wozniakowski,et al.  Estimating the Largest Eigenvalue by the Power and Lanczos Algorithms with a Random Start , 1992, SIAM J. Matrix Anal. Appl..

[8]  Harald Niederreiter,et al.  Recent trends in random number and random vector generation , 1991, Ann. Oper. Res..

[9]  S. B. Atienza-Samols,et al.  With Contributions by , 1978 .

[10]  H. Woxniakowski Information-Based Complexity , 1988 .

[11]  Manuel Blum,et al.  How to generate cryptographically strong sequences of pseudo random bits , 1982, 23rd Annual Symposium on Foundations of Computer Science (sfcs 1982).

[12]  Philip Rabinowitz,et al.  Methods of Numerical Integration , 1985 .

[13]  I. M. Soboĺ,et al.  Die Monte-Carlo-Methode , 1971 .

[14]  Prabhakar Raghavan,et al.  Randomized algorithms and pseudorandom numbers , 1988, STOC '88.

[15]  Andrew Chi-Chih Yao,et al.  Theory and application of trapdoor functions , 1982, 23rd Annual Symposium on Foundations of Computer Science (sfcs 1982).

[16]  J. Kuczy,et al.  Estimating the Largest Eigenvalue by the Power and Lanczos Algorithms with a Random Start , 1992 .

[17]  P. Prescott,et al.  Monte Carlo Methods , 1964, Computational Statistical Physics.

[18]  J. Hammersley,et al.  Monte Carlo Methods , 1965 .

[19]  H. Niederreiter Quasi-Monte Carlo methods and pseudo-random numbers , 1978 .

[20]  J. Halton On the efficiency of certain quasi-random sequences of points in evaluating multi-dimensional integrals , 1960 .

[21]  E. Novak Deterministic and Stochastic Error Bounds in Numerical Analysis , 1988 .

[22]  S. M. Ermakov,et al.  The Monte Carlo method , 1977 .

[23]  Prabhakar Raghavan,et al.  Randomized algorithms and pseudorandom numbers , 1993, JACM.