Probability: Theory and Examples

This book is an introduction to probability theory covering laws of large numbers, central limit theorems, random walks, martingales, Markov chains, ergodic theorems, and Brownian motion. It is a comprehensive treatment concentrating on the results that are the most useful for applications. Its philosophy is that the best way to learn probability is to see it in action, so there are 200 examples and 450 problems.

[1]  Simon Newcomb,et al.  Note on the Frequency of Use of the Different Digits in Natural Numbers , 1881 .

[2]  L. Bachelier,et al.  Théorie de la spéculation , 1900 .

[3]  M. Borel.  Les probabilités dénombrables et leurs applications arithmétiques , 1909 .

[4]  J. E. Littlewood,et al.  Some problems of diophantine approximation , 1914 .

[5]  J. Littlewood,et al.  Some problems of diophantine approximation , 1914 .

[6]  H. Steinhaus.  Les probabilités dénombrables et leur rapport à la théorie de la mesure , 1923 .

[7]  S. Banach,et al.  Sur la décomposition des ensembles de points en parties respectivement congruentes , 1924 .

[8]  Adolphe Lindebaum,et al.  Contributions à l'étude de l'espace métrique I , 1926 .

[9]  G. Birkhoff.  Proof of the Ergodic Theorem , 1931, Proceedings of the National Academy of Sciences.

[10]  N. Wiener,et al.  Notes on random functions , 1933 .

[11]  E. Wright,et al.  An Introduction to the Theory of Numbers , 1939 .

[12]  漸近的概週期性ト ergodic theorems,II , 1939 .

[13]  Shizuo Kakutani,et al.  Birkhoff's Ergodic Theorem and the Maximal Ergodic Theorem , 1939 .

[14]  P. Hartman,et al.  On the Law of the Iterated Logarithm , 1941 .

[15]  P. Erdös.  On the Law of the Iterated Logarithm , 1942 .

[16]  B. Gnedenko.  Sur La Distribution Limite Du Terme Maximum D'Une Serie Aleatoire , 1943 .

[17]  P. Erdös,et al.  On certain limit theorems of the theory of probability , 1946 .

[18]  William Feller,et al.  A Limit Theorem for Random Variables with Infinite Moments , 1946 .

[19]  On the Ergodic Theorems , 1947 .

[20]  M. Kac.  On the notion of recurrence in discrete stochastic processes , 1947 .

[21]  M. Kac.  Random Walk and the Theory of Brownian Motion , 1947 .

[22]  P. Erdös,et al.  On the number of positive sums of independent random variables , 1947 .

[23]  J. Doob.  Heuristic Approach to the Kolmogorov-Smirnov Theorems , 1949 .

[24]  Kai Lai Chung,et al.  A Course in Probability Theory , 1949 .

[25]  B. Friedman,et al.  A simple urn model , 1949 .

[26]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[27]  Paul Erdös,et al.  Some Problems on Random Walk in Space , 1951 .

[28]  Kai Lai Chung,et al.  On the distribution of values of sums of random variables , 1951 .

[29]  C. Ryll-Nardzewski.  On the ergodic theorems (II) (Ergodic theory of continued fractions) , 1951 .

[30]  M. Donsker.  Justification and Extension of Doob's Heuristic Approach to the Kolmogorov- Smirnov Theorems , 1952 .

[31]  B. McMillan.  The Basic Theorems of Information Theory , 1953 .

[32]  J. Doob.  Stochastic processes , 1953 .

[33]  B. Gnedenko,et al.  Limit Distributions for Sums of Independent Random Variables , 1955 .

[34]  L. Weiss.  The Stochastic Convergence of a Function of Sample Successive Differences , 1955 .

[35]  L. J. Savage,et al.  Symmetric measures on Cartesian products , 1955 .

[36]  M. Rosenblatt.  A CENTRAL LIMIT THEOREM AND A STRONG MIXING CONDITION. , 1956, Proceedings of the National Academy of Sciences of the United States of America.

[37]  E. Pitman.  On the Derivatives of a Characteristic Function at the Origin , 1956 .

[38]  G. A. Hunt.  SOME THEOREMS CONCERNING BROWNIAN MOTION , 1956 .

[39]  A. A. Yushkevich,et al.  Strong Markov Processes , 1956 .

[40]  T. E. Harris.  The Existence of Stationary Measures for Certain Markov Processes , 1956 .

[41]  Paul Erdös,et al.  On the Lipschitz's condition for Brownian motion , 1959 .

[42]  M. Kac.  Statistical Independence in Probability Analysis and Number Theory , 1959 .

[43]  M. Motoo.  Proof of the law of iterated logarithm through diffusion equation , 1959 .

[44]  J. L. Hodges,et al.  The Poisson Approximation to the Poisson Binomial Distribution , 1960 .

[45]  H. Furstenberg,et al.  Products of Random Matrices , 1960 .

[46]  A. Kolmogorov,et al.  On Strong Mixing Conditions for Stationary Gaussian Processes , 1960 .

[47]  P. Billingsley,et al.  The Lindeberg-Lévy theorem for martingales , 1961 .

[48]  William Feller,et al.  A simple proof for renewal theorems , 1961 .

[49]  A. Dvoretzky,et al.  Nonincrease Everywhere of the Brownian Motion Process , 1961 .

[50]  I. Ibragimov,et al.  Some Limit Theorems for Stationary Processes , 1962 .

[51]  I. Ibragimov,et al.  A Central Limit Theorem for a Class of Dependent Random Variables , 1963 .

[52]  C. C. Heyde,et al.  On a Property of the Lognormal Distribution , 1963 .

[53]  F. Spitzer.  Principles Of Random Walk , 1966 .

[54]  V. Strassen.  An invariance principle for the law of the iterated logarithm , 1964 .

[55]  L. Shepp.  Recurrent random walks with arbitrarily large steps , 1964 .

[56]  David A. Freedman,et al.  The Tail $\sigma$-Field of a Markov Chain and a Theorem of Orey , 1964 .

[57]  D. Freedman.  Bernard Friedman's Urn , 1965 .

[58]  J. Neveu,et al.  Mathematical foundations of the calculus of probability , 1965 .

[59]  Patrick Billingsley,et al.  Asymptotic Distributions for the Coupon Collector's Problem , 1965 .

[60]  Edwin Hewitt,et al.  Real And Abstract Analysis , 1967 .

[61]  L. Lecam,et al.  On the Distribution of Sums of Independent Random Variables , 1965 .

[62]  David A. Freedman,et al.  A Sharper Form of the Borel-Cantelli Lemma and the Strong Law , 1965 .

[63]  V. Strassen.  A converse to the law of the iterated logarithm , 1966 .

[64]  C. Heyde.  On the influence of moments on the rate of convergence to the normal distribution , 1967 .

[65]  Volker Strassen,et al.  Almost sure behavior of sums of independent random variables and martingales , 1967 .

[66]  L. Dubins.  On a Theorem of Skorohod , 1968 .

[67]  G. Hardy,et al.  An Introduction To The Theory Of Numbers Fourth Edition , 1968 .

[68]  P. Billingsley,et al.  Convergence of Probability Measures , 1970, The Mathematical Gazette.

[69]  V. I. Oseledec.  A multiplicative ergodic theorem: Lyapunov characteristic num-bers for dynamical systems , 1968 .

[70]  Diffusion Processes and their Sample Paths. , 1968 .

[71]  J. Kingman,et al.  The Ergodic Theory of Subadditive Stochastic Processes , 1968 .

[72]  D. H. Root.  The Existence of Certain Stopping Times on Brownian Motion , 1969 .

[73]  C. J. Stone.  Asymptotic behavior of the convolution of a pair of measures , 1969 .

[74]  C. J. Stone,et al.  Potential theory of random walks on Abelian groups , 1969 .

[75]  D. Ornstein.  Random walks. I , 1969 .

[76]  On the potential operator for one-dimensional recurrent random walks. , 1969 .

[77]  Allan F. Abrahamse.  The Tail Field of a Markov Chain , 1969 .

[78]  R. Solovay.  A model of set-theory in which every set of reals is Lebesgue measurable* , 1970 .

[79]  I. Ibragimov,et al.  Independent and stationary sequences of random variables , 1971 .

[80]  D. Freedman.  Brownian motion and diffusion , 1971 .

[81]  W. Feller,et al.  An Introduction to Probability Theory and Its Applications, Vol. II , 1972, The Mathematical Gazette.

[82]  M. Rosenblatt.  Central limit theorem for stationary processes , 1972 .

[83]  A. Dvoretzky,et al.  Asymptotic normality for sums of dependent random variables , 1972 .

[84]  J. Hammersley.  A few seedlings of research , 1972 .

[85]  P. V. Beek,et al.  An application of Fourier methods to the problem of sharpening the Berry-Esseen inequality , 1972 .

[86]  Horst Wegner.  On consistency of probability measures , 1973 .

[87]  D. Lindley.  The foundations of statistics (second edition), by Leonard J. Savage. Pp xv, 310. £1·75. 1972 (Dover/Constable) , 1973 .

[88]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[89]  J. Kingman.  Subadditive Ergodic Theory , 1973 .

[90]  D. Scott,et al.  Central limit theorems for martingales and for processes with stationary increments using a Skorokhod representation approach , 1973, Advances in Applied Probability.

[91]  G. O'Brien.  Limit theorems for sums of chain-dependent processes , 1974, Journal of Applied Probability.

[92]  David Sankoff,et al.  Longest common subsequences of two random sequences , 1975, Advances in Applied Probability.

[93]  J. Kingman.  The First Birth Problem for an Age-dependent Branching Process , 1975 .

[94]  Joel Spencer,et al.  Optimal Doubling in Backgammon , 1975, Oper. Res..

[95]  J. Neveu,et al.  Discrete Parameter Martingales , 1975 .

[96]  On a unified approach to the law of the iterated logarithm for martingales , 1976 .

[97]  Hiroshi Ishitani,et al.  A Central Limit Theorem for the Subadditive Process and Its Application to Products of Random Matrices , 1976 .

[98]  R. A. Raimi.  The First Digit Problem , 1976 .

[99]  R. Smythe,et al.  First-passage percolation on the square lattice. I , 1977, Advances in Applied Probability.

[100]  B. Logan,et al.  A Variational Problem for Random Young Tableaux , 1977 .

[101]  I. Zucker,et al.  Extended Watson integrals for the cubic lattices. , 1977, Proceedings of the National Academy of Sciences of the United States of America.

[102]  J. Biggins.  Chernoff's theorem in the branching random walk , 1977, Journal of Applied Probability.

[103]  A Probabilistic Proof of Blackwell's Renewal Theorem , 1977 .

[104]  P. Ney,et al.  Coupling and the Renewal Theorem , 1978 .

[105]  Sidney C. Port,et al.  Brownian Motion and Classical Potential Theory , 1978 .

[106]  R. Durrett,et al.  Functional Limit Theorems for Dependent Variables , 1978 .

[107]  J. D. Biggins,et al.  The asymptotic shape of the branching random walk , 1978, Advances in Applied Probability.

[108]  K. Athreya,et al.  A New Approach to the Limit Theory of Recurrent Markov Chains , 1978 .

[109]  P. Billingsley,et al.  Probability and Measure , 1980 .

[110]  J. Biggins.  Growth rates in the branching random walk , 1979 .

[111]  M. Raghunathan.  A proof of Oseledec’s multiplicative ergodic theorem , 1979 .

[112]  D. Ruelle.  Ergodic theory of differentiable dynamical systems , 1979 .

[113]  David A. Freedman,et al.  Exchangeable processes need not be mixtures of independent, identically distributed random variables , 1979 .

[114]  D. Freedman,et al.  Finite Exchangeable Sequences , 1980 .

[115]  P. Hall,et al.  Martingale Limit Theory and Its Application , 1980 .

[116]  D. Freedman.  A mixture of independent identically distributed random variables need not admit a regular conditional probability given the exchangeable σ-field , 1980 .

[117]  J. T. Cox,et al.  Some Limit Theorems for Percolation Processes with Necessary and Sufficient Conditions , 1981 .

[118]  N. Etemadi.  An elementary proof of the strong law of large numbers , 1981 .

[119]  Y. Katznelson,et al.  A simple proof of some ergodic theorems , 1982 .

[120]  Edwin A. Perkins,et al.  On the Hausdorff dimension of the Brownian slow points , 1983 .

[121]  Burgess Davis.  On Brownian slow points , 1983 .

[122]  P. Hall.  Rates of convergence in the central limit theorem , 1983 .

[123]  Shey Shiung Sheu,et al.  The Poisson Approximation to the Binomial Distribution , 1984 .

[124]  Arnold M. Faden,et al.  The Existence of Regular Conditional Probabilities: Necessary and Sufficient Conditions , 1985 .

[125]  T. Liggett.  An Improved Subadditive Ergodic Theorem , 1985 .

[126]  P. Diaconis,et al.  SHUFFLING CARDS AND STOPPING-TIMES , 1986 .

[127]  S. Sheu.  Representing a distribution by stopping a Brownian Motion: Root's construction , 1986, Bulletin of the Australian Mathematical Society.

[128]  H. Kesten.  Aspects of first passage percolation , 1986 .

[129]  Joel E. Cohen,et al.  Random matrices and their applications , 1986 .

[130]  C. Stein.  Approximate computation of expectations , 1986 .

[131]  Hermann Thorisson,et al.  A complete coupling proof of Blackwell's renewal theorem , 1987 .

[132]  T. Hara,et al.  Critical exponent of susceptibility for a class of general ferromagnets in d>4 dimensions , 1987 .

[133]  S. Resnick.  Extreme Values, Regular Variation, and Point Processes , 1987 .

[134]  A. Shiryaev,et al.  Limit Theorems for Stochastic Processes , 1987 .

[135]  Harry Kesten,et al.  Percolation Theory and First-Passage Percolation , 1987 .

[136]  S. Levental.  A proof of Liggett's version of the subadditive ergodic theorem , 1988 .

[137]  R. French.  The Banach-Tarski theorem , 1988 .

[138]  Jordan Stoyanov,et al.  Counterexamples in Probability , 1988 .

[139]  R. M. Dudley,et al.  Real Analysis and Probability , 1989 .