On excursion sets, tube formulas and maxima of random fields

This is a rambling review of what, with a few notable and significant exceptions, has been a rather dormant area for over a decade. It concentrates on the septuagenarian problem of finding good approximations for the excursion probability P supt∈TXt ≥ λ where λ is large, X is a Gaussian, or “Gaussian-like,” process over a region T ⊂ N and, generally, N > 1. A quarter of a century ago, there was a flurry of papers out of various schools linking this problem to the geometrical properties of random field sample paths. My own papers made the link via Euler characteristics of the excursion sets t ∈ T : Xt ≥ λ . A decade ago, Aldous popularized the Poisson clumping heuristic for computing excursion probabilities in a wide variety of scenarios, including the Gaussian. Over the past few years, Keith Worsley has been the driving force behind the computation of many new Euler characteristic functionals, primarily driven by applications in medical imaging. There has also been a parallel development of techniques in the astrophysical literature. Meanwhile, somewhat closer to home, Hotelling’s 1939 “tube formulas” have seen a renaissance as sophisticated statistical hypothesis testing problems led to their reapplication toward computing excursion probabilities, and Sun and others have shown how to apply them in a purely Gaussian setting. The aim of the present paper is to look again at many of these results and tie them together in new ways to obtain a few new results and, hopefully, considerable new insight. The “Punchline of this paper,” which relies heavily on a recent result of Piterbarg, is given in Section 6.6: “In computing excursion probabilities for smooth enough Gaussian random fields over reasonable enough regions, the expected Euler characteristic of the corresponding excursion sets gives an approximation, for large levels, that is accurate to as many terms as there are in its expansion.”

[1]  Andrew H. Wallace,et al.  Differential topology; first steps , 1968 .

[2]  A. Gorin ON THE VOLUME OF TUBES , 1983 .

[3]  B. Gnedenko Sur La Distribution Limite Du Terme Maximum D'Une Serie Aleatoire , 1943 .

[4]  V. Piterbarg Comparison of Distribution Functions of Maxima of Gaussian Processes , 1982 .

[5]  HIGHER ORDER APPROXIMATIONS FOR MAXIMA OF RANDOM FIELDS , 1996 .

[6]  D. Siegmund Boundary Crossing Probabilities and Statistical Applications , 1986 .

[7]  E. Kreyszig Introduction to Differential Geometry and Riemannian Geometry , 1968 .

[8]  D. Siegmund,et al.  Large deviations for the maxima of some random fields , 1986 .

[9]  C. Jennen,et al.  Second-Order Approximations to the Density, Mean and Variance of Brownian First-Exit Times , 1985 .

[10]  李幼升,et al.  Ph , 1989 .

[11]  J. Pickands Upcrossing probabilities for stationary Gaussian processes , 1969 .

[12]  D. Applebaum Stable non-Gaussian random processes , 1995, The Mathematical Gazette.

[13]  H. B. Griffiths CRITICAL POINT THEORY IN GLOBAL ANALYSIS AND DIFFERENTIAL TOPOLOGY , 1971 .

[14]  D. Siegmund,et al.  Testing for a Signal with Unknown Location and Scale in a Stationary Gaussian Random Field , 1995 .

[15]  Vladimir I. Piterbarg,et al.  On the Distribution of the Maximum of a Gaus-sian Field with Constant Variance on a Smooth Manifold , 1996 .

[16]  J. Cuzick A CENTRAL LIMIT THEOREM FOR THE NUMBER OF ZEROS OF A STATIONARY GAUSSIAN PROCESS , 1976 .

[17]  On the density of the maximum of smooth Gaussian processes , 1996 .

[18]  D. Slepian The one-sided barrier problem for Gaussian noise , 1962 .

[19]  R. Adler An introduction to continuity, extrema, and related topics for general Gaussian processes , 1990 .

[20]  Hisao Watanabe,et al.  Asymptotic properties of Gaussian random fields , 1973 .

[21]  Simeon M. Berman,et al.  Sojourns and Extremes of Stationary Processes , 1982 .

[22]  H. Cramér A Limit Theorem for the Maximum Values of Certain Stochastic Processes , 1965 .

[23]  Céline Delmas An asymptotic expansion for the distribution of the maximum of a class of Gaussian fields , 1998 .

[24]  D. Siegmund,et al.  On Hotelling's Approach to Testing for a Nonlinear Parameter in Regression , 1989 .

[25]  Hajime Takahashi,et al.  Asymptotic Expansions for the Error Probabilities of Some Repeated Significance Tests , 1982 .

[26]  K. J. Worsley,et al.  Rotation Space: Detecting Functional Activation by Searching Over Rotated and Scaled Filters , 1998, NeuroImage.

[27]  D. Aldous Probability Approximations via the Poisson Clumping Heuristic , 1988 .

[28]  S. Berman Asymptotic Independence of the Numbers of High and Low Level Crossings of Stationary Gaussian Processes , 1971 .

[29]  E. L. Wright,et al.  MORPHOLOGY OF THE INTERSTELLAR COOLING LINES DETECTED BY COBE , 1993, astro-ph/9311032.

[30]  Z. Luo THE AVERAGE NUMBER OF REAL ROOTS OF A RANDOM ALGEBRAIC EQUATION , 1980 .

[31]  H. Hadwiger Vorlesungen über Inhalt, Oberfläche und Isoperimetrie , 1957 .

[32]  R. J. Adler,et al.  A non-gaussian model for random surfaces , 1981, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[33]  S. Resnick Extreme Values, Regular Variation, and Point Processes , 1987 .

[34]  D. Siegmund,et al.  Tail approximations for maxima of random fields , 1992 .

[35]  E. Bulinskaya On the Mean Number of Crossings of a Level by a Stationary Gaussian Process , 1961 .

[36]  Heping Zhang,et al.  The Expected Number of Local Maxima of a Random Field and the Volume of Tubes , 1993 .

[37]  V. Piterbarg,et al.  On Maximum of Gaussian Non-Centered Fields Indexed on Smooth Manifolds , 2001 .

[38]  M. Lifshits Tail probabilities of Gaussian suprema and Laplace transform , 1994 .

[39]  A nonasymptotic approach to the density of the maximum of smooth Gaussian processes , 1995 .

[40]  H. Hotelling Tubes and Spheres in n-Spaces, and a Class of Statistical Problems , 1939 .

[41]  C. Borell The Brunn-Minkowski inequality in Gauss space , 1975 .

[42]  M. Talagrand THE SUPREMUM OF SOME CANONICAL PROCESSES , 1994 .

[43]  Keith J. Worsley,et al.  The Geometry of Random Images , 1996 .

[44]  Mark Kac,et al.  Toeplitz matrices, translation kernels and a related problem in probability theory , 1954 .

[45]  H. Cramér On the intersections between the trajectories of a normal stationary stochastic process and a high level , 1966 .

[46]  J. Cao The size of the connected components of excursion sets of χ2, t and F fields , 1999, Advances in Applied Probability.

[47]  Richard M. Dudley,et al.  Sample Functions of the Gaussian Process , 1973 .

[48]  N. Ylvisaker The Expected Number of Zeros of a Stationary Gaussian Process , 1965 .

[49]  R. Adler,et al.  The Geometry of Random Fields , 1982 .

[50]  Terrence L. Fine,et al.  Assessing generalization of feedforward neural networks , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.

[51]  D. Slepian,et al.  Large Excursions of Gaussian Processes , 1959 .

[52]  R. Schneider Convex Bodies: The Brunn–Minkowski Theory: Minkowski addition , 1993 .

[53]  M. Spivak A comprehensive introduction to differential geometry , 1979 .

[54]  K. Worsley,et al.  The geometry of correlation fields with an application to functional connectivity of the brain , 1999 .

[55]  T. Malevich Asymptotic Normality of the Number of Crossings of Level Zero by a Gaussian Process , 1969 .

[56]  Jiayang Sun Tail probabilities of the maxima of Gaussian random fields , 1993 .

[57]  K. Worsley,et al.  Local Maxima and the Expected Euler Characteristic of Excursion Sets of χ 2, F and t Fields , 1994, Advances in Applied Probability.

[58]  S. Rice Mathematical analysis of random noise , 1944 .

[59]  D. Siegmund,et al.  THE APPROXIMATE DISTRIBUTION OF THE MAXIMUM OF A SMOOTHED POISSON RANDOM FIELD , 1997 .

[60]  Michael B. Marcus,et al.  Bounds for the expected number of level crossings of certain harmonizable infinitely divisible processes , 1998 .

[61]  M. Talagrand A simple proof of the majorizing measure theorem , 1992 .

[62]  The Golden Age of Cosmology , 1992 .

[63]  I. Johnstone,et al.  On Hotelling's Formula for the Volume of Tubes and Naiman's Inequality , 1989 .

[64]  K. Worsley,et al.  THE DETECTION OF LOCAL SHAPE CHANGES VIA THE GEOMETRY OF HOTELLING’S T 2 FIELDS 1 , 1999 .

[65]  I. Ibragimov,et al.  Norms of Gaussian sample functions , 1976 .

[66]  S. Berman Stationary and Related Stochastic Processes , 1967 .

[67]  L. Santaló Integral geometry and geometric probability , 1976 .

[68]  Sur la loi du maximum de certains processus gaussions sur le tore , 1981 .

[69]  B. Ripley,et al.  Introduction to the Theory of Coverage Processes. , 1989 .

[70]  Daniel Q. Naiman,et al.  Volumes of Tubular Neighborhoods of Spherical Polyhedra and Statistical Inference , 1990 .

[71]  L. Shepp,et al.  Sample behavior of Gaussian processes , 1972 .

[72]  D. Siegmund Large Deviations for Boundary Crossing Probabilities. , 1982 .

[73]  M. Marcus ξ-radial processes and random Fourier series , 1987 .

[74]  D. Naiman,et al.  INCLUSION-EXCLUSION-BONFERRONI IDENTITIES AND INEQUALITIES FOR DISCRETE TUBE-LIKE PROBLEMS VIA EULER CHARACTERISTICS , 1992 .

[75]  David Siegmund,et al.  Approximate Tail Probabilities for the Maxima of Some Random Fields , 1988 .

[76]  D. Siegmund,et al.  Approximate Exit Probabilities for a Brownian Bridge on a Short Time Interval, and Applications. , 1989 .

[77]  G. Pisier Probabilistic methods in the geometry of Banach spaces , 1986 .

[78]  M. Talagrand Regularity of gaussian processes , 1987 .

[79]  D. Siegmund,et al.  Conditional boundary crossing probabilities, with applications to change-point problems , 1988 .

[80]  J. Hüsler Extremes and related properties of random sequences and processes , 1984 .

[81]  K. Worsley,et al.  Boundary corrections for the expected Euler characteristic of excursion sets of random fields, with an application to astrophysics , 1995, Advances in Applied Probability.

[82]  S. Berman Limit Theorems for the Maximum Term in Stationary Sequences , 1964 .

[83]  M. Kratz,et al.  On the rate of convergence for extremes of mean square differentiable stationary normal processes , 1997, Journal of Applied Probability.

[84]  H. Landau,et al.  On the supremum of a Gaussian process , 1970 .

[85]  川崎 恭治,et al.  Formation, dynamics and statistics of patterns , 1990 .

[86]  J. Seaman Introduction to the theory of coverage processes , 1990 .

[87]  G. Pisier,et al.  Random Fourier Series with Applications to Harmonic Analysis. , 1981 .

[88]  V. S. Tsirel’son The Density of the Distribution of the Maximum of a Gaussian Process , 1976 .

[89]  K. Worsley Testing for signals with unknown location and scale in a χ2 random field, with an application to fMRI , 2001, Advances in Applied Probability.

[90]  Michael B. Marcus,et al.  Some bounds for the expected number of level crossings of symmetric harmonizable p-stable processes , 1989 .

[91]  W. J. Thron,et al.  Encyclopedia of Mathematics and its Applications. , 1982 .

[92]  J. Doob Stochastic processes , 1953 .

[93]  James Pickands,et al.  Asymptotic properties of the maximum in a stationary Gaussian process. , 1969 .

[94]  Jiayang Sun Some Practical Aspects of Exploratory Projection Pursuit , 1993, SIAM J. Sci. Comput..

[95]  M. Talagrand,et al.  Probability in Banach Spaces: Isoperimetry and Processes , 1991 .

[96]  Iain M. Johnstone,et al.  Hotelling's Theorem on the Volume of Tubes: Some Illustrations in Simultaneous Inference and Data Analysis , 1990 .

[97]  H. Hadwiger,et al.  Normale Körper im euklidischen Raum und ihre topologischen und metrischen Eigenschaften , 1959 .

[98]  R. Dudley The Sizes of Compact Subsets of Hilbert Space and Continuity of Gaussian Processes , 1967 .

[99]  M. Talagrand Sharper Bounds for Gaussian and Empirical Processes , 1994 .

[100]  Vladimir I. Piterbarg,et al.  Asymptotic Methods in the Theory of Gaussian Processes and Fields , 1995 .

[101]  Simeon M. Berman,et al.  Maxima and high level excursions of stationary Gaussian processes , 1971 .

[102]  G. Lindgren Local maxima of Gaussian fields , 1972 .

[103]  harald Cramer,et al.  Stationary And Related Stochastic Processes , 1967 .

[104]  Gennady Samorodnitsky,et al.  Level Crossings of Absolutely Continuous Stationary Symmetric ?-stable Processes , 1997 .

[105]  G. Matheron Random Sets and Integral Geometry , 1976 .

[106]  N. Steenrod,et al.  Foundations of Algebraic Topology , 1952 .

[107]  Large Deviations of Random Processes Close to Gaussian Ones , 1983 .

[108]  P. Bickel,et al.  Two-Dimensional Random Fields , 1973 .

[109]  M. Talagrand,et al.  Probability in Banach spaces , 1991 .

[110]  Kiyosi Itô The expected number of zeros of continuous stationary Gaussian processes , 1963 .

[111]  Jiayang Sun,et al.  Significance levels in exploratory projection pursuit , 1991 .

[112]  G. Hinshaw,et al.  Structure in the COBE differential microwave radiometer first-year maps , 1992 .

[113]  K. Worsley Estimating the number of peaks in a random field using the Hadwiger characteristic of excursion sets, with applications to medical images , 1995 .