Extreme first passage times of piecewise deterministic Markov processes

The time it takes the fastest searcher out of N ≫ 1 searchers to find a target determines the timescale of many physical, chemical, and biological processes. This time is called an extreme first passage time (FPT) and is typically much faster than the FPT of a single searcher. Extreme FPTs of diffusion have been studied for decades, but little is known for other types of stochastic processes. In this paper, we study the distribution of extreme FPTs of piecewise deterministic Markov processes (PDMPs). PDMPs are a broad class of stochastic processes that evolve deterministically between random events. Using classical extreme value theory, we prove general theorems which yield the distribution and moments of extreme FPTs in the limit of many searchers based on the short time distribution of the FPT of a single searcher. We then apply these theorems to some canonical PDMPs, including run and tumble searchers in one, two, and three space dimensions. We discuss our results in the context of some biological systems and show how our approach accounts for an unphysical property of diffusion which can be problematic for extreme statistics.

[1]  P. Bressloff,et al.  Quasi-steady State Reduction of Molecular Motor-Based Models of Directed Intermittent Search , 2010, Bulletin of mathematical biology.

[2]  Werner Horsthemke,et al.  Noise-induced transitions , 1984 .

[3]  Bard Ermentrout,et al.  Stochastic representations of ion channel kinetics and exact stochastic simulation of neuronal dynamics , 2014, Journal of Computational Neuroscience.

[4]  M. Moreau,et al.  Intermittent search strategies , 2011, 1104.0639.

[5]  Alexandru Hening,et al.  The competitive exclusion principle in stochastic environments , 2018, Journal of Mathematical Biology.

[6]  USA,et al.  Efficient search by optimized intermittent random walks , 2009, 0909.1048.

[7]  Martin Hairer,et al.  Exponential ergodicity for Markov processes with random switching , 2013, 1303.6999.

[8]  D. Coombs.  First among equals: Comment on "Redundancy principle and the role of extreme statistics in molecular and cellular biology" by Z. Schuss, K. Basnayake and D. Holcman. , 2019, Physics of life reviews.

[9]  Stephen R. Proulx,et al.  Gene expression dynamics in randomly varying environments , 2010, Journal of mathematical biology.

[10]  Nathalie Rouach,et al.  Why so many sperm cells? , 2015, Communicative & integrative biology.

[11]  Mean first passage times for piecewise deterministic Markov processes and the effects of critical points , 2017 .

[12]  S. Redner.  A guide to first-passage processes , 2001 .

[13]  Jonathan C. Mattingly,et al.  Sensitivity to switching rates in stochastically switched odes , 2013, 1310.2525.

[14]  Charles R Doering,et al.  Gene expression dynamics with stochastic bursts: Construction and exact results for a coarse-grained model. , 2015, Physical review. E.

[15]  S. Redner,et al.  Redundancy, extreme statistics and geometrical optics of Brownian motion: Comment on "Redundancy principle and the role of extreme statistics in molecular and cellular biology" by Z. Schuss et al. , 2019, Physics of life reviews.

[16]  I. Sokolov.  Extreme fluctuation dominance in biology: On the usefulness of wastefulness: Comment on "Redundancy principle and the role of extreme statistics in molecular and cellular biology" by Z. Schuss, K. Basnayake and D. Holcman. , 2019, Physics of life reviews.

[17]  J. Parrondo,et al.  SPATIAL PATTERNS INDUCED BY RANDOM SWITCHING , 2002, The Random and Fluctuating World.

[18]  G. Schehr,et al.  Run-and-tumble particle in one-dimensional confining potentials: Steady-state, relaxation, and first-passage properties. , 2018, Physical review. E.

[19]  James Pickands,et al.  Moment Convergence of Sample Extremes , 1968 .

[20]  M. Heineman,et al.  Intra-uterine insemination for male subfertility. , 2007, The Cochrane database of systematic reviews.

[21]  Z. Schuss,et al.  Search for a small egg by spermatozoa in restricted geometries , 2015, Journal of Mathematical Biology.

[22]  Ioana Bena.  DICHOTOMOUS MARKOV NOISE: EXACT RESULTS FOR OUT-OF-EQUILIBRIUM SYSTEMS , 2006 .

[23]  L. Martyushev.  Minimal time, Weibull distribution and maximum entropy production principle: Comment on "Redundancy principle and the role of extreme statistics in molecular and cellular biology" by Z. Schuss et al. , 2019, Physics of life reviews.

[24]  S. Redner,et al.  Steady state, relaxation and first-passage properties of a run-and-tumble particle in one-dimension , 2017, 1711.08474.

[25]  C. Vidal,et al.  Non-Equilibrium Dynamics in Chemical Systems , 1984 .

[26]  David Holcman,et al.  Asymptotic Formulas for Extreme Statistics of Escape Times in 1, 2 and 3-Dimensions , 2017, J. Nonlinear Sci..

[27]  Jonathan C. Mattingly,et al.  SENSITIVITY TO SWITCHING RATES IN STOCHASTICALLY SWITCHED , 2014 .

[28]  J. Hespanha,et al.  Hybrid systems: Generalized solutions and robust stability , 2004 .

[29]  M V Tamm,et al.  Importance of extreme value statistics in biophysical contexts: Comment on "Redundancy principle and the role of extreme statistics in molecular and cellular biology". , 2019, Physics of life reviews.

[30]  Nir Friedman,et al.  Linking stochastic dynamics to population distribution: an analytical framework of gene expression. , 2006, Physical review letters.

[31]  M. Eisenbach,et al.  Sperm guidance in mammals — an unpaved road to the egg , 2006, Nature Reviews Molecular Cell Biology.

[32]  João Pedro Hespanha,et al.  Modeling and analysis of networked control systems using stochastic hybrid systems , 2014, Annu. Rev. Control..

[33]  Sean D. Lawley,et al.  A Probabilistic Approach to Extreme Statistics of Brownian Escape Times in Dimensions 1, 2, and 3 , 2019, J. Nonlinear Sci..

[34]  W. Horsthemke,et al.  A comparison between transitions induced by random and periodic fluctuations , 1985 .

[35]  K. Shuler,et al.  Order statistics for first passage times in diffusion processes , 1983 .

[36]  L. Savtchenko,et al.  Extreme statistics may govern avalanche-type biological reactions: Comment on "Redundancy principle and the role of extreme statistics in molecular and cellular biology" by Z. Schuss, K. Basnayake, D. Holcman. , 2019, Physics of life reviews.

[37]  G. Yin,et al.  Hybrid Switching Diffusions , 2010 .

[38]  David Hartich,et al.  Duality between relaxation and first passage in reversible Markov dynamics: rugged energy landscapes disentangled , 2018, New Journal of Physics.

[39]  Eric P. Smith,et al.  An Introduction to Statistical Modeling of Extreme Values , 2002, Technometrics.

[40]  M Barrett,et al.  HEAT WAVES , 2019, The Year of the Femme.

[41]  F. Malrieu,et al.  Probabilistic and Piecewise Deterministic models in Biology , 2017, 1706.09163.

[42]  D. Holcman,et al.  Fastest among equals: a novel paradigm in biology: Reply to comments: Redundancy principle and the role of extreme statistics in molecular and cellular biology. , 2019, Physics of life reviews.

[43]  Onno Boxma,et al.  ON/OFF STORAGE SYSTEMS WITH STATE-DEPENDENT INPUT, OUTPUT, AND SWITCHING RATES , 2005, Probability in the Engineering and Informational Sciences.

[44]  S. Coles,et al.  An Introduction to Statistical Modeling of Extreme Values , 2001 .

[45]  João Pedro Hespanha,et al.  Stochastic hybrid systems: A modeling and stability theory tutorial , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[46]  David Hartich,et al.  Extreme value statistics of ergodic Markov processes from first passage times in the large deviation limit , 2019, Journal of Physics A: Mathematical and Theoretical.

[47]  S. Redner,et al.  First invader dynamics in diffusion-controlled absorption , 2014, 1404.2181.

[48]  H. Berg,et al.  Chemotaxis in Escherichia coli analysed by Three-dimensional Tracking , 1972, Nature.

[49]  Marta Tyran-Kamińska,et al.  Piecewise Deterministic Processes in Biological Models , 2017 .

[50]  S. Leibler,et al.  Physical aspects of the growth and regulation of microtubule structures. , 1993, Physical review letters.

[51]  Joseph B Keller,et al.  Diffusion at finite speed and random walks. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[52]  Nicolas E. Buchler,et al.  Efficient analysis of stochastic gene dynamics in the non-adiabatic regime using piecewise deterministic Markov processes , 2017, Journal of The Royal Society Interface.

[53]  M. Benaim,et al.  Quantitative ergodicity for some switched dynamical systems , 2012, 1204.1922.

[54]  Katja Lindenberg,et al.  Order statistics for first passage times in one-dimensional diffusion processes , 1996 .

[55]  Paul C. Bressloff,et al.  Stochastic Processes in Cell Biology , 2014, Interdisciplinary Applied Mathematics.

[56]  Diffusion of a set of random walkers in Euclidean media. First passage times , 2000 .

[57]  Comment on first-passage times for processes driven by dichotomous fluctuations. , 1987, Physical review. A, General physics.

[58]  Mark H. A. Davis.  Piecewise‐Deterministic Markov Processes: A General Class of Non‐Diffusion Stochastic Models , 1984 .

[59]  Z. Schuss,et al.  Redundancy principle and the role of extreme statistics in molecular and cellular biology. , 2019, Physics of life reviews.

[60]  P. Billingsley,et al.  Convergence of Probability Measures , 1970, The Mathematical Gazette.

[61]  P. Bressloff,et al.  On balance relations for irreversible chemical reaction networks , 2017 .

[62]  S. Redner,et al.  Mortality, redundancy, and diversity in stochastic search. , 2015, Physical review letters.

[63]  Paul C. Bressloff,et al.  Stochastic switching in biology: from genotype to phenotype , 2017 .

[64]  Jonathan C. Mattingly,et al.  Smooth invariant densities for random switching on the torus , 2017, 1708.01390.

[66]  Jonathan C. Mattingly,et al.  Regularity of invariant densities for 1D systems with random switching , 2014, 1406.5425.

[67]  Hans G. Othmer,et al.  The Diffusion Limit of Transport Equations Derived from Velocity-Jump Processes , 2000, SIAM J. Appl. Math..

[68]  Ivo J. B. F. Adan,et al.  Analysis of a single-server queue interacting with a fluid reservoir , 1998, Queueing Syst. Theory Appl..

[69]  Martin Hasler,et al.  Dynamics of Stochastically Blinking Systems. Part I: Finite Time Properties , 2013, SIAM J. Appl. Dyn. Syst..

[70]  L. Haan,et al.  Extreme value theory : an introduction , 2006 .

[72]  P. Bressloff,et al.  Stochastic models of intracellular transport , 2013 .

[73]  H. Berg.  Random Walks in Biology , 2018 .

[74]  Large deviation theory for stochastic difference equations , 1997, European Journal of Applied Mathematics.

[75]  S B Yuste,et al.  Order statistics for d-dimensional diffusion processes. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[76]  Gaston H. Gonnet,et al.  On the LambertW function , 1996, Adv. Comput. Math..

[77]  S. Lawley.  Blowup from randomly switching between stable boundary conditions for the heat equation , 2018 .