Taboo rate and hitting time distribution of continuous-time reversible Markov chains

Abstract The taboo rate is first defined, which satisfies with the Chapman–Kolmogorov equation. Then the differentials of hitting time distribution are expressed by many different taboo rates, which deeply reveal the intrinsic relationship between the transition rate matrix and the hitting time distribution in continuous-time reversible Markov chains. As an example, the explicit expressions of the differentials of the hitting time distribution at a single state are provided for the birth and death chain, hence the transition rate matrix can be identified. Such differentials improve the theory of statistical identification of continuous-time reversible Markov chains.

[1]  W. Hong,et al.  A note on the passage time of finite-state Markov chains , 2013, 1302.5987.

[2]  O. Boxma,et al.  On the discounted penalty function in a Markov-dependent risk model , 2005 .

[3]  Yong-Hua Mao,et al.  Hitting Time Distributions for Denumerable Birth and Death Processes , 2010, 1007.1039.

[4]  Mu-Fa Chen,et al.  From Markov Chains to Non-Equilibrium Particle Systems , 1992 .

[5]  J. Doob.  Stochastic processes , 1953 .

[6]  Xiang Xu-yan,et al.  Markov chain inversion approach to identify the transition rates of ion channels , 2012 .

[7]  D. G. Kendall,et al.  The construction theory of denumerable Markov processes , 1990 .

[8]  Tzu-kʿun Wang,et al.  Birth and death processes and Markov chains , 1992 .

[9]  Hitting time distribution for skip-free Markov chains: A simple proof , 2013, 1301.7180.

[10]  J. Rice,et al.  On aggregated Markov processes , 1986 .

[11]  Frank G. Ball,et al.  Marked Continuous-Time Markov Chain Modelling of Burst Behaviour for Single Ion Channels , 2007, Adv. Decis. Sci..

[12]  Minping Qian,et al.  Identifying transition rates of ionic channels via observations at a single state , 2003 .

[13]  Pauline Coolen-Schrijner,et al.  THE DEVIATION MATRIX OF A CONTINUOUS-TIME MARKOV CHAIN , 2002, Probability in the Engineering and Informational Sciences.

[14]  Nicholas P. Jewell,et al.  Mixtures of Exponential Distributions , 1982 .

[15]  Bret Larget,et al.  A canonical representation for aggregated Markov processes , 1998, Journal of Applied Probability.

[16]  Xuyan Xiang,et al.  Statistical Identification of Markov Chain on Trees , 2018 .

[17]  Jian-Qiang Feng,et al.  Identifying transition rates of ionic channels of star-graph branch type , 2006 .

[18]  Some Sufficient Conditions for Stochastic Comparisons Between Hitting Times for Skip-free Markov Chains , 2016 .

[19]  E. Bulinskaya.  Finiteness of hitting times under taboo , 2013, 1310.7108.

[20]  Clive L. Keatinge.  MODELING LOSSES WITH THE MIXED EXPONENTIAL DISTRIBUTION , 2000 .

[21]  Mark Brown,et al.  Identifying Coefficients in the Spectral Representation for First Passage Time Distributions , 1987, Probability in the Engineering and Informational Sciences.

[22]  A. Hawkes,et al.  On the stochastic properties of bursts of single ion channel openings and of clusters of bursts. , 1982, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[23]  Hitting Time and Inverse Problems for Markov Chains , 2008, Journal of Applied Probability.