Fokker–Planck Equations for a Free Energy Functional or Markov Process on a Graph

The classical Fokker–Planck equation is a linear parabolic equation which describes the time evolution of the probability distribution of a stochastic process defined on a Euclidean space. Corresponding to a stochastic process, there often exists a free energy functional which is defined on the space of probability distributions and is a linear combination of a potential and an entropy. In recent years, it has been shown that the Fokker–Planck equation is the gradient flow of the free energy functional defined on the Riemannian manifold of probability distributions whose inner product is generated by a 2-Wasserstein distance. In this paper, we consider analogous matters for a free energy functional or Markov process defined on a graph with a finite number of vertices and edges. If N ≧ 2 is the number of vertices of the graph, we show that the corresponding Fokker–Planck equation is a system of Nnonlinear ordinary differential equations defined on a Riemannian manifold of probability distributions. However, in contrast to stochastic processes defined on Euclidean spaces, the situation is more subtle for discrete spaces. We have different choices for inner products on the space of probability distributions resulting in different Fokker–Planck equations for the same process. It is shown that there is a strong connection but there are also substantial discrepancies between the systems of ordinary differential equations and the classical Fokker–Planck equation on Euclidean spaces. Furthermore, both systems of ordinary differential equations are gradient flows for the same free energy functional defined on the Riemannian manifolds of probability distributions with different metrics. Some examples are also discussed.

[1]  Peter G. Bergmann,et al.  New Approach to Nonequilibrium Processes , 1955 .

[2]  R. Dobrushin Prescribing a System of Random Variables by Conditional Distributions , 1970 .

[3]  M. Hasse,et al.  W. H. Greub, Multilinear Algebra. (Die Grundlehren der mathematischen Wissenschaften. Band 136). XII + 225 S. Berlin/Heidelberg/New York 1967. Springer-Verlag. Preis geb. DM 32,– , 1971 .

[4]  D. Gilbarg,et al.  Elliptic Partial Differential Equa-tions of Second Order , 1977 .

[5]  Z. Schuss Singular Perturbation Methods in Stochastic Differential Equations of Mathematical Physics , 1980 .

[6]  C. Gardiner Handbook of Stochastic Methods , 1983 .

[7]  J. Elgin The Fokker-Planck Equation: Methods of Solution and Applications , 1984 .

[8]  C. W. Gardiner,et al.  Handbook of stochastic methods - for physics, chemistry and the natural sciences, Second Edition , 1986, Springer series in synergetics.

[9]  R. LeVeque Numerical methods for conservation laws , 1990 .

[10]  D. Kinderlehrer,et al.  THE VARIATIONAL FORMULATION OF THE FOKKER-PLANCK EQUATION , 1996 .

[11]  H. Risken Fokker-Planck Equation , 1996 .

[12]  Konrad W. Wojciechowski,et al.  Contrast Enhancement of Badly Illuminated Images Based on Gibbs Distribution and Random Walk Model , 1997, CAIP.

[13]  R. Astumian Thermodynamics and kinetics of a Brownian motor. , 1997, Science.

[14]  D. Kinderlehrer,et al.  Free energy and the Fokker-Planck equation , 1997 .

[15]  Derek Abbott,et al.  Game theory: Losing strategies can win by Parrondo's paradox , 1999, Nature.

[16]  L. Evans,et al.  Differential equations methods for the Monge-Kantorovich mass transfer problem , 1999 .

[17]  Stéphane Cordier,et al.  Numerical Analysis of Conservative and Entropy Schemes for the Fokker--Planck--Landau Equation , 1999 .

[18]  R. McCann Exact solutions to the transportation problem on the line , 1999, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[19]  C. Villani,et al.  Generalization of an Inequality by Talagrand and Links with the Logarithmic Sobolev Inequality , 2000 .

[20]  F. Otto THE GEOMETRY OF DISSIPATIVE EVOLUTION EQUATIONS: THE POROUS MEDIUM EQUATION , 2001 .

[21]  R. McCann,et al.  A Riemannian interpolation inequality à la Borell, Brascamp and Lieb , 2001 .

[22]  David Heath,et al.  Discrete and continuous ratchets: from coin toss to molecular motor , 2002 .

[23]  David Kinderlehrer,et al.  Diffusion-Mediated Transport¶and the Flashing Ratchet , 2002 .

[24]  Derek Abbott,et al.  A REVIEW OF PARRONDO'S PARADOX , 2002 .

[25]  Ora E. Percus,et al.  Can Two Wrongs Make a Right? Coin-Tossing Games and Parrondo’s Paradox , 2002 .

[26]  W. Gangbo,et al.  Constrained steepest descent in the 2-Wasserstein metric , 2003, math/0312063.

[27]  C. Villani Topics in Optimal Transportation , 2003 .

[28]  Christian Houdré,et al.  Inequalities for generalized entropy and optimal transportation , 2003 .

[29]  Gang Hua,et al.  Tracking articulated body by dynamic Markov network , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[30]  S. Farley Two wrongs make a right , 2003, Nature Reviews Neuroscience.

[31]  Toby Williamson,et al.  Can Two Wrongs Make a Right? , 2004 .

[32]  Wilfrid Gangbo,et al.  Solution of a Model Boltzmann Equation via Steepest Descent in the 2-Wasserstein Metric , 2004 .

[33]  G. Burton TOPICS IN OPTIMAL TRANSPORTATION (Graduate Studies in Mathematics 58) By CÉDRIC VILLANI: 370 pp., US$59.00, ISBN 0-8218-3312-X (American Mathematical Society, Providence, RI, 2003) , 2004 .

[34]  H. Qian Motor protein with nonequilibrium potential: Its thermodynamics and efficiency. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  D. Kinderlehrer,et al.  Remarks about the Flashing Rachet , 2004 .

[36]  C. Villani,et al.  Ricci curvature for metric-measure spaces via optimal transport , 2004, math/0412127.

[37]  Karl-Theodor Sturm,et al.  Transport inequalities, gradient estimates, entropy and Ricci curvature , 2005 .

[38]  Felix Otto,et al.  Eulerian Calculus for the Contraction in the Wasserstein Distance , 2005, SIAM J. Math. Anal..

[39]  L. Ambrosio,et al.  Gradient Flows: In Metric Spaces and in the Space of Probability Measures , 2005 .

[40]  H. Qian Cycle kinetics, steady state thermodynamics and motors—a paradigm for living matter physics , 2005, Journal of physics. Condensed matter : an Institute of Physics journal.

[41]  Karl-Theodor Sturm Generalized Ricci bounds and convergence of metric measure spaces , 2005 .

[42]  E. Olivieri,et al.  Large deviations and metastability: Large deviations and statistical mechanics , 2005 .

[43]  J. Lott Some Geometric Calculations on Wasserstein Space , 2006, math/0612562.

[44]  Karl-Theodor Sturm,et al.  On the geometry of metric measure spaces. II , 2006 .

[45]  Karl-Theodor Sturm,et al.  On the geometry of metric measure spaces , 2006 .

[46]  David H Mathews,et al.  Prediction of RNA secondary structure by free energy minimization. , 2006, Current opinion in structural biology.

[47]  L. Ambrosio,et al.  Chapter 1 – Gradient Flows of Probability Measures , 2007 .

[48]  Karl-Theodor Sturm,et al.  Entropic Measure and Wasserstein Diffusion , 2007, 0704.0704.

[49]  Rachid Ait-Haddou,et al.  Brownian ratchet models of molecular motors , 2007, Cell Biochemistry and Biophysics.

[50]  C. Villani Optimal Transport: Old and New , 2008 .

[51]  Jianfeng Feng,et al.  Efficiency of Brownian motors in terms of entropy production rate , 2008 .

[52]  Prasad Tetali,et al.  Concentration on the Discrete Torus Using Transportation , 2009, Comb. Probab. Comput..

[53]  Karl-Theodor Sturm,et al.  Mass transportation and rough curvature bounds for discrete spaces , 2009 .

[54]  S. Varadhan,et al.  Large deviations , 2019, Graduate Studies in Mathematics.

[55]  H. Qian,et al.  Nonlinear Oscillations and Multiscale Dynamics in a Closed Chemical Reaction System , 2010 .

[56]  Alexander Mielke,et al.  A gradient structure for reaction-diusion systems and for energy-drift-diu , 2011 .

[57]  S. Chow,et al.  A free energy based mathematical study for molecular motors , 2011 .

[58]  Thermodynamics and Geometry of Reversible and Irreversible Markov Processes , 2011, 1108.4055.

[59]  A. Si,et al.  Entropy,Large Deviations,and Statistical Mechanics , 2011 .

[60]  Alexander Mielke,et al.  A gradient structure for reaction–diffusion systems and for energy-drift-diffusion systems , 2011 .