Recovering Stochastic Dynamics via Gaussian Schrödinger Bridges

We propose a new framework to reconstruct a stochastic process {Pt : t ∈ [0, T ]} using only samples from its marginal distributions, observed at start and end times 0 and T . This reconstruction is useful to infer population dynamics, a crucial challenge, e.g., when modeling the time-evolution of cell populations from single-cell sequencing data. Our general framework encompasses the more specific Schrödinger bridge (SB) problem, where Pt represents the evolution of a thermodynamic system at almost equilibrium. Estimating such bridges is notoriously difficult, motivating our proposal for a novel adaptive scheme called the GSBFLOW. Our goal is to rely on Gaussian approximations of the data to provide the reference stochastic process needed to estimate SB. To that end, we solve the SB problem with Gaussian marginals, for which we provide, as a central contribution, a closed-form solution and SDErepresentation. We use these formulas to define the reference process used to estimate more complex SBs, and show that this does indeed help with its numerical solution. We obtain notable improvements when reconstructing both synthetic processes and single-cell genomics experiments.

[1]  Valentin De Bortoli,et al.  Simulating Diffusion Bridges with Score Matching , 2021, ArXiv.

[2]  Evangelos A. Theodorou,et al.  Likelihood Training of Schrödinger Bridge using Forward-Backward SDEs Theory , 2021, ICLR.

[3]  Yuling Jiao,et al.  Schr{\"o}dinger-F{\"o}llmer Sampler: Sampling without Ergodicity , 2021, 2106.10880.

[4]  Gefei Wang,et al.  Deep Generative Learning via Schrödinger Bridge , 2021, ICML.

[5]  Andreas Krause,et al.  Proximal Optimal Transport Modeling of Population Dynamics , 2021, AISTATS.

[6]  Aaron C. Courville,et al.  A Variational Perspective on Diffusion-Based Generative Models and Score Matching , 2021, NeurIPS.

[7]  Neil D. Lawrence,et al.  Solving Schrödinger Bridges via Maximum Likelihood , 2021, Entropy.

[8]  Youssef Mroueh,et al.  Optimizing Functionals on the Space of Probabilities with Input Convex Neural Networks , 2021, Trans. Mach. Learn. Res..

[9]  Valentin De Bortoli,et al.  Diffusion Schrödinger Bridge with Applications to Score-Based Generative Modeling , 2021, NeurIPS.

[10]  Evgeny Burnaev,et al.  Large-Scale Wasserstein Gradient Flows , 2021, NeurIPS.

[11]  A. Regev,et al.  Multimodal pooled Perturb-CITE-seq screens in patient models define mechanisms of cancer immune evasion , 2021, Nature Genetics.

[12]  Stephen X. Zhang,et al.  Towards a mathematical theory of trajectory inference , 2021, ArXiv.

[13]  Aaron C. Courville,et al.  Convex Potential Flows: Universal Probability Distributions with Optimal Transport and Convex Optimization , 2020, ICLR.

[14]  Abhishek Kumar,et al.  Score-Based Generative Modeling through Stochastic Differential Equations , 2020, ICLR.

[15]  Pieter Abbeel,et al.  Denoising Diffusion Probabilistic Models , 2020, NeurIPS.

[16]  E. Barrio,et al.  The statistical effect of entropic regularization in optimal transportation , 2020, arXiv.org.

[17]  Anton Mallasto,et al.  Entropy-regularized 2-Wasserstein distance between Gaussian measures , 2020, Information Geometry.

[18]  Marco Cuturi,et al.  Entropic Optimal Transport between Unbalanced Gaussian Measures has a Closed Form , 2020, NeurIPS.

[19]  D. V. Dijk,et al.  TrajectoryNet: A Dynamic Optimal Transport Network for Modeling Cellular Dynamics , 2020, ICML.

[20]  Ronald R. Coifman,et al.  Visualizing structure and transitions in high-dimensional biological data , 2019, Nature Biotechnology.

[21]  Ashwinikumar Kulkarni,et al.  Beyond bulk: a review of single cell transcriptomics methodologies and applications. , 2019, Current opinion in biotechnology.

[22]  Yang Song,et al.  Generative Modeling by Estimating Gradients of the Data Distribution , 2019, NeurIPS.

[23]  Fabian J Theis,et al.  Current best practices in single‐cell RNA‐seq analysis: a tutorial , 2019, Molecular systems biology.

[24]  P. Rigollet,et al.  Optimal-Transport Analysis of Single-Cell Gene Expression Identifies Developmental Trajectories in Reprogramming , 2019, Cell.

[25]  Gabriel Peyré,et al.  Stochastic Deep Networks , 2018, ICML.

[26]  Michele Pavon,et al.  The Data‐Driven Schrödinger Bridge , 2018, Communications on Pure and Applied Mathematics.

[27]  Gabriel Peyré,et al.  Computational Optimal Transport , 2018, Found. Trends Mach. Learn..

[28]  Grace X. Y. Zheng,et al.  Massively parallel digital transcriptional profiling of single cells , 2016, Nature Communications.

[29]  A. Galichon,et al.  Matching in closed-form: equilibrium, identification, and comparative statics , 2015, 2102.04295.

[30]  Shakir Mohamed,et al.  Variational Inference with Normalizing Flows , 2015, ICML.

[31]  Evan Z. Macosko,et al.  Highly Parallel Genome-wide Expression Profiling of Individual Cells Using Nanoliter Droplets , 2015, Cell.

[32]  Surya Ganguli,et al.  Deep Unsupervised Learning using Nonequilibrium Thermodynamics , 2015, ICML.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Tryphon T. Georgiou,et al.  On the Relation Between Optimal Transport and Schrödinger Bridges: A Stochastic Control Viewpoint , 2014, J. Optim. Theory Appl..

[35]  Lucas Pelkmans,et al.  A Hierarchical Map of Regulatory Genetic Interactions in Membrane Trafficking , 2014, Cell.

[36]  Marco Cuturi,et al.  Sinkhorn Distances: Lightspeed Computation of Optimal Transport , 2013, NIPS.

[37]  Christian L'eonard A survey of the Schr\"odinger problem and some of its connections with optimal transport , 2013, 1308.0215.

[38]  Nicola Bruti-Liberati Numerical Solution of Stochastic Differential Equations with Jumps in Finance , 2010 .

[39]  J. Axelman,et al.  Derivation and Differentiation of Human Embryonic Germ Cells , 2004 .

[40]  M. Evans,et al.  Differentiation of clonal lines of teratocarcinoma cells: formation of embryoid bodies in vitro. , 1975, Proceedings of the National Academy of Sciences of the United States of America.

[41]  T. Georgiou,et al.  Stochastic Control Liaisons: Richard Sinkhorn Meets Gaspard Monge on a Schrödinger Bridge , 2021, SIAM Rev..

[42]  Tryphon T. Georgiou,et al.  Optimal Steering of a Linear Stochastic System to a Final Probability Distribution, Part I , 2016, IEEE Transactions on Automatic Control.

[43]  E. Schrödinger Sur la théorie relativiste de l'électron et l'interprétation de la mécanique quantique , 1932 .