Neural ordinary differential equations for ecological and evolutionary time‐series analysis

Inferring the functional shape of ecological and evolutionary processes from time‐series data can be challenging because processes are often not describable with simple equations. The dynamical coupling between variables in time series further complicates the identification of equations through model selection as the inference of a given process is contingent on the accurate depiction of all other processes. We present a novel method, neural ordinary differential equations (NODEs), for learning ecological and evolutionary processes from time‐series data by modelling dynamical systems as ordinary differential equations and dynamical functions with artificial neural networks (ANNs). Upon successful training, the ANNs converge to functional shapes that best describe the biological processes underlying the dynamics observed, in a way that is robust to mathematical misspecifications of the dynamical model. We demonstrate NODEs in a population dynamic context and show how they can be used to infer ecological interactions, dynamical causation and equilibrium points. We tested NODEs by analysing well‐understood hare and lynx time‐series data, which revealed that prey–predator oscillations were mainly driven by the interspecific interaction, as well as intraspecific densitydependence, and characterised by a single equilibrium point at the centre of the oscillation. Our approach is applicable to any system that can be modelled with differential equations, and particularly suitable for linking ecological, evolutionary and environmental dynamics where parametric approaches are too challenging to implement, opening new avenues for theoretical and empirical investigations.

[1]  S. Eubank,et al.  Commentary on Ferguson, et al., “Impact of Non-pharmaceutical Interventions (NPIs) to Reduce COVID-19 Mortality and Healthcare Demand” , 2020, Bulletin of Mathematical Biology.

[2]  A. Yamashita,et al.  Dissecting Neural ODEs , 2020, Neural Information Processing Systems.

[3]  David Duvenaud,et al.  Latent ODEs for Irregularly-Sampled Time Series , 2019, ArXiv.

[4]  B. Sheldon,et al.  Accounting for interspecific competition and age structure in demographic analyses of density dependence improves predictions of fluctuations in population size. , 2019, Ecology letters.

[5]  Vaibhav Dixit,et al.  DiffEqFlux.jl - A Julia Library for Neural Differential Equations , 2019, ArXiv.

[6]  Kaj Nyström,et al.  Data-driven discovery of PDEs in complex datasets , 2018, J. Comput. Phys..

[7]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[8]  B. Deng An Inverse Problem: Trappers Drove Hares to Eat Lynx , 2018, Acta Biotheoretica.

[9]  Kairat Sovetovish Imanbayev,et al.  Some methods of training radial basis neural networks in solving the Navier‐Stokes equations , 2018 .

[10]  Swati Patel,et al.  Partitioning the Effects of Eco-Evolutionary Feedbacks on Community Stability* , 2018, The American Naturalist.

[11]  S. Lion Theoretical Approaches in Evolutionary Ecology: Environmental Feedback as a Unifying Perspective , 2018, The American Naturalist.

[12]  Ursula Gaedke,et al.  Disentangling eco-evolutionary dynamics of predator-prey coevolution: the case of antiphase cycles , 2017, Scientific Reports.

[13]  Adrian L. R. Thomas,et al.  Terminal attack trajectories of peregrine falcons are described by the proportional navigation guidance law of missiles , 2017, Proceedings of the National Academy of Sciences.

[14]  D. Coltman,et al.  Fluctuating effects of genetic and plastic changes in body mass on population dynamics in a large herbivore. , 2017, Ecology.

[15]  Michael H. Cortez,et al.  The Effects of Predator Evolution and Genetic Variation on Predator–Prey Population-Level Dynamics , 2017, Bulletin of mathematical biology.

[16]  Günther Klonner,et al.  A dynamic eco-evolutionary model predicts slow response of alpine plants to climate warming , 2017, Nature Communications.

[17]  U. Brose,et al.  Interactive effects of shifting body size and feeding adaptation drive interaction strengths of protist predators under warming , 2017, bioRxiv.

[18]  Aaron J Corcoran,et al.  How moths escape bats: predicting outcomes of predator–prey interactions , 2016, Journal of Experimental Biology.

[19]  Corey S. O'Hern,et al.  Reconstruction of Ordinary Differential Equations From Time Series Data , 2016, 1605.05420.

[20]  M. Holyoak,et al.  The integration of climate change, spatial dynamics, and habitat fragmentation: A conceptual overview. , 2016, Integrative zoology.

[21]  Matthew T. Kaufman,et al.  A neural network that finds a naturalistic solution for the production of muscle activity , 2015, Nature Neuroscience.

[22]  Jason G. Bragg,et al.  Incorporating evolutionary processes into population viability models , 2015, Conservation biology : the journal of the Society for Conservation Biology.

[23]  S. Ellner,et al.  Temporal dynamics of a simple community with intraguild predation: an experimental test , 2013 .

[24]  David B. Dunson,et al.  Bayesian data analysis, third edition , 2013 .

[25]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.

[26]  Jon Norberg,et al.  Eco-evolutionary responses of biodiversity to climate change , 2012 .

[27]  R. Olberg,et al.  Visual control of prey-capture flight in dragonflies , 2012, Current Opinion in Neurobiology.

[28]  Stephen P Ellner,et al.  Does rapid evolution matter? Measuring the rate of contemporary evolution and its impacts on ecological dynamics. , 2011, Ecology letters.

[29]  Ricard V Solé,et al.  Press perturbations and indirect effects in real food webs. , 2009, Ecology.

[30]  Benjamin D. Dalziel,et al.  Fitting Probability Distributions to Animal Movement Trajectories: Using Artificial Neural Networks to Link Distance, Resources, and Memory , 2008, The American Naturalist.

[31]  Vasily Demyanov,et al.  Improving ecological impact assessment by statistical data synthesis using process‐based models , 2006 .

[32]  Jun Wu,et al.  Parameter estimation of an ecological system by a neural network with residual minimization training , 2005 .

[33]  S. Ellner,et al.  Rapid evolution and the convergence of ecological and evolutionary time , 2005 .

[34]  Stephen P. Ellner,et al.  POPULATION CYCLES IN THE PINE LOOPER MOTH: DYNAMICAL TESTS OF MECHANISTIC HYPOTHESES , 2005 .

[35]  Lucie P. Aarts,et al.  Neural Network Method for Solving Partial Differential Equations , 2001, Neural Processing Letters.

[36]  S. Ellner,et al.  Fitting population dynamic models to time-series data by gradient matching , 2002 .

[37]  Michael Obach,et al.  Modelling population dynamics of aquatic insects with artificial neural networks , 2001 .

[38]  Young-Seuk Park,et al.  Patterning and short-term predictions of benthic macroinvertebrate community dynamics by using a recurrent artificial neural network , 2001 .

[39]  Simon N. Wood,et al.  PARTIALLY SPECIFIED ECOLOGICAL MODELS , 2001 .

[40]  C. Krebs,et al.  What Drives the 10-year Cycle of Snowshoe Hares? , 2001 .

[41]  Young-Seuk Park,et al.  Use of an Artificial Neural Network to Predict Population Dynamics of the Forest–Pest Pine Needle Gall Midge (Diptera: Cecidomyiida) , 2000 .

[42]  Sovan Lek,et al.  Artificial neural networks as a tool in ecological modelling, an introduction , 1999 .

[43]  H. Tong,et al.  From patterns to processes: phase and density dependencies in the Canadian lynx cycle. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[44]  B. Slough,et al.  Lynx population dynamics in an untrapped refugium , 1996 .

[45]  Hong Chen,et al.  Approximations of continuous functionals by neural networks with application to dynamic systems , 1993, IEEE Trans. Neural Networks.

[46]  Yuichi Nakamura,et al.  Approximation of dynamical systems by continuous time recurrent neural networks , 1993, Neural Networks.

[47]  B. Grant,et al.  Evolution of Darwin’s finches caused by a rare climatic event , 1993, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[48]  A. Galston Fundamentals of Ecology , 1972, The Yale Journal of Biology and Medicine.