Machine learning for modeling animal movement

Animal movement drives important ecological processes such as migration and the spread of infectious disease. Current approaches to modeling animal tracking data focus on parametric models used to understand environmental effects on movement behavior and to fill in missing tracking data. Machine Learning and Deep learning algorithms are powerful and flexible predictive modeling tools but have rarely been applied to animal movement data. In this study we present a general framework for predicting animal movement that is a combination of two steps: first predicting movement behavioral states and second predicting the animal’s velocity. We specify this framework at the individual level as well as for collective movement. We use Random Forests, Neural and Recurrent Neural Networks to compare performance predicting one step ahead as well as long range simulations. We compare results against a custom constructed Stochastic Differential Equation (SDE) model. We apply this approach to high resolution ant movement data. We found that the individual level Machine Learning and Deep Learning methods outperformed the SDE model for one step ahead prediction. The SDE model did comparatively better at simulating long range movement behaviour. Of the Machine Learning and Deep Learning models the Long Short Term Memory (LSTM) individual level model did best at long range simulations. We also applied the Random Forest and LSTM individual level models to model gull migratory movement to demonstrate the generalizability of this framework. Machine Learning and deep learning models are easier to specify compared to traditional parametric movement models which can have restrictive assumptions. However, machine learning and deep learning models are less interpretable than parametric movement models. The type of model used should be determined by the goal of the study, if the goal is prediction, our study provides evidence that machine learning and deep learning models could be useful tools.

[1]  Robert Jenssen,et al.  An overview and comparative analysis of Recurrent Neural Networks for Short Term Load Forecasting , 2017, ArXiv.

[2]  Vadim Sokolov,et al.  Deep Learning: A Bayesian Perspective , 2017, ArXiv.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Brett T. McClintock,et al.  Animal Movement: Statistical Models for Telemetry Data , 2017 .

[5]  Sean Gerrish,et al.  Black Box Variational Inference , 2013, AISTATS.

[6]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[7]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[8]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[9]  John Shawe-Taylor,et al.  Movement Activity Based Classification of Animal Behaviour with an Application to Data from Cheetah (Acinonyx jubatus) , 2012, PloS one.

[10]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Dustin Tran,et al.  Automatic Differentiation Variational Inference , 2016, J. Mach. Learn. Res..

[12]  John W. Benoit,et al.  Wildland fire probabilities estimated from weather model-deduced monthly mean fire danger indices , 2008 .

[13]  M. Ringnér,et al.  Analyzing array data using supervised methods. , 2002, Pharmacogenomics.

[14]  Willem Bouten,et al.  Short distance migrants travel as far as long distance migrants in lesser black-backed gulls Larus fuscus , 2017 .

[15]  Mark R. Segal,et al.  Multivariate random forests , 2011, WIREs Data Mining Knowl. Discov..

[16]  Jonathan R. Potts,et al.  Integrated step selection analysis: bridging the gap between resource selection and animal movement , 2015, 1512.01614.

[17]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[18]  Ephraim M. Hanks,et al.  Modeling Collective Animal Movement Through Interactions in Behavioral States , 2017 .

[19]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[20]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[21]  Mevin B. Hooten,et al.  Reflected Stochastic Differential Equation Models for Constrained Animal Movement , 2017, Journal of Agricultural, Biological and Environmental Statistics.

[22]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[23]  Elizabeth Eisenhauer,et al.  A lattice and random intermediate point sampling design for animal movement , 2019, Environmetrics.

[24]  Chung-Ming Kuan,et al.  Forecasting exchange rates using feedforward and recurrent neural networks , 1992 .

[25]  Brett T. McClintock,et al.  momentuHMM: R package for generalized hidden Markov models of animal movement , 2017, 1710.03786.

[26]  B. Shaby,et al.  Extreme Value-Based Methods for Modeling Elk Yearly Movements , 2018, Journal of Agricultural, Biological and Environmental Statistics.

[27]  Roland Langrock,et al.  Modelling group dynamic animal movement , 2013, 1308.5850.

[28]  Achim Zeileis,et al.  BMC Bioinformatics BioMed Central Methodology article Conditional variable importance for random forests , 2008 .

[29]  Robert Jenssen,et al.  Recurrent Neural Networks for Short-Term Load Forecasting , 2017, SpringerBriefs in Computer Science.

[30]  D. Hughes,et al.  Ant colonies maintain social homeostasis in the face of decreased density , 2019, eLife.

[31]  Devin S Johnson,et al.  A General Framework for the Analysis of Animal Resource Selection from Telemetry Data , 2008, Biometrics.

[32]  Dean P. Anderson,et al.  State-space models link elk movement patterns to landscape characteristics in Yellowstone National Park , 2007 .

[33]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[34]  Xuanjing Huang,et al.  Recurrent Neural Network for Text Classification with Multi-Task Learning , 2016, IJCAI.

[35]  Mark R. Segal,et al.  Identification of Yeast Transcriptional Regulation Networks Using Multivariate Random Forests , 2009, PLoS Comput. Biol..

[36]  Jason Matthiopoulos,et al.  Linking resource selection and step selection models for habitat preferences in animals. , 2017, Ecology.

[37]  Adam Powell,et al.  The Origins of Lactase Persistence in Europe , 2009, PLoS Comput. Biol..

[38]  Aritra Ghosh,et al.  Robust Loss Functions under Label Noise for Deep Neural Networks , 2017, AAAI.

[39]  Sara M. Maxwell,et al.  Using Satellite Tracking to Optimize Protection of Long-Lived Marine Species: Olive Ridley Sea Turtle Conservation in Central Africa , 2011, PloS one.

[40]  A. Parton,et al.  Bayesian Inference for Multistate ‘Step and Turn’ Animal Movement in Continuous Time , 2017, 1701.05736.

[41]  K. M. Schaefer,et al.  Tracking apex marine predator movements in a dynamic ocean , 2011, Nature.

[42]  Brett T. McClintock,et al.  A general discrete‐time modeling framework for animal movement using multistate random walks , 2012 .

[43]  Ian Jonsen,et al.  Supervised accelerometry analysis can identify prey capture by penguins at sea , 2014, Journal of Experimental Biology.

[44]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[45]  Juan M. Morales,et al.  EXTRACTING MORE OUT OF RELOCATION DATA: BUILDING MOVEMENT MODELS AS MIXTURES OF RANDOM WALKS , 2004 .

[46]  H. Preisler,et al.  Modeling animal movements using stochastic differential equations , 2004 .

[47]  Giles Hooker,et al.  Statistical inference on tree swallow migrations with random forests , 2017, Journal of the Royal Statistical Society: Series C (Applied Statistics).

[48]  Thomas Lengauer,et al.  Permutation importance: a corrected feature importance measure , 2010, Bioinform..

[49]  Tamás D. Gedeon,et al.  Data Mining of Inputs: Analysing Magnitude and Functional Measures , 1997, Int. J. Neural Syst..

[50]  Murali Haran,et al.  A spatially varying stochastic differential equation model for animal movement , 2016, The Annals of Applied Statistics.

[51]  David A. Patterson,et al.  In-datacenter performance analysis of a tensor processing unit , 2017, 2017 ACM/IEEE 44th Annual International Symposium on Computer Architecture (ISCA).

[52]  Ran Nathan,et al.  Using tri-axial acceleration data to identify behavioral modes of free-ranging animals: general concepts and tools illustrated for griffon vultures , 2012, Journal of Experimental Biology.

[53]  Shweta Bansal,et al.  Social, spatial, and temporal organization in a complex insect society , 2015, Scientific Reports.

[54]  Ella Browning,et al.  Predicting animal behaviour using deep learning: GPS data alone accurately predict diving in seabirds , 2017 .

[55]  Alan A. Ager,et al.  Analyzing animal movement patterns using potential functions , 2013 .

[56]  Anind K. Dey,et al.  Maximum Entropy Inverse Reinforcement Learning , 2008, AAAI.

[57]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[58]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[59]  A. Hossein Sahoolizadeh,et al.  A New Face Recognition Method using PCA, LDA and Neural Network , 2008 .

[60]  Wolfram Burgard,et al.  Learning driving styles for autonomous vehicles from demonstration , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[61]  N. Câmara,et al.  The Spleen CD4+ T Cell Response to Blood-Stage Plasmodium chabaudi Malaria Develops in Two Phases Characterized by Different Properties , 2011, PloS one.

[62]  Paulin Coulibaly,et al.  Nonstationary hydrological time series forecasting using nonlinear dynamic methods , 2005 .