On the application of mixed hidden Markov models to multiple behavioural time series

Analysing behavioural sequences and quantifying the likelihood of occurrences of different behaviours is a difficult task as motivational states are not observable. Furthermore, it is ecologically highly relevant and yet more complicated to scale an appropriate model for one individual up to the population level. In this manuscript (mixed) hidden Markov models (HMMs) are used to model the feeding behaviour of 54 subadult grey mouse lemurs (Microcebus murinus), small nocturnal primates endemic to Madagascar that forage solitarily. Our primary aim is to introduce ecologists and other users to various HMM methods, many of which have been developed only recently, and which in this form have not previously been synthesized in the ecological literature. Our specific application of mixed HMMs aims at gaining a better understanding of mouse lemur behaviour, in particular concerning sex-specific differences. The model we consider incorporates random effects for accommodating heterogeneity across animals, i.e. accounts for different personalities of the animals. Additional subject- and time-specific covariates in the model describe the influence of sex, body mass and time of night.

[1]  Alastair Franke,et al.  Prediction of wolf (Canis lupus) kill-sites using hidden Markov models , 2006 .

[2]  D. Haussler,et al.  Hidden Markov models in computational biology. Applications to protein modeling. , 1993, Journal of molecular biology.

[3]  Marcel Eens,et al.  Seasonal Changes in Courtship Song and the Medial Preoptic Area in Male European Starlings (Sturnus vulgaris) , 2000, Hormones and Behavior.

[4]  Dimitris N. Metaxas,et al.  Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[5]  Paul S. Martin,et al.  Measuring Behaviour: An Introductory Guide , 1986 .

[6]  Martin L. Puterman,et al.  Analysis of longitudinal data of epileptic seizure counts: A two-state hidden Markov regression approach , 2001 .

[7]  S. Turnbull,et al.  Pricing foreign currency options with stochastic volatility , 1990 .

[8]  James S. Clark,et al.  Why environmental scientists are becoming Bayesians , 2004 .

[9]  Peter M. Kappeler,et al.  Comparative Feeding Ecology of Sympatric Microcebus berthae and M. murinus , 2008, International Journal of Primatology.

[10]  A. Houston,et al.  Integrating function and mechanism. , 2009, Trends in ecology & evolution.

[11]  Greg A Breed,et al.  Sex-specific, seasonal foraging tactics of adult grey seals (Halichoerus grypus) revealed by state-space analysis. , 2009, Ecology.

[12]  Jutta Schmid,et al.  Sex-Specific Differences in Activity Patterns and Fattening in the Gray Mouse Lemur (Microcebus murinus) in Madagascar , 1999 .

[13]  Henrik Madsen,et al.  Estimating animal behavior and residency from movement data , 2011 .

[14]  W. Zucchini,et al.  Hidden Markov Models for Time Series: An Introduction Using R , 2009 .

[15]  A. W. van der Vaart,et al.  Modeling Portfolio Defaults Using Hidden Markov Models with Covariates , 2006 .

[16]  Jörg U. Ganzhorn,et al.  Taxonomic Revision of Mouse Lemurs (Microcebus) in the Western Portions of Madagascar , 2000, International Journal of Primatology.

[17]  R. Macarthur,et al.  On Optimal Use of a Patchy Environment , 1966, The American Naturalist.

[18]  Peter E. Rossi,et al.  Case Studies in Bayesian Statistics , 1998 .

[19]  Iain L. MacDonald,et al.  Hidden Markov Models and Animal Behaviour , 1995 .

[20]  Michael Kock,et al.  One size does not fit all: flexible models are required to understand animal movement across scales. , 2011, The Journal of animal ecology.

[21]  Gerry C. Emmans,et al.  Diet selection and animal state: an integrative framework , 1999, Proceedings of the Nutrition Society.

[22]  P. Whitten,et al.  Recent advances in noninvasive techniques to monitor hormone-behavior interactions. , 1998, American journal of physical anthropology.

[23]  R. Langrock.  Some applications of nonlinear and non-Gaussian state–space modelling by means of hidden Markov models , 2011 .

[24]  O. Ovaskainen,et al.  State-space models of individual animal movement. , 2008, Trends in ecology & evolution.

[25]  J. Durbin,et al.  Monte Carlo maximum likelihood estimation for non-Gaussian state space models , 1997 .

[26]  Steven M. Goodman,et al.  The Natural History of Madagascar , 2003 .

[27]  Juan M. Morales,et al.  EXTRACTING MORE OUT OF RELOCATION DATA: BUILDING MOVEMENT MODELS AS MIXTURES OF RANDOM WALKS , 2004 .

[28]  Thomas Caraco,et al.  ON FORAGING TIME ALLOCATION IN A STOCHASTIC ENVIRONMENT , 1980 .

[29]  Philippe Gaspar,et al.  A state-space model to derive bluefin tuna movement and habitat from archival tags , 2005 .

[30]  David Raubenheimer,et al.  Modeling Time Series of Animal Behavior by Means of a Latent‐State Model with Feedback , 2008, Biometrics.

[31]  Bruce Maxwell,et al.  Elk decision-making rules are simplified in the presence of wolves , 2006, Behavioral Ecology and Sociobiology.

[32]  Byron J. T. Morgan.  Markov Properties of Sequences of Behaviours , 1976 .

[33]  R. Mittermeier,et al.  Lemurs of Madagascar , 1994 .

[34]  Francesco Bartolucci,et al.  Latent Markov model for longitudinal binary data: An application to the performance evaluation of nursing homes , 2009, 0908.2300.

[35]  E. Zimmermann,et al.  Patterns and dynamics of sex-biased dispersal in a nocturnal primate, the grey mouse lemur, Microcebus murinus , 2003, Animal Behaviour.

[36]  E. Charnov.  Optimal foraging, the marginal value theorem. , 1976, Theoretical population biology.

[37]  P. Kappeler,et al.  Scramble or contest competition over food in solitarily foraging mouse lemurs (Microcebus spp.): New insights from stable isotopes. , 2009, American journal of physical anthropology.

[38]  Iain L. MacDonald,et al.  Some nonstandard stochastic volatility models and their estimation using structured hidden Markov models , 2012 .

[39]  Madhur Anand,et al.  On the use of stationary versus hidden Markov models to detect simple versus complex ecological dynamics , 2005 .

[40]  Antonello Maruotti,et al.  A semiparametric approach to hidden Markov models under longitudinal observations , 2009, Stat. Comput..

[41]  R. Langrock,et al.  Hidden Markov models with arbitrary state dwell-time distributions , 2011, Comput. Stat. Data Anal..

[42]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[43]  N. Dingemanse,et al.  Integrating animal temperament within ecology and evolution , 2007, Biological reviews of the Cambridge Philosophical Society.

[44]  Fabien Genin,et al.  Female dominance in competition for gum trees in the Grey Mouse Lemur Microcebus murinus , 2003, Revue d'Écologie (La Terre et La Vie).

[45]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[46]  James D. Hamilton.  A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[47]  Peter M. Kappeler,et al.  Mouse lemurs in space and time: a test of the socioecological model , 2001, Behavioral Ecology and Sociobiology.

[48]  Keith Humphreys,et al.  The Latent Markov Chain with Multivariate Random Effects , 1998 .

[49]  S. L. Scott.  Bayesian Methods for Hidden Markov Models , 2002 .

[50]  Toby A Patterson,et al.  Classifying movement behaviour in relation to environmental conditions using hidden Markov models. , 2009, The Journal of animal ecology.

[51]  David McFarland,et al.  Animal Behaviour Psychobiology, Ethology, and Evolution , 1985 .

[52]  Peter M. Kappeler,et al.  Small-scale coexistence of two mouse lemur species (Microcebus berthae and M. murinus) within a homogeneous competitive environment , 2008, Oecologia.

[53]  R. Altman.  Mixed Hidden Markov Models , 2007 .

[54]  Simon J. Bonner,et al.  Bayesian Analysis for Population Ecology by KING, R., MORGAN, B. J. T., GIMENEZ, O., and BROOKS, S. P. , 2011 .

[55]  S. Genovés,et al.  Violence and behavior: a symposium on the origins of man's inhumanity to man. , 2005, American journal of physical anthropology.

[56]  P M Kappeler,et al.  Microsatellite analyses reveal fine‐scale genetic structure in grey mouse lemurs (Microcebus murinus) , 2005, Molecular ecology.

[57]  Sean R. Eddy,et al.  Biological Sequence Analysis: Probabilistic Models of Proteins and Nucleic Acids , 1998 .

[58]  A. Houston,et al.  Models of adaptive behaviour , 1999 .

[59]  S. T. Bucklanda,et al.  State-space models for the dynamics of wild animal populations , 2003 .

[60]  E. Zimmermann,et al.  Female dominance in captive gray mouse lemurs (Microcebus murinus) , 2001, American journal of primatology.

[61]  Ian D Jonsen,et al.  Robust hierarchical state-space models reveal diel variation in travel rates of migrating leatherback turtles. , 2006, The Journal of animal ecology.

[62]  Peter M. Kappeler,et al.  Sex in the dark: determinants and consequences of mixed male mating tactics in Microcebus murinus, a small solitary nocturnal primate , 2004, Behavioral Ecology and Sociobiology.

[63]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .