A Unifying Variational Inference Framework for Hierarchical Graph-Coupled HMM with an Application to Influenza Infection

The Hierarchical Graph-Coupled Hidden Markov Model (hGCHMM) is a useful tool for tracking and predicting the spread of contagious diseases, such as influenza, by leveraging social contact data collected from individual wearable devices. However, the existing inference algorithms depend on the assumption that the infection rates are small in probability, typically close to 0. The purpose of this paper is to build a unified learning framework for latent infection state estimation for the hGCHMM, regardless of the infection rate and transition function. We derive our algorithm based on a dynamic auto-encoding variational inference scheme, thus potentially generalizing the hGCHMM to models other than those that work on highly contagious diseases. We experimentally compare our approach with previous Gibbs EM algorithms and standard variational method mean-field inference, on both semi-synthetic data and app collected epidemiological and social records.

[1]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[2]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[3]  Michal Rosen-Zvi,et al.  Hidden Topic Markov Models , 2007, AISTATS.

[4]  R. Christley,et al.  Infection in social networks: using network analysis to identify high-risk individuals. , 2005, American journal of epidemiology.

[5]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[6]  Maria A. Kazandjieva,et al.  A high-resolution human contact network for infectious disease transmission , 2010, Proceedings of the National Academy of Sciences.

[7]  K. Heller,et al.  Bayesian Models for Heterogeneous Personalized Health Data , 2015, 1509.00110.

[8]  Max Welling,et al.  Markov Chain Monte Carlo and Variational Inference: Bridging the Gap , 2014, ICML.

[9]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[10]  Radford M. Neal.  MCMC Using Hamiltonian Dynamics , 2011, 1206.1901.

[11]  M. Lipsitch,et al.  The analysis of hospital infection data using hidden Markov models. , 2004, Biostatistics.

[12]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[13]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[14]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[15]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[16]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[17]  Matthew J. Beal.  Variational algorithms for approximate Bayesian inference , 2003 .

[18]  Alex Pentland,et al.  Graph-Coupled HMMs for Modeling the Spread of Infection , 2012, UAI.

[19]  Harm de Vries,et al.  RMSProp and equilibrated adaptive learning rates for non-convex optimization. , 2015 .

[20]  Nitish Srivastava,et al.  Modeling Documents with Deep Boltzmann Machines , 2013, UAI.

[21]  Karol Gregor,et al.  Neural Variational Inference and Learning in Belief Networks , 2014, ICML.

[22]  Geoffrey E. Hinton,et al.  Deep, Narrow Sigmoid Belief Networks Are Universal Approximators , 2008, Neural Computation.

[23]  Katherine A. Heller,et al.  Hierarchical Graph-Coupled HMMs for Heterogeneous Personalized Health Data , 2015, KDD.