Infinite Factorial Dynamical Model

We propose the infinite factorial dynamic model (iFDM), a general Bayesian non-parametric model for source separation. Our model builds on the Markov Indian buffet process to consider a potentially unbounded number of hidden Markov chains (sources) that evolve independently according to some dynamics, in which the state space can be either discrete or continuous. For posterior inference, we develop an algorithm based on particle Gibbs with ancestor sampling that can be efficiently applied to a wide range of source separation problems. We evaluate the performance of our iFDM on four well-known applications: multitarget tracking, cocktail party, power disaggregation, and multiuser detection. Our experimental results show that our approach for source separation does not only outperform previous approaches, but it can also handle problems that were computationally intractable for existing approaches.

[1]  Brian W. Kernighan,et al.  WISE design of indoor wireless systems: practical computation and optimization , 1995 .

[2]  Matthew J. Johnson,et al.  Bayesian nonparametric hidden semi-Markov models , 2012, J. Mach. Learn. Res..

[3]  Yee Whye Teh,et al.  Bayesian Nonparametric Models , 2010, Encyclopedia of Machine Learning.

[4]  Michael I. Jordan,et al.  Bayesian Nonparametric Methods for Learning Markov Switching Processes , 2010, IEEE Signal Processing Magazine.

[5]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[6]  Michael I. Jordan,et al.  A Sticky HDP-HMM With Application to Speaker Diarization , 2009, 0905.2592.

[7]  Jouko Lampinen,et al.  Rao-Blackwellized particle filter for multiple target tracking , 2007, Inf. Fusion.

[8]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[9]  Mark Coates,et al.  Multi-target tracking for measurement models with additive contributions , 2011, 14th International Conference on Information Fusion.

[10]  Jaechan Lim,et al.  Multitarget Tracking by Particle Filtering Based on RSS Measurement in Wireless Sensor Networks , 2015, Int. J. Distributed Sens. Networks.

[11]  Songhwai Oh,et al.  Markov chain Monte Carlo data association for general multiple-target tracking problems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[12]  Michael I. Jordan.  Hierarchical Models , Nested Models and Completely Random Measures , 2010 .

[13]  Fred Popowich,et al.  AMPds: A public dataset for load disaggregation and eco-feedback research , 2013, 2013 IEEE Electrical Power & Energy Conference.

[14]  Sinan Yildirim,et al.  Bayesian Tracking and Parameter Learning for Non-Linear Multiple Target Tracking Models , 2014, IEEE Transactions on Signal Processing.

[15]  Carl E. Rasmussen,et al.  Factorial Hidden Markov Models , 1997 .

[16]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[17]  Fredrik Lindsten,et al.  Particle gibbs with ancestor sampling , 2014, J. Mach. Learn. Res..

[18]  Yee Whye Teh,et al.  The Infinite Factorial Hidden Markov Model , 2008, NIPS.

[19]  Fredrik Lindsten,et al.  Backward Simulation Methods for Monte Carlo Statistical Inference , 2013, Found. Trends Mach. Learn..

[20]  Christopher Yau,et al.  Hamming Ball Auxiliary Sampling for Factorial Hidden Markov Models , 2014, NIPS.

[21]  A. Doucet,et al.  Efficient Bayesian Inference for Switching State-Space Models using Discrete Particle Markov Chain Monte Carlo Methods , 2010, 1011.2437.

[22]  Yee Whye Teh,et al.  Stick-breaking Construction for the Indian Buffet Process , 2007, AISTATS.

[23]  Tommi S. Jaakkola,et al.  Approximate Inference in Additive Factorial HMMs with Application to Energy Disaggregation , 2012, AISTATS.

[24]  Joaquín Míguez,et al.  User Activity Tracking in DS-CDMA Systems , 2013, IEEE Transactions on Vehicular Technology.

[25]  Zoubin Ghahramani,et al.  Nonparametric Bayesian Sparse Factor Models with application to Gene Expression modelling , 2010, The Annals of Applied Statistics.