Nonparametric belief propagation

Continuous quantities are ubiquitous in models of real-world phenomena, but are surprisingly difficult to reason about automatically. Probabilistic graphical models such as Bayesian networks and Markov random fields, and algorithms for approximate inference such as belief propagation (BP), have proven to be powerful tools in a wide range of applications in statistics and artificial intelligence. However, applying these methods to models with continuous variables remains a challenging task. In this work we describe an extension of BP to continuous variable models, generalizing particle filtering, and Gaussian mixture filtering techniques for time series to more complex models. We illustrate the power of the resulting nonparametric BP algorithm via two applications: kinematic tracking of visual motion and distributed localization in sensor networks.

[1]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  David J. Fleet,et al.  Probabilistic tracking of motion boundaries with spatiotemporal predictions , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Darryl Morrell,et al.  Implementation of Continuous Bayesian Networks Using Sums of Weighted Gaussians , 1995, UAI.

[4]  Thomas S. Huang,et al.  Learning-Based Nonparametric Image Super-Resolution , 2006, EURASIP J. Adv. Signal Process..

[5]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[6]  Matthias Seeger Gaussian Process Belief Propagation , 2007 .

[7]  Tom Heskes,et al.  On the Uniqueness of Loopy Belief Propagation Fixed Points , 2004, Neural Computation.

[8]  William T. Freeman,et al.  Efficient Multiscale Sampling from Products of Gaussian Mixtures , 2003, NIPS.

[9]  James M. Coughlan,et al.  Dynamic quantization for belief propagation in sparse spaces , 2007, Comput. Vis. Image Underst..

[10]  Michael Isard,et al.  PAMPAS: real-valued graphical models for computer vision , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Serafín Moral,et al.  Mixing exact and importance sampling propagation algorithms in dependence graphs , 1997, Int. J. Intell. Syst..

[12]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[13]  William T. Freeman,et al.  Constructing free-energy approximations and generalized belief propagation algorithms , 2005, IEEE Transactions on Information Theory.

[14]  N BelhumeurPeter A Bayesian approach to binocular stereopsis , 1996 .

[15]  Justin Dauwels,et al.  Message-passing decoding of lattices using Gaussian mixtures , 2008, 2008 IEEE International Symposium on Information Theory.

[16]  Michael J. Black,et al.  On the unification of line processes, outlier rejection, and robust statistics with applications in early vision , 1996, International Journal of Computer Vision.

[17]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[18]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[19]  Pietro Perona,et al.  Unsupervised Learning of Models for Recognition , 2000, ECCV.

[20]  Alan S. Willsky,et al.  Learning the Dynamics and Time-Recursive Boundary Detection of Deformable Objects , 2008, IEEE Transactions on Image Processing.

[21]  Michael I. Mandel,et al.  Visual Hand Tracking Using Nonparametric Belief Propagation , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[22]  Richard G. Baraniuk,et al.  Bayesian Compressive Sensing Via Belief Propagation , 2008, IEEE Transactions on Signal Processing.

[23]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[24]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[25]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[26]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[27]  Simon J. Godsill,et al.  An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo , 2007, Proceedings of the IEEE.

[28]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[29]  Rajesh P. N. Rao,et al.  Learning Nonparametric Models for Probabilistic Imitation , 2006, NIPS.

[30]  John W. Fisher,et al.  Nonparametric belief propagation for self-localization of sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[31]  Ying Wu,et al.  Hand modeling, analysis and recognition , 2001, IEEE Signal Process. Mag..

[32]  Hilbert J. Kappen,et al.  Sufficient Conditions for Convergence of the Sum–Product Algorithm , 2005, IEEE Transactions on Information Theory.

[33]  Michael Isard,et al.  Continuously-adaptive discretization for message-passing algorithms , 2008, NIPS.

[34]  A. Doucet,et al.  Sequential auxiliary particle belief propagation , 2005, 2005 7th International Conference on Information Fusion.

[35]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[36]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Yair Weiss,et al.  Approximate Inference and Protein-Folding , 2002, NIPS.

[38]  James M. Coughlan,et al.  Finding Deformable Shapes Using Loopy Belief Propagation , 2002, ECCV.

[39]  P. Moral Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[40]  Steffen L. Lauritzen,et al.  Graphical models in R , 1996 .

[41]  Vibhav Gogate,et al.  AND/OR Importance Sampling , 2008, UAI.

[42]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[43]  Meir Feder,et al.  Low-Density Lattice Codes , 2007, IEEE Transactions on Information Theory.

[44]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[45]  Gregory F. Cooper,et al.  The Computational Complexity of Probabilistic Inference Using Bayesian Belief Networks , 1990, Artif. Intell..

[46]  Daniel P. Huttenlocher,et al.  Pictorial Structures for Object Recognition , 2004, International Journal of Computer Vision.

[47]  John W. Fisher,et al.  Loopy Belief Propagation: Convergence and Effects of Message Errors , 2005, J. Mach. Learn. Res..

[48]  William T. Freeman,et al.  Nonparametric belief propagation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[49]  I JordanMichael,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008 .

[50]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[51]  H. Sorenson,et al.  Nonlinear Bayesian estimation using Gaussian sum approximations , 1972 .

[52]  Uffe Kjaerulff HUGS: Combining Exact Inference and Gibbs Sampling in Junction Trees , 2011 .

[53]  Martin Neil,et al.  Inference in hybrid Bayesian networks using dynamic discretization , 2007, Stat. Comput..

[54]  Radford M. Neal,et al.  Inferring State Sequences for Non-linear Systems with Embedded Hidden Markov Models , 2003, NIPS.

[55]  Parag A. Pathak,et al.  Massachusetts Institute of Technology , 1964, Nature.

[56]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[57]  Michael J. Black,et al.  Learning the Statistics of People in Images and Video , 2003, International Journal of Computer Vision.

[58]  Michael Isard,et al.  Tracking loose-limbed people , 2004, CVPR 2004.

[59]  David A. McAllester,et al.  Particle Belief Propagation , 2009, AISTATS.

[60]  Daniel Rudoy,et al.  Multi-Scale MCMC Methods for Sampling from Products of Gaussian Mixtures , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[61]  Brendan J. Frey,et al.  A Revolution: Belief Propagation in Graphs with Cycles , 1997, NIPS.

[62]  Bernard W. Silverman,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[63]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[65]  William T. Freeman,et al.  Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology , 1999, Neural Computation.

[66]  Steffen L. Lauritzen,et al.  Hybrid Propagation in Junction Trees , 1994, IPMU.

[67]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[68]  Dragomir Anguelov,et al.  A General Algorithm for Approximate Inference and Its Application to Hybrid Bayes Nets , 1999, UAI.

[69]  Padhraic Smyth,et al.  Particle-based Variational Inference for Continuous Systems , 2009, NIPS.

[70]  Michael J. Black,et al.  On the unification of line processes , 1996 .

[71]  Michael J. Black,et al.  Robust Parameterized Component Analysis Theory and Applications to 2D Facial Modeling , 2002, eccv 2002.

[72]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[73]  Tony X. Han,et al.  Efficient Nonparametric Belief Propagation with Application to Articulated Body Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[74]  Nando de Freitas,et al.  Hot Coupling: A Particle Approach to Inference and Normalization on Pairwise Undirected Graphs , 2005, NIPS.

[75]  Martin J. Wainwright,et al.  Tree-based reparameterization for approximate inference on loopy graphs , 2001, NIPS.

[76]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .