Tractable inference for probabilistic data models

We present an approximation technique for probabilistic data models with a large number of hidden variables, based on ideas from statistical physics. We give examples for two nontrivial applications. © 2003 Wiley Periodicals, Inc.

[1]  W. Freeman,et al.  Generalized Belief Propagation , 2000, NIPS.

[2]  David Haussler,et al.  Using the Fisher Kernel Method to Detect Remote Protein Homologies , 1999, ISMB.

[3]  Yoshiyuki Kabashima,et al.  Belief propagation vs. TAP for decoding corrupted messages , 1998 .

[4]  Opper,et al.  Mean field approach to Bayes learning in feed-forward neural networks. , 1996, Physical review letters.

[5]  Toshiyuki TANAKA.  Mean-field theory of Boltzmann machine learning , 1998 .

[6]  M. Opper,et al.  Tractable approximations for probabilistic models: the adaptive Thouless-Anderson-Palmer mean field approach. , 2001, Physical review letters.

[7]  Ole Winther,et al.  Mean-Field Approaches to Independent Component Analysis , 2002, Neural Computation.

[8]  T. Plefka.  Convergence condition of the TAP equation for the infinite-ranged Ising spin glass model , 1982 .

[9]  Tom Minka,et al.  Expectation Propagation for approximate Bayesian inference , 2001, UAI.

[10]  Ole Winther,et al.  Gaussian Processes for Classification: Mean-Field Algorithms , 2000, Neural Computation.

[11]  Hilbert J. Kappen,et al.  Efficient Learning in Boltzmann Machines Using Linear Response Theory , 1998, Neural Computation.

[12]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[13]  M. Opper,et al.  Adaptive and self-averaging Thouless-Anderson-Palmer mean-field theory for probabilistic modeling. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  M. Opper,et al.  Advanced mean field methods: theory and practice , 2001 .

[15]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[16]  Y. M. WongDepartment,et al.  Microscopic Equations and Stability Conditions in Optimal Neural Networks , 1995 .

[17]  Ole Winther,et al.  Analysis of functional neuroimages using ICA with adaptive binary sources , 2002, Neurocomputing.

[18]  Carl E. Rasmussen,et al.  In Advances in Neural Information Processing Systems , 2011 .

[19]  G. Parisi,et al.  Mean-field equations for spin models with orthogonal interaction matrices , 1995, cond-mat/9503009.

[20]  R. Palmer,et al.  Solution of 'Solvable model of a spin glass' , 1977 .

[21]  M. Mézard.  The space of interactions in neural networks: Gardner's computation with the cavity method , 1989 .