Probabilistic Information Processing and Belief Propagation

Abstract The basic frameworks of the Bayesian network and the belief propagation in the probabilistic information processing are reviewed in the standpoint of probabilistic inference. Some simple examples of Bayesian networks for the probabilistic inference are demonstrated and the basic formulation of the belief propagation algorithm is explained.

[1]  M. Mézard,et al.  Analytic and Algorithmic Solution of Random Satisfiability Problems , 2002, Science.

[2]  W. Freeman,et al.  Generalized Belief Propagation , 2000, NIPS.

[3]  Masato Okada,et al.  Accuracy of the Bethe approximation for hyperparameter estimation in probabilistic image processing , 2004 .

[4]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[5]  Shun-ichi Amari,et al.  Information geometry of turbo and low-density parity-check codes , 2004, IEEE Transactions on Information Theory.

[6]  Toshiyuki Tanaka,et al.  A statistical-mechanics approach to large-system analysis of CDMA multiuser detectors , 2002, IEEE Trans. Inf. Theory.

[7]  Kazuyuki Tanaka,et al.  Probabilistic Inference by means of Cluster Variation Method and Linear Response Theory , 2003 .

[8]  Y. Kabashima.  A CDMA multiuser detection algorithm on the basis of belief propagation , 2003 .

[9]  Rémi Monasson,et al.  Statistical mechanics methods and phase transitions in optimization problems , 2001, Theor. Comput. Sci..

[10]  Shun-ichi Amari,et al.  Stochastic Reasoning, Free Energy, and Information Geometry , 2004, Neural Computation.

[11]  Brendan J. Frey,et al.  Graphical Models for Machine Learning and Digital Communication , 1998 .

[12]  Kazuyuki Tanaka.  Statistical-mechanical approach to image processing , 2002 .

[13]  D. M. Titterington,et al.  Probabilistic image processing by means of the Bethe approximation for the Q-Ising model , 2003 .