Maximum entropy signal reconstruction with neural networks

The implementation of the maximum entropy reconstruction algorithms by means of neural networks is discussed. It is shown that the solutions of the maximum entropy problem correspond to the steady states of the appropriate Hopfield net. The choice of network parameters is discussed, and existence of the maximum entropy solution is proved.

[1]  G Demoment,et al.  Maximum entropy image reconstruction in X-ray and diffraction tomography. , 1988, IEEE transactions on medical imaging.

[2]  Stephen F. Gull,et al.  Developments in Maximum Entropy Data Analysis , 1989 .

[3]  John Skilling,et al.  Maximum entropy method in image processing , 1984 .

[4]  R. Hecht-Nielsen,et al.  Neurocomputing: picking the human brain , 1988, IEEE Spectrum.

[5]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[6]  Kunihiko Fukushima,et al.  Neocognitron: A hierarchical neural network capable of visual pattern recognition , 1988, Neural Networks.

[7]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[8]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[9]  M. C. Peckerar,et al.  Electronic 'neural' net algorithm for maximum entropy solutions of ill-posed problems , 1989 .

[10]  Lawrence D. Jackel,et al.  VLSI implementation of a neural network model , 1988, Computer.

[11]  Dov Ingman,et al.  Local minimum escape using thermodynamic properties of neural networks , 1991, Neural Networks.

[12]  S. Gull,et al.  Image reconstruction from incomplete and noisy data , 1978, Nature.

[13]  Xinhua Zhuang,et al.  A differential equation approach to maximum entropy image reconstruction , 1987, IEEE Trans. Acoust. Speech Signal Process..

[14]  Nelson Morgan,et al.  Applications of neural-network (NN) signal processing in brain research , 1988, IEEE Trans. Acoust. Speech Signal Process..

[15]  Mohamad T. Musavi,et al.  A neural network approach to character recognition , 1989, Neural Networks.

[16]  John Skilling,et al.  Image restoration by a powerful maximum entropy method , 1982, Comput. Vis. Graph. Image Process..

[17]  Bernard Widrow,et al.  Layered neural nets for pattern recognition , 1988, IEEE Trans. Acoust. Speech Signal Process..

[18]  B. Frieden.  Restoring with maximum likelihood and maximum entropy. , 1972, Journal of the Optical Society of America.

[19]  B. K. Jenkins,et al.  Image restoration using a neural network , 1988, IEEE Trans. Acoust. Speech Signal Process..

[20]  I. A. Mack,et al.  Electronic ‘Neural’ Nets for Solving Ill-Posed Problems with an Entropy Regulariser , 1989 .

[21]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[22]  C K Zoltani,et al.  Maximum bounded entropy: application to tomographic reconstruction. , 1985, Applied optics.

[23]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.