Multilayer Neural Network based on Multi-Valued Neurons and the Blur Identification Problem

A multilayer neural network based on multivalued neurons (MLMVN) is a neural network with a traditional feedforward architecture. At the same time this network has a number of specific properties and advantages. Its backpropagation learning algorithm does not require differentiability of the activation function. The functionality of MLMVN is higher than the ones of the traditional feedforward neural networks and a variety of kernel-based networks. Its higher flexibility and faster adaptation to the mapping implemented make possible an accomplishment of complex problems using a simpler network. The MLMVN can be used to solve those non-standard recognition and classification problems that cannot be solved using other techniques. In this paper we use the MLMVN as a tool for the blur identification problem. A prior knowledge about the distorting operator and its parameter is of crucial importance in blurred image restoration.

[1]  J. Reinitz,et al.  Temporal classification of Drosophila segmentation gene expression patterns by the multi-valued neural recognition method. , 2002, Mathematical biosciences.

[2]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[3]  Reginald L. Lagendijk,et al.  Identification and restoration of noisy blurred images using the expectation-maximization algorithm , 1990, IEEE Trans. Acoust. Speech Signal Process..

[4]  Henry Stark,et al.  Image recovery: Theory and application , 1987 .

[5]  Constantine Butakoff,et al.  Type of Blur and Blur Parameters Identification Using Neural Network and Its Application to Image Restoration , 2002, ICANN.

[6]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[7]  Claudio Moraga,et al.  A Feedforward Neural Network based on Multi-Valued Neurons , 2004, Fuzzy Days.

[8]  Robert D. Nowak,et al.  An EM algorithm for wavelet-based image restoration , 2003, IEEE Trans. Image Process..

[9]  Jacek M. Zurada,et al.  A new design method for the complex-valued multistate Hopfield associative memory , 2003, IEEE Trans. Neural Networks.

[10]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[11]  Richard G. Baraniuk,et al.  ForWaRD: Fourier-wavelet regularized deconvolution for ill-conditioned systems , 2004, IEEE Transactions on Signal Processing.

[12]  Yukio Kosugi,et al.  Rotation-Invariant Image Association for Endoscopic Positional Identification Using Complex-Valued Associative Memories , 2001, IWANN.

[13]  Jan Flusser,et al.  Multichannel blind deconvolution of spatially misaligned images , 2005, IEEE Transactions on Image Processing.

[14]  Constantine Butakoff,et al.  Blurred image restoration using the type of blur and blur parameter identification on the neural network , 2002, IS&T/SPIE Electronic Imaging.

[15]  Claudio Moraga,et al.  Multilayer Feedforward Neural Network Based on Multi-valued Neurons (MLMVN) and a Backpropagation Learning Algorithm , 2006, Soft Comput..

[16]  Joos Vandewalle,et al.  Multi-Valued and Universal Binary Neurons: Theory, Learning and Applications , 2012 .

[17]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[18]  Jacek M. Zurada,et al.  Complex-valued multistate neural associative memory , 1996, IEEE Trans. Neural Networks.

[19]  Dianne P. O'Leary,et al.  Restoring Images Degraded by Spatially Variant Blur , 1998, SIAM J. Sci. Comput..

[20]  Yoram Bresler,et al.  Perfect blind restoration of images blurred by multiple filters: theory and efficient algorithms , 1999, IEEE Trans. Image Process..

[21]  Naum N. Aizenberg,et al.  CNN based on multi-valued neuron as a model of associative memory for grey scale images , 1992, CNNA '92 Proceedings Second International Workshop on Cellular Neural Networks and Their Applications.

[22]  Yukio Kosugi,et al.  An image storage system using complex-valued associative memories , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[23]  Joos Vandewalle,et al.  Multi-Valued and Universal Binary Neurons , 2000 .

[24]  Jaakko Astola,et al.  A spatially adaptive nonparametric regression image deblurring , 2005, IEEE Transactions on Image Processing.