Bayesian estimation of discrete-time cellular neural network coefficients

A new method for finding the network coefficients of a discrete-time cellular neural network (DTCNN) is proposed. This new method uses a probabilistic approach that itself uses Bayesian learning to estimate the network coefficients. A posterior probability density function (PDF) is composed using the likelihood and prior PDFs derived from the system model and prior information, respectively. This posterior PDF is used to draw samples with the help of the Metropolis algorithm, a special case of the Metropolis--Hastings algorithm where the proposal distribution function is symmetric, and resulting samples are then averaged to find the minimum mean square error (MMSE) estimate of the network coefficients. A couple of image processing applications are performed using these estimated parameters and the results are compared with those of some well-known methods.

[1]  Leon O. Chua,et al.  Cellular neural networks: applications , 1988 .

[2]  Lawrence Carin,et al.  Bayesian Robust Principal Component Analysis , 2011, IEEE Transactions on Image Processing.

[3]  Igor Kononenko,et al.  Inductive and Bayesian learning in medical diagnosis , 1993, Appl. Artif. Intell..

[4]  S. Arik,et al.  Stability analysis of dynamical neural networks , 1997 .

[5]  S. Karamahmut,et al.  Recurrent perceptron learning algorithm for completely stable cellular neural networks , 1994, Proceedings of the Third IEEE International Workshop on Cellular Neural Networks and their Applications (CNNA-94).

[6]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[7]  E. Olsson.  Bayesian epistemology , 2017 .

[8]  Michael I. Jordan,et al.  Bayesian Nonparametric Inference of Switching Dynamic Linear Models , 2010, IEEE Transactions on Signal Processing.

[9]  Kari Halonen,et al.  CNN applications from the hardware point of view: video sequence segmentation , 2002, Int. J. Circuit Theory Appl..

[10]  Giovanni Costantini,et al.  CNN based unsupervised pattern classification for linearly and non linearly separable data sets , 2005 .

[11]  Hoi-Jun Yoo,et al.  A Configurable Heterogeneous Multicore Architecture With Cellular Neural Network for Real-Time Object Recognition , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Leon O. Chua,et al.  Genetic algorithm for CNN template learning , 1993 .

[13]  Wen Yu,et al.  Training Cellular Neural Networks with Stable Learning Algorithm , 2006, ISNN.

[14]  Francesco Parisi,et al.  The Role of Status Quo Bias and Bayesian Learning in the Creation of New Legal Rights , 2007 .

[15]  Karolin Baecker,et al.  Two Dimensional Signal And Image Processing , 2016 .

[16]  Zbigniew Szymański,et al.  Cellular Neural Network learning using Multilayer Perceptron , 2011, 2011 20th European Conference on Circuit Theory and Design (ECCTD).

[17]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[18]  Ganesh K. Venayagamoorthy,et al.  Decentralized Asynchronous Learning in Cellular Neural Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[19]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001 .

[20]  Gomes de Freitas,et al.  Bayesian methods for neural networks , 2000 .

[21]  Josef A. Nossek.  Design and Learning with Cellular Neural Networks , 1996, Int. J. Circuit Theory Appl..

[22]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[23]  Abdullah Bal,et al.  Cellular Neural Network training by ant colony optimization algorithm , 2010, 2010 IEEE 18th Signal Processing and Communications Applications Conference.

[24]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[25]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[26]  Lawrence Carin,et al.  Nonparametric Bayesian Segmentation of a Multivariate Inhomogeneous Space-Time Poisson Process. , 2012, Bayesian analysis.

[27]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.