Toward CNN chip-specific robustness

The promising potential of cellular neural networks (CNN) has resulted in the development of several template design methods. The CNN universal machine (CNN-UM), a programmable CNN, has made it possible to create image-processing algorithms that run on this platform. However, very large-scale integration implementations of CNN-UMs presented parameter deviations that do not occur on ideal CNN structures. Consequently, new design methods were developed aiming at more robust templates. Although these new templates were indeed more robust, erroneous behavior can still be observed. An alternative for chip-independent robustness is chip-specific optimization, where the template is targeted to an individual chip. This paper describes a solution proposal in this sense to automatically tune templates in order to make the chip react as an ideal CNN structure. The approach uses measurements of actual CNN-UM chips as part of the cost function for a global optimization method to find an optimal template given an initial approximation. Further improvements are achieved by generating chip-specific robust templates by doing a search for the best template among the optimal ones. The tuned templates are therefore customized versions that are expected to be much less sensitive to imperfections on the operation of CNN-UM chips. Results are presented for the binary and grayscale cases, including the case of grayscale output. It is expected that as this technique matures, it will give CNN-UM chips enough reliability to compete with digital systems in terms of robustness in addition to advantages of speed.

[1]  Leon O. Chua,et al.  Genetic algorithm for CNN template learning , 1993 .

[2]  Ákos Zarándy The art of CNN template design , 1999 .

[3]  Johan A. K. Suykens,et al.  Automatic chip-spcific CNN template optimization using adaptive simulated Annealing , 2003 .

[4]  Tamás Roska,et al.  The CNN universal machine , 1993 .

[5]  C. L. Semmelman,et al.  Statistical circuit design: Nonlinear circuits and statistical design , 1971 .

[6]  Ángel Rodríguez-Vázquez,et al.  Toward visual microprocessors , 2002, Proc. IEEE.

[7]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[8]  Michiel Steyaert,et al.  Evaluation of CNN Template Robustness Towards VLSI Implementation , 1996, Int. J. Circuit Theory Appl..

[9]  Ákos Zarándy,et al.  CNN universal chips crank up the computing power , 1996 .

[10]  George S. Moschytz,et al.  Stochastic and hybrid approaches toward robust templates , 1998, 1998 Fifth IEEE International Workshop on Cellular Neural Networks and their Applications. Proceedings (Cat. No.98TH8359).

[11]  Akio Ushida,et al.  Adaptive Simulated Annealing in CNN Template Learning , 1999 .

[12]  M. A. Styblinski Statistical design centering approach to minimax circuit design , 1989, IEEE International Symposium on Circuits and Systems,.

[13]  B. Mirzai,et al.  Robust CNN templates: theory and simulations , 1996, 1996 Fourth IEEE International Workshop on Cellular Neural Networks and their Applications Proceedings (CNNA-96).

[14]  Leon O. Chua,et al.  Methods for image processing and pattern formation in Cellular Neural Networks: a tutorial , 1995 .

[15]  L. Ingber Very fast simulated re-annealing , 1989 .

[16]  Tamás Roska,et al.  The CNN universal machine: an analogic array computer , 1993 .

[17]  C. Güzeliş,et al.  A recurrent perceptron learning algorithm for cellular neural networks , 1999 .

[18]  Ángel Rodríguez-Vázquez,et al.  ACE4k: An analog I/O 64×64 visual microprocessor chip with 7-bit analog accuracy , 2002, Int. J. Circuit Theory Appl..

[19]  Tamás Roska,et al.  CNN software library (Templates and algorithms.) Version 7.2 , 1998 .

[20]  Josef A. Nossek Design and Learning with Cellular Neural Networks , 1996, Int. J. Circuit Theory Appl..

[21]  George S. Moschytz,et al.  An exact and direct analytical method for the design of optimally robust CNN templates , 1999 .

[22]  Ángel Rodríguez-Vázquez,et al.  ACE16k: A 128x128 Focal Plane Analog Processor with Digital I/O , 2003, Int. J. Neural Syst..

[23]  S. Espejo,et al.  A CNN universal chip in CMOS technology , 1994, Proceedings of the Third IEEE International Workshop on Cellular Neural Networks and their Applications (CNNA-94).

[24]  Ákos Zarándy,et al.  Fault-tolerant design of analogic CNN templates and algorithms-Part I: The binary output case , 1999 .