Spiking neural network based ASIC for character recognition

Spiking neural networks are the recent models of artificial neural networks. These networks use biologically similar neuron models as their basic computation units. This paper presents and compares a custom spiking neural network (SNN) with a conventional nearest neighbour classifier for hand written character recognition. The classifiers are designed and simulated in 90nm CMOS technology. The two algorithms are compared in terms of their success rates and their hardware requirements (based on the area and power estimates). The classification performance of the SNN is also compared with that of second generation feedforward neural network, with the same set of images. The robustness of SNN is demonstrated in this work by its ability to classify the 30 out of 32 noisy characters images presented as compared to the nearest neighbour algorithm, which correctly classified only 20 of them. The feedforward neural network using backpropagation algorithm was able to correctly identify 29 out of 32 noisy images in MATLAB. In terms of hardware, the ASIC realizing the nearest neighbour classifier dissipates power of 1.2mW and an area of 380μm × 380μm, while the SNN dissipates 16.7mW power and an area of 1mm × 1mm. The higher area and power requirements for the SNN stem from its inherent parallel architecture. Earlier works have focused on realization of a single spiking neuron and its variants while this work brings about the application using networks of these neurons and their suitability for custom realization.

[1]  L. F Abbott,et al.  Lapicque’s introduction of the integrate-and-fire model neuron (1907) , 1999, Brain Research Bulletin.

[2]  Lee Lam Hong,et al.  A Review of Nearest Neighbor-Support Vector Machines Hybrid Classification Models , 2010 .

[3]  Hojjat Adeli,et al.  Spiking Neural Networks , 2009, Int. J. Neural Syst..

[4]  Stefan Wermter,et al.  Spike-Timing Dependent Competitive Learning of Integrate-and-Fire Neurons with Active Dendrites , 2002, ICANN.

[5]  Brijesh Verma,et al.  A novel feature extraction technique for the recognition of segmented handwritten characters , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[6]  Stavros J. Perantonis,et al.  Handwritten character recognition through two-stage foreground sub-sampling , 2010, Pattern Recognit..

[7]  Tarek M. Taha,et al.  Character recognition with two spiking neural network models on multicore architectures , 2009, 2009 IEEE Symposium on Computational Intelligence for Multimedia Signal and Vision Processing.

[8]  Sander M. Bohte,et al.  Computing with Spiking Neuron Networks , 2012, Handbook of Natural Computing.

[9]  Anuja P. Nagare.  License Plate Character Recognition System using Neural Network , 2011 .

[10]  K SrikantaMurthy,et al.  Fan Beam Projection Based Features to Recognize Handwritten Kannada Numerals , 2011 .

[11]  Lyle N. Long,et al.  Character Recognition using Spiking Neural Networks , 2007, 2007 International Joint Conference on Neural Networks.

[12]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[13]  Wulfram Gerstner,et al.  Reducing Spike Train Variability: A Computational Theory Of Spike-Timing Dependent Plasticity , 2004, BNAIC.

[14]  Ashok M. Sapkal,et al.  Survey of Methods for Character Recognition , 2012 .

[15]  Dinesh Dileep Gaurav,et al.  A feature extraction technique based on character geometry for character recognition , 2012, ArXiv.

[16]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[17]  Ankush Mittal,et al.  Evaluation of Different Feature Extractors and Classifiers for Offline Handwritten Devnagari Character Recognition , 2011 .