Handwritten characters recognition based on nature-inspired computing and neuro-evolution

The enormous services obtainable by bank and postal systems are not 100 % guaranteed due to variability of handwriting styles. Various methods based on neural networks have been suggested to address this issue. Unfortunately, they often fall into local optima that arises from the use of old learning methods. Global optimization methods provided new directions for neural networks evolution that may be useful in recognition. This paper develops efficient algorithms that compute globally optimal solutions by exploiting the benefits of both swarm intelligence and neuro-evolution in a way to improve the overall performance of a character recognition system. Various adaptations implied to both MLP and RBF networks have been suggested namely: particle swarm optimization (PSO) and the bees algorithm (BA) for characters classification, MLP training or RBF design by co-evolution and effective combinations of MLPs, RBFs or SVMs as an attempt to overcome the drawbacks of old recognition methods. Results proved that networks combination proposals ensure the highest improvement compared to either standard MLP and RBF networks, the co-evolutionary alternatives or other classifiers combination based on common combination rules namely majority voting, the fusion rules of min, max, sum, average, product and Bayes, Decision template and the Behavior Knowledge Space (BKS).

[1]  Marc Parizeau,et al.  Genetic engineering of hierarchical fuzzy regional representations for handwritten character recognition , 2006, International Journal of Document Analysis and Recognition (IJDAR).

[2]  Andries Petrus Engelbrecht,et al.  A fuzzy particle swarm optimization algorithm for computer communication network topology design , 2010, Applied Intelligence.

[3]  Luigi P. Cordella,et al.  A novel mutation operator for the evolutionary learning of Bayesian networks , 2008, ICPR 2008.

[4]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[5]  Ranpreet Kaur,et al.  A Hybrid Neural Approach For Character Recognition System , 2011 .

[6]  R. Lefebvre,et al.  A neural network approach for preclassification in musical chords recognition , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[7]  Myong Kee Jeong,et al.  A two-leveled symbiotic evolutionary algorithm for clustering problems , 2012, Applied Intelligence.

[8]  Ranadhir Ghosh,et al.  An Intelligent Offline Handwriting Recognition System Using Evolutionary Neural Learning Algorithm and Rule Based Over Segmented Data Points , 2005, J. Res. Pract. Inf. Technol..

[9]  Manuel Carcenac,et al.  A modular neural network for super-resolution of human faces , 2009, Applied Intelligence.

[10]  D. Janzen WHEN IS IT COEVOLUTION? , 1980, Evolution; international journal of organic evolution.

[11]  Benjamin Quost One-against-all Classifier Combination in the Framework of Belief Functions , 2006 .

[12]  Hassan Qjidaa,et al.  Evolving Neural Networks using Moment Method for Handwritten Digit Recognition , 2007 .

[13]  Didier Guériot,et al.  RBF neural network, basis functions and genetic algorithm , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[14]  Sargur N. Srihari,et al.  Hierarchical character recognition and its use in handwritten word/phrase recognition , 2000 .

[15]  Yamina Mohamed Ben Ali,et al.  Psychological model of particle swarm optimization based multiple emotions , 2012, Applied Intelligence.

[16]  Luiz Eduardo Soares de Oliveira,et al.  Improving cascading classifiers with particle swarm optimization , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[17]  Mahua Bhattacharya,et al.  Evolutionary Radial Basis Function Network for Classificatory Problems , 2010, Int. J. Comput. Sci. Appl..

[18]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[19]  Ernesto Costa,et al.  SAPPO: A Simple, Adaptable, Predator Prey Optimiser , 2003, EPIA.

[20]  Ajith Abraham,et al.  Is Neural Network a Reliable Forecaster on Earth? A MARS Query! , 2001, IWANN.

[21]  Brijesh Verma,et al.  Hybrid ensemble approach for classification , 2011, Applied Intelligence.

[22]  P. Angeline Evolving basis functions with dynamic receptive fields , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[23]  Salima Nebti,et al.  An improved radial basis function neural network based on a cooperative coevolutionary algorithm for handwritten digits recognition , 2010, 2010 International Conference on Machine and Web Intelligence.

[24]  X. Yao Evolving Artificial Neural Networks , 1999 .

[25]  Halina Kwasnicka,et al.  Efficiency Aspects of Neural Network Architecture Evolution Using Direct and Indirect Encoding , 2005 .

[26]  Jinping Li,et al.  Character Recognition Based on Hierarchical RBF Neural Networks , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[27]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[28]  Yann LeCun,et al.  Handwritten zip code recognition with multilayer networks , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[29]  Jeffrey K. Bassett,et al.  An Analysis of Cooperative Coevolutionary Algorithms A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at George Mason University , 2003 .

[30]  Manu Pratap Singh,et al.  Handwritten English Vowels Recognition Using Hybrid Evolutionary Feed-forward Neural Network , 2006 .

[31]  Luigi P. Cordella,et al.  A feature selection algorithm for handwritten character recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[32]  Tania Binos,et al.  Evolving Neural Network Architecture and Weights Using An Evolutionary Algorithm , 2003 .

[33]  Zhenbo Li,et al.  Study on hybrid PS-ACO algorithm , 2011, Applied Intelligence.

[34]  John Cartlidge,et al.  Rules of engagement : competitive coevolutionary dynamics in computational systems , 2004 .

[35]  James R. Parker,et al.  Practical Computer Vision Using C , 1993 .

[36]  Wasfi G. Al-Khatib,et al.  Recognition of Arabic (Indian) bank check digits using log-gabor filters , 2011, Applied Intelligence.

[37]  Germano C. Vasconcelos,et al.  Investigating feedforward neural networks with respect to the rejection of spurious patterns , 1995, Pattern Recognit. Lett..

[38]  Isabelle Guyon Applications of Neural Networks to Character Recognition , 1991, Int. J. Pattern Recognit. Artif. Intell..

[39]  Guangmin Sun,et al.  A new recognition method of vehicle license plate based on Genetic Neural Network , 2010, 2010 5th IEEE Conference on Industrial Electronics and Applications.

[40]  Luiz Eduardo Soares de Oliveira,et al.  Automatic Recognition of Handwritten Numerical Strings: A Recognition and Verification Strategy , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Germano C. Vasconcelos,et al.  An investigation of feedforward neural networks with respect to the detection of spurious patterns , 1995 .

[42]  Jaymin Kessler,et al.  Using genetic algorithms to reorganize superpeer structure in peer to peer networks , 2007, Applied Intelligence.

[43]  Iren Valova,et al.  Bridging the fuzzy, neural and evolutionary paradigms for automatic target recognition , 2011, Applied Intelligence.

[44]  D. Pham,et al.  THE BEES ALGORITHM, A NOVEL TOOL FOR COMPLEX OPTIMISATION PROBLEMS , 2006 .

[45]  Peitsang Wu,et al.  The Development of Neural Network Models by Revised Particle Swarm Optimization , 2006, JCIS.

[46]  Kyoung-jae Kim,et al.  Simultaneous optimization of artificial neural networks for financial forecasting , 2012, Applied Intelligence.

[47]  Anne M. P. Canuto,et al.  Ensembles of ARTMAP-based neural networks: an experimental study , 2011, Applied Intelligence.

[48]  Ajith Abraham,et al.  Optimization of evolutionary neural networks using hybrid learning algorithms , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[49]  Se-Young Oh,et al.  A new approach to simultaneous localization and map building with implicit model learning using neuro evolutionary optimization , 2010, Applied Intelligence.

[50]  Héla Khoufi Zouari Contribution à l'évaluation des méthodes de combinaison parallèle de classifieurs par simulation , 2004 .

[51]  R. D. Sudhaker Samuel,et al.  A simple and efficient optical character recognition system for basic symbols in printed Kannada text , 2007 .

[52]  V. Kalaichelvi,et al.  Application of Neural Networks in Character Recognition , 2012 .

[53]  Patrick Gallinari,et al.  Practical complexity control in multilayer perceptrons , 1999, Signal Process..

[54]  Timo Similä,et al.  Combined input variable selection and model complexity control for nonlinear regression , 2009, Pattern Recognit. Lett..

[55]  Ajith Abraham,et al.  Optimal Design of Neural Nets Using Hybrid Algorithms , 2000, PRICAI.

[56]  Salima Nebti,et al.  Use of Nature-inspired Meta-heuristics for Handwritten Digits Recognition , 2006 .

[57]  R.M. Valdovinos,et al.  Ensembles of Multilayer Perceptron and Modular Neural Networks for Fast and Accurate Learning , 2006, 2006 Fifth Mexican International Conference on Artificial Intelligence.

[58]  Brian J. Ross,et al.  Evolving dynamic Bayesian networks with Multi-objective genetic algorithms , 2007, Applied Intelligence.