Training neural networks using Clonal Selection Algorithm and Particle Swarm Optimization: A comparisons for 3D object recognition

Clonal Selection Algorithm (CLONALG) and Particle Swarm Optimization (PSO) have been applied for wide spectrum of computer vision problems. However, their applications to 3D object recognition receive only little attention. In this paper, CLONALG and PSO algorithms for recognition of 3D object are discussed. Instead of using any predefined model to extract the geometrical information, the 3D object is modeled based on its 2D image appearance. Firstly, the 2D image is segmented using Otsu thresholding method. Secondly, a set of moment features that are invariant under translation, changes in scale, and rotation is extracted. Thirdly, the CLONALG and PSO are used to initialize the neural network weights. Then, the neural network training is continued by Levenberg-Marquardt algorithm. The experimental results showed that the CLONALG-LM is better than PSO-LM and the other traditional training algorithms: Levenberg-Marquardt (LM), Scaled Conjugate Gradient (SCG), Gradient Descent (GD), Gradient Descent with Momentum (GDM), Gradient Descent with Adaptive Learning Rate (GDA), and Gradient descent with momentum and adaptive learning rate (GDMA).

[1]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[2]  Hiroshi Murase,et al.  Visual learning and recognition of 3-d objects from appearance , 2005, International Journal of Computer Vision.

[3]  Santhoji Katare,et al.  A hybrid swarm optimizer for efficient parameter estimation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[5]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[6]  Y. Lin MODEL BASED 3 D OBJECT RECOGNITION , 1997 .

[7]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[8]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[9]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[10]  Liu Jing,et al.  Feature Extraction Technique Based on the Perceptive Invariability , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[11]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[12]  Kaoru Hirota,et al.  A Hu moment invariant as a shape circularity measure , 2010, Pattern Recognit..

[13]  B Javidi,et al.  Neural network for three-dimensional object recognition based on digital holography. , 2001, Optics letters.

[14]  Manuele Bicego,et al.  A Hidden Markov Model approach for appearance-based 3D object recognition , 2005, Pattern Recognit. Lett..

[15]  Hiroshi Murase,et al.  Learning and recognition of 3D objects from appearance , 1993, [1993] Proceedings IEEE Workshop on Qualitative Vision.

[16]  Leandro Nunes de Castro,et al.  An Immune and a Gradient-Based Method to Train Multi-Layer Perceptron Neural Networks , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[17]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[18]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[19]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..