A fuzzy hybrid learning algorithm for radial basis function neural network with application in human face recognition

This paper presents a fuzzy hybrid learning algorithm (FHLA) for the radial basis function neural network (RBFNN). The method determines the number of hidden neurons in the RBFNN structure by using cluster validity indices with majority rule while the characteristics of the hidden neurons are initialized based on advanced fuzzy clustering. The FHLA combines the gradient method and the linear least-squared method for adjusting the RBF parameters and the neural network connection weights. The RBFNN with the proposed FHLA is used as a classifier in a face recognition system. The inputs to the RBFNN are the feature vectors obtained by combining shape information and principal component analysis. The designed RBFNN with the proposed FHLA, while providing a faster convergence in the training phase, requires a hidden layer with fewer neurons and less sensitivity to the training and testing patterns. The efficiency of the proposed method is demonstrated on the ORL and Yale face databases, and comparison with other algorithms indicates that the FHLA yields excellent recognition rate in human face recognition.

[1]  M. A. Grudin,et al.  On internal representations in face recognition systems , 2000, Pattern Recognit..

[2]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[3]  R. Tagliaferri,et al.  A supervised fuzzy clustering for Radial Basis Function Neural Networks training , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[4]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[5]  Jose C. Principe,et al.  The past, present, and future of neural networks for signal processing , 1997 .

[6]  N. B. Karayiannis,et al.  Gradient descent learning of radial basis neural networks , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[7]  Antonio F. Gómez-Skarmeta,et al.  A fuzzy clustering-based rapid prototyping for fuzzy rule-based modeling , 1997, IEEE Trans. Fuzzy Syst..

[8]  Simon Yueh,et al.  Application of neural networks to radar image classification , 1994, IEEE Trans. Geosci. Remote. Sens..

[9]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[10]  Boudewijn P. F. Lelieveldt,et al.  Optimal design of radial basis function neural networks for fuzzy-rule extraction in high dimensional data , 2002, Pattern Recognit..

[11]  Paramasivan Saratchandran,et al.  Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm , 1998, IEEE Trans. Neural Networks.

[12]  Lorenzo Bruzzone,et al.  A neural-statistical approach to multitemporal and multisource remote-sensing image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[13]  James C. Bezdek,et al.  Correction to "On Cluster Validity for the Fuzzy c-Means Model" [Correspondence] , 1997, IEEE Trans. Fuzzy Syst..

[14]  Christopher M. Bishop,et al.  Neural Network for Pattern Recognition , 1995 .

[15]  Karim Faez,et al.  An efficient method for recognition of human faces using higher orders Pseudo Zernike Moment Invariant , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[16]  Carlos E. Thomaz,et al.  Design of radial basis function network as classifier in face recognition using eigenfaces , 1998, Proceedings 5th Brazilian Symposium on Neural Networks (Cat. No.98EX209).

[17]  Karim Faez,et al.  A hybrid learning RBF neural network for human face recognition with pseudo Zernike moment invariant , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[18]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[19]  Weiyang Zhou,et al.  Verification of the nonparametric characteristics of backpropagation neural networks for image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[20]  James C. Bezdek,et al.  On cluster validity for the fuzzy c-means model , 1995, IEEE Trans. Fuzzy Syst..

[21]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[22]  Karim Faez,et al.  Neural network based face recognition with moment invariants , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[23]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[24]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[25]  Chin-Chuan Han,et al.  Why recognition in a statistics-based face recognition system should be based on the pure face portion: a probabilistic decision-based proof , 2001, Pattern Recognit..

[26]  Majid Ahmadi,et al.  N-feature neural network human face recognition , 2004, Image Vis. Comput..

[27]  Miin-Shen Yang.  Convergence properties of the generalized fuzzy c-means clustering algorithms , 1993 .

[28]  Boudewijn P. F. Lelieveldt,et al.  A new cluster validity index for the fuzzy c-mean , 1998, Pattern Recognit. Lett..

[29]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[30]  Zhi-Qiang Liu,et al.  Fuzzy neural network in case-based diagnostic system , 1997, IEEE Trans. Fuzzy Syst..

[31]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[32]  Ioannis Pitas,et al.  Face localization and facial feature extraction based on shape and color information , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[33]  Stan Z. Li,et al.  Face recognition using the nearest feature line method , 1999, IEEE Trans. Neural Networks.

[34]  Shigeo Abe,et al.  A fuzzy classifier with ellipsoidal regions for diagnosis problems , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[35]  Hong Yan,et al.  Face recognition by fractal transformations , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[36]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[37]  David A. Landgrebe,et al.  Decision boundary feature extraction for neural networks , 1997, IEEE Trans. Neural Networks.

[38]  Gerry White,et al.  The Past , 2000 .

[39]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.