Kernel Fisher Discriminant Analysis Based on a Regularized Method for Multiclassification and Application in Lithological Identification

This study aimed to construct a kernel Fisher discriminant analysis (KFDA) method from well logs for lithology identification purposes. KFDA, via the use of a kernel trick, greatly improves the multiclassification accuracy compared with Fisher discriminant analysis (FDA). The optimal kernel Fisher projection of KFDA can be expressed as a generalized characteristic equation. However, it is difficult to solve the characteristic equation; therefore, a regularized method is used for it. In the absence of a method to determine the value of the regularized parameter, it is often determined based on expert human experience or is specified by tests. In this paper, it is proposed to use an improved KFDA (IKFDA) to obtain the optimal regularized parameter by means of a numerical method. The approach exploits the optimal regularized parameter selection ability of KFDA to obtain improved classification results. The method is simple and not computationally complex. The IKFDA was applied to the Iris data sets for training and testing purposes and subsequently to lithology data sets. The experimental results illustrated that it is possible to successfully separate data that is nonlinearly separable, thereby confirming that the method is effective.

[1]  Qing Zhang,et al.  Efficient Semantic Kernel-Based Text Classification Using Matching Pursuit KFDA , 2011, ICONIP.

[2]  Feng Zhao,et al.  Learning kernel parameters for kernel Fisher discriminant analysis , 2013, Pattern Recognit. Lett..

[3]  Bieng-Zih Hsieh,et al.  Lithology identification of aquifers from geophysical well logs and fuzzy logic analysis: Shui-Lin Area, Taiwan , 2005, Comput. Geosci..

[4]  George P. Petropoulos,et al.  Flooding extent cartography with Landsat TM imagery and regularized kernel Fisher's discriminant analysis , 2013, Comput. Geosci..

[5]  Babak Rezaee,et al.  A cluster validity index for fuzzy clustering , 2010, Fuzzy Sets Syst..

[6]  Jing-Yu Yang,et al.  An efficient renovation on kernel Fisher discriminant analysis and face recognition experiments , 2004, Pattern Recognit..

[7]  Stephen A. Billings,et al.  Nonlinear Fisher discriminant analysis using a minimum squared error cost function and the orthogonal least squares algorithm , 2002, Neural Networks.

[8]  Junhong Li,et al.  Improved kernel fisher discriminant analysis for fault diagnosis , 2009, Expert Syst. Appl..

[9]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[10]  Qi Zhu.  Reformative nonlinear feature extraction using kernel MSE , 2010, Neurocomputing.

[11]  Shehroz S. Khan,et al.  Cluster center initialization algorithm for K-means clustering , 2004, Pattern Recognit. Lett..

[12]  Qin Li,et al.  Fast kernel Fisher discriminant analysis via approximating the kernel principal component analysis , 2011, Neurocomputing.

[13]  Reshma Khemchandani,et al.  Learning the optimal kernel for Fisher discriminant analysis via second order cone programming , 2010, Eur. J. Oper. Res..

[14]  Hyun-Woo Cho.  An orthogonally filtered tree classifier based on nonlinear kernel-based optimal representation of data , 2008, Expert Syst. Appl..

[15]  Dongmei Zhang,et al.  The Application of Improved BP Neural Network Algorithm in Lithology Recognition , 2008, ISICA.

[16]  Nelmarie Louw,et al.  Variable selection in kernel Fisher discriminant analysis by means of recursive feature elimination , 2006, Comput. Stat. Data Anal..

[17]  Murat Dundar,et al.  A fast iterative algorithm for fisher discriminant using heterogeneous kernels , 2004, ICML.

[18]  Z. Volkovich,et al.  A statistical model of cluster stability , 2008, Pattern Recognit..

[19]  Guoqiang Wang,et al.  Face Recognition Using KFDA-LLE , 2011, ICIC.