The integrated strategy of pattern classification and its application in chemistry

In this paper, the advantages and disadvantages of multivariate discriminant analysis and feed-forward neural networks as classifiers are discussed, and then the strategy integrating the classification methods of two different kinds is proposed. The integrated strategy can be described as follows: use the transform which derives from neural networks to convert the primary matrix which is compose of specimens into a new matrix, and then extract useful components from the converted matrix applying a statistical method, and lastly process the extracted components to establish a discriminant model. Two classifiers, RBF.T-CCA-Fisher and WS.T-CCA-Bayes, which are based on this integrated strategy, are designed to apply respectively to two classification problems: the grade of nature spearmint essence (NSE) and the classification of toxicity of amines. The results show that the new classifiers have the better classification correctness and wider applicability than any statistical method or neural network does.

[1]  T. W. Anderson,et al.  An Introduction to Multivariate Statistical Analysis , 1959 .

[2]  D. Massart,et al.  The Radial Basis Functions — Partial Least Squares approach as a flexible non-linear regression technique , 1996 .

[3]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[4]  Zhi-Quan Luo,et al.  On the Convergence of the LMS Algorithm with Adaptive Learning Rate for Linear Feedforward Networks , 1991, Neural Computation.

[5]  Richard Lippmann,et al.  Neural Network Classifiers Estimate Bayesian a posteriori Probabilities , 1991, Neural Computation.

[6]  Sung-Bae Cho,et al.  Neural-network classifiers for recognizing totally unconstrained handwritten numerals , 1997, IEEE Trans. Neural Networks.

[7]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[8]  Mike James,et al.  Classification Algorithms , 1986, Encyclopedia of Machine Learning and Data Mining.

[9]  Correlative components analysis for pattern classification , 1996 .

[10]  Dezhao Chen,et al.  A Pattern Classification Procedure Integrating the Multivariate Statistical Analysis with Neural Networks , 1997, Comput. Chem..

[11]  Dezhao Chen,et al.  Potential Function Based Neural Networks and Its Application to the Classification of Complex Chemical Patterns , 1998, Comput. Chem..

[12]  Mohamad T. Musavi,et al.  On the training of radial basis function classifiers , 1992, Neural Networks.

[13]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[14]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[15]  Xuefeng Yan,et al.  SOM Integrated with CCA for the Feature Map and Classification of Complex Chemical Patterns , 2001, Comput. Chem..