A hybrid neural network/genetic algorithm approach to optimizing feature extraction for signal classification

In this paper, a hybrid neural network/genetic algorithm technique is presented, aiming at designing a feature extractor that leads to highly separable classes in the feature space. The application upon which the system is built, is the identification of the state of human peripheral vascular tissue (i.e., normal, fibrous and calcified). The system is further tested on the classification of spectra measured from the cell nuclei in blood samples in order to distinguish normal cells from those affected by Acute Lymphoblastic Leukemia. As advantages of the proposed technique we may encounter the algorithmic nature of the design procedure, the optimized classification results and the fact that the system performance is less dependent on the classifier type to be used.

[1]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[2]  Franco P. Preparata,et al.  Sequencing-by-hybridization revisited: the analog-spectrum proposal , 2004, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[3]  C. Balas,et al.  A novel optical imaging method for the early detection, quantitative grading, and mapping of cancerous and precancerous lesions of cervix , 2001, IEEE Transactions on Biomedical Engineering.

[4]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[5]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[6]  Bruce A. Whitehead,et al.  Evolving space-filling curves to distribute radial basis functions over an input space , 1994, IEEE Trans. Neural Networks.

[7]  Madan M. Gupta,et al.  Neuro-Control Systems: Theory and Applications , 1993 .

[8]  H. Ishigami,et al.  Structure optimization of fuzzy neural network by genetic algorithm , 1995 .

[9]  Donald E. Waagen,et al.  Evolving recurrent perceptrons for time-series modeling , 1994, IEEE Trans. Neural Networks.

[10]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[11]  George A. Rovithakis,et al.  Tracking control of multi-input affine nonlinear dynamical systems with unknown nonlinearities using dynamical neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Joydeep Ghosh,et al.  Efficient Higher-Order Neural Networks for Classification and Function Approximation , 1992, Int. J. Neural Syst..

[13]  George A. Rovithakis.  Robust neural adaptive stabilization of unknown systems with measurement noise , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[14]  George Filippidis,et al.  Artificial neural networks for discriminating pathologic from normal peripheral vascular tissue , 2001, IEEE Trans. Biomed. Eng..

[15]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[16]  Peter J. Angeline,et al.  An evolutionary algorithm that constructs recurrent neural networks , 1994, IEEE Trans. Neural Networks.

[17]  Alex A. Freitas,et al.  A survey of evolutionary algorithms for data mining and knowledge discovery , 2003 .

[18]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[19]  Michael Ian Shamos,et al.  Computational geometry: an introduction , 1985 .

[20]  Manolis A. Christodoulou,et al.  Adaptive Control with Recurrent High-order Neural Networks , 2000, Advances in Industrial Control.

[21]  Francesco Mondada,et al.  Evolution of homing navigation in a real mobile robot , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[22]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[23]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[24]  K. De Jong.  Learning with Genetic Algorithms: An Overview , 1988 .

[25]  George A. Rovithakis,et al.  Performance of a neural adaptive tracking controller for multi-input nonlinear dynamical systems in the presence of additive and multiplicative external disturbances , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[26]  D.A. Handelman,et al.  Theory and development of higher-order CMAC neural networks , 1992, IEEE Control Systems.

[27]  Neil E. Cotter,et al.  The Stone-Weierstrass theorem and its application to neural networks , 1990, IEEE Trans. Neural Networks.

[28]  Vittorio Maniezzo,et al.  Genetic evolution of the topology and weight distribution of neural networks , 1994, IEEE Trans. Neural Networks.

[29]  Xin Yao,et al.  A review of evolutionary artificial neural networks , 1993, Int. J. Intell. Syst..