Nonlinear feature extraction using a neuro genetic hybrid

Feature extraction is a process that extracts salient features from observed variables. It is considered a promising alternative to overcome the problems of weight and structure optimization in artificial neural networks. There were many nonlinear feature extraction methods using neural networks but they still have the same difficulties arisen from the fixed network topology. In this paper, we propose a novel combination of genetic algorithm and feedforward neural networks for nonlinear feature extraction. The genetic algorithm evolves the feature space by utilizing characteristics of hidden neurons. It improved remarkably the performance of neural networks on a number of real world regression and classification problems.

[1]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[2]  G. Lewicki,et al.  Approximation by Superpositions of a Sigmoidal Function , 2003 .

[3]  Gérard Dreyfus,et al.  Handwritten digit recognition by neural networks with single-layer training , 1992, IEEE Trans. Neural Networks.

[4]  Kurt Hornik,et al.  Neural networks and principal component analysis: Learning from examples without local minima , 1989, Neural Networks.

[5]  T. Sejnowski,et al.  Predicting the secondary structure of globular proteins using neural network models. , 1988, Journal of molecular biology.

[6]  Byung Ro Moon,et al.  A Genetic Hybrid For Critical Heat Flux Function Approximation , 2002, GECCO.

[7]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[8]  Garrison W. Greenwood Training partially recurrent neural networks using evolutionary strategies , 1997, IEEE Trans. Speech Audio Process..

[9]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[10]  David B. Fogel,et al.  Alternative Neural Network Training Methods , 1995, IEEE Expert.

[11]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[12]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[13]  Anil K. Jain,et al.  A nonlinear projection method based on Kohonen's topology preserving maps , 1992, IEEE Trans. Neural Networks.

[14]  Jerome H. Friedman Multivariate adaptive regression splines (with discussion) , 1991 .

[15]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[16]  Tariq Samad,et al.  Designing Application-Specific Neural Networks Using the Genetic Algorithm , 1989, NIPS.

[17]  Oded Maimon,et al.  A Distributed Genetic Algorithm for Neural Network Design and Training , 1992, Complex Syst..

[18]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[19]  Johan A. K. Suykens,et al.  Genetic Weight Optimization of a Feedforward Neural Network Controller , 1993 .

[20]  Anil K. Jain,et al.  Discriminant analysis neural networks , 1993, IEEE International Conference on Neural Networks.

[21]  H. Burke,et al.  Artificial neural networks for cancer research: outcome prediction. , 1994, Seminars in surgical oncology.

[22]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[23]  Richard J. Enbody,et al.  Further Research on Feature Selection and Classification Using Genetic Algorithms , 1993, ICGA.

[24]  Tariq Samad,et al.  Towards the Genetic Synthesisof Neural Networks , 1989, ICGA.

[25]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[26]  Dean A. Pomerleau,et al.  What's hidden in the hidden layers? , 1989 .

[27]  Stewart W. Wilson Perceptron redux: emergence of structure , 1990 .

[28]  Byung Ro Moon,et al.  Neuron Reordering For Better Neuro-genetic Hybrids , 2002, GECCO.

[29]  J. Urgen Branke Evolutionary Algorithms for Neural Network Design and Training , 1995 .

[30]  David Lowe,et al.  The optimised internal representation of multilayer classifier networks performs nonlinear discriminant analysis , 1990, Neural Networks.

[31]  Anil K. Jain,et al.  Artificial neural networks for feature extraction and multivariate data projection , 1995, IEEE Trans. Neural Networks.

[32]  Martin Brown,et al.  Neurofuzzy adaptive modelling and control , 1994 .

[33]  D. Rubinfeld,et al.  Hedonic housing prices and the demand for clean air , 1978 .

[34]  Pamela K. Coats,et al.  A neural network for classifying the financial health of a firm , 1995 .

[35]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[36]  Hervé Bourlard,et al.  Continuous speech recognition by connectionist statistical methods , 1993, IEEE Trans. Neural Networks.

[37]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognit. Lett..

[38]  Abraham Kandel,et al.  Efficient Genetic Algorithms for Training Layered Feedback Neural Networks , 1994, Inf. Sci..

[39]  Byung Ro Moon,et al.  Daily Stock Prediction Using Neuro-genetic Hybrids , 2003, GECCO.