Evolving neural networks to identify bent-double galaxies in the FIRST survey

The FIRST (Faint Images of the Radio Sky at Twenty-cm) survey is an ambitious project scheduled to cover 10,000 square degrees of the northern and southern galactic caps. Until recently, astronomers associated with FIRST identified radio-emitting galaxies with a bent-double morphology through a visual inspection of images. Besides being subjective, prone to error and tedious, this manual approach is becoming increasingly infeasible: upon completion, FIRST will include almost a million galaxies. This paper describes the application of six methods of evolving neural networks (NNs) with genetic algorithms (GAs) to the identification of bent-double galaxies. The objective is to demonstrate that GAs can successfully address some common problems in the application of NNs to classification problems, such as training the networks, choosing appropriate network topologies, and selecting relevant features. We measured the overall accuracy of the networks using the arithmetic and geometric means of the accuracies on bent and non-bent galaxies. Most of the combinations of GAs and NNs perform equally well on our data, but using GAs to select feature subsets produces the best results, reaching accuracies of 90% using the arithmetic mean and 87% with the geometric mean. The networks found by the GAs were more accurate than hand-designed networks and decision trees.

[1]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[2]  David G. Stork,et al.  Pattern Classification , 1973 .

[3]  L. Darrell Whitley,et al.  Optimizing Neural Networks Using FasterMore Accurate Genetic Search , 1989, ICGA.

[4]  Simon M. Lucas,et al.  A comparison of matrix rewriting versus direct encoding for evolving neural networks , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[5]  Hiroaki Kitano,et al.  Empirical Studies on the Speed of Convergence of Neural Network Training Using Genetic Algorithms , 1990, AAAI.

[6]  Paulo Cortez,et al.  Evolutionary Design of Neural Networks for Classification and Regression , 2005 .

[7]  Richard L. White,et al.  A Catalog of 1.4 GHz Radio Sources from the FIRST Survey , 1997 .

[8]  Stefano Nolfi,et al.  Learning and Evolution , 1999, Auton. Robots.

[9]  A. Skinner,et al.  Neural networks in computational materials science: training algorithms , 1995 .

[10]  Richard K. Belew,et al.  Evolving networks: using the genetic algorithm with connectionist learning , 1990 .

[11]  A. Adams,et al.  Hubble classification of galaxies using neural networks , 1994 .

[12]  S. Odewahn,et al.  Star-galaxy separation using neural networks , 1994 .

[13]  R. G. McMahon,et al.  An Efficient Search for Gravitationally Lensed Radio Lobes , 2000, astro-ph/0007458.

[14]  N. S. Barnett,et al.  Private communication , 1969 .

[15]  Nicholas J. Radcliffe,et al.  Genetic neural networks on MIMD computers , 1992 .

[16]  U. Aickelin,et al.  The Application of Bayesian Optimization and Classifier Systems in Nurse Scheduling , 2004, PPSN.

[17]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[18]  Dung Kai-cheung,et al.  The Catalog , 2001, Thresholds.

[19]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[20]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[21]  Vanderlaan,et al.  EVOLUTIONARY PROGRAMMING IV , 1995 .

[22]  Jeffrey L. Elman,et al.  Learning and Evolution in Neural Networks , 1994, Adapt. Behav..

[23]  Robert G. Reynolds,et al.  Dynamic Feature Set Training of Neural Nets for Classification , 1995 .

[24]  O. Lahav,et al.  Morphological Classification of galaxies by Artificial Neural Networks , 1992 .

[25]  Robert F. Harrison,et al.  Optimization and training of feedforward neural networks by genetic algorithms , 1991 .

[26]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[27]  Johan A. K. Suykens,et al.  Genetic Weight Optimization of a Feedforward Neural Network Controller , 1993 .

[28]  Schloss Birlinghoven,et al.  How Genetic Algorithms Really Work I.mutation and Hillclimbing , 2022 .

[29]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[30]  L. Darrell Whitley,et al.  Genetic algorithms and neural networks: optimizing connections and connectivity , 1990, Parallel Comput..

[31]  Heinz Mühlenbein,et al.  How Genetic Algorithms Really Work: Mutation and Hillclimbing , 1992, PPSN.

[32]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[33]  D. Fogel.  Evolutionary algorithms in theory and practice , 1997, Complex..

[34]  Frédéric Gruau,et al.  Genetic synthesis of Boolean neural networks with a cell rewriting developmental process , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[35]  Worthy N. Martin,et al.  Genetic Algorithms for Feature Selection for Counterpropagation Networks , 1990 .

[36]  Kendall E. Nygard,et al.  Improving the Performance of Genetic Algorithms in Automated Discovery of Parameters , 1990, ML.

[37]  Stan Matwin,et al.  Addressing the Curse of Imbalanced Training Sets: One-Sided Selection , 1997, ICML.

[38]  Peter J. B. Hancock,et al.  Recombination Operators for the Design of Neural Nets by Genetic Algorithm , 1992, Parallel Problem Solving from Nature.

[39]  Thomas P. Caudell,et al.  Parametric Connectivity: Training of Constrained Networks using Genetic Algorithms , 1989, ICGA.

[40]  Richard L. White,et al.  The FIRST Survey: Faint Images of the Radio Sky at twenty centimeters , 1995 .

[41]  C. Kamath,et al.  Finding Bent-double Radio Galaxies: A Case Study in Data Mining , 2000 .

[42]  S. Odewahn,et al.  Automated star/galaxy discrimination with neural networks , 1992 .

[43]  Jacek M. Zurada,et al.  Computational Intelligence: Imitating Life , 1994 .

[44]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[45]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .