Feature Learning HyperNEAT: Evolving Neural Networks to Extract Features for Classification of Maritime Satellite Imagery

Imagery analysis represents a significant aspect of maritime domain awareness; however, the amount of imagery is exceeding human capability to process. Unfortunately, the maritime domain presents unique challenges for machine learning to automate such analysis. Indeed, when object recognition algorithms observe real-world data, they face hurdles not present in experimental situations. Imagery from such domains suffers from degradation, have limited examples, and vary greatly in format. These limitations are present satellite imagery because of the associated constraints in expense and capability. To this end, the Hypercube-based NeuroEvolution of Augmenting Topologies approach is investigated in addressing some such challenges for classifying maritime vessels from satellite imagery. Results show that HyperNEAT learns features from such imagery that allows better classification than Principal Component Analysis (PCA). Furthermore, HyperNEAT enables a unique capability to scale image sizes through the indirect encoding.

[1]  Josh Harguess,et al.  Deep learning through generative and developmental system , 2014, GECCO.

[2]  Kenneth O. Stanley,et al.  Generative encoding for multiagent learning , 2008, GECCO '08.

[3]  Kenneth O. Stanley,et al.  Autonomous Evolution of Topographic Regularities in Artificial Neural Networks , 2010, Neural Computation.

[4]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[5]  Josh Harguess,et al.  Vessel classification in overhead satellite imagery using learned dictionaries , 2012, Other Conferences.

[6]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[7]  Kenneth O. Stanley,et al.  Generating large-scale neural networks through discovering geometric regularities , 2007, GECCO '07.

[8]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Josh Harguess,et al.  Are face recognition methods useful for classifying ships? , 2011, 2011 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[11]  Katie Rainey,et al.  Object recognition in ocean imagery using feature selection and compressive sensing , 2011, 2011 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[12]  Shimon Whiteson.  Improving reinforcement learning function approximators via neuroevolution , 2005, AAMAS '05.

[13]  Niko Sünderhauf,et al.  Evaluation of Features for Leaf Classification in Challenging Conditions , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[14]  Risto Miikkulainen,et al.  Competitive Coevolution through Evolutionary Complexification , 2011, J. Artif. Intell. Res..

[15]  John Stastny,et al.  Enhanced ship detection from overhead imagery , 2008, SPIE Defense + Commercial Sensing.

[16]  A. Turing.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[17]  Risto Miikkulainen,et al.  HyperNEAT-GGP: a hyperNEAT-based atari general game player , 2012, GECCO '12.

[18]  Daniele Loiacono,et al.  On-line neuroevolution applied to The Open Racing Car Simulator , 2009, 2009 IEEE Congress on Evolutionary Computation.

[19]  Risto Miikkulainen,et al.  Real-time neuroevolution in the NERO video game , 2005, IEEE Transactions on Evolutionary Computation.

[20]  Kenneth O. Stanley,et al.  Evolving Static Representations for Task Transfer , 2010, J. Mach. Learn. Res..

[21]  Shimon Whiteson,et al.  Comparing evolutionary and temporal difference methods in a reinforcement learning domain , 2006, GECCO.

[22]  Kenneth O. Stanley,et al.  A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks , 2009, Artificial Life.

[23]  Joel Lehman,et al.  Evolving policy geometry for scalable multiagent learning , 2010, AAMAS.

[24]  Kenneth O. Stanley,et al.  A Case Study on the Critical Role of Geometric Regularity in Machine Learning , 2008, AAAI.

[25]  Josh Harguess,et al.  Maritime vessel recognition in degraded satellite imagery , 2014, Defense + Security Symposium.

[26]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[27]  Risto Miikkulainen,et al.  A Taxonomy for Artificial Embryogeny , 2003, Artificial Life.

[28]  Kenneth O. Stanley,et al.  Constraining connectivity to encourage modularity in HyperNEAT , 2011, GECCO '11.

[29]  Shimon Whiteson,et al.  Stochastic Optimization for Collision Selection in High Energy Physics , 2006, AAAI.

[30]  Josh Harguess,et al.  Image Classification Using Generative Neuro Evolution for Deep Learning , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[31]  Kenneth O. Stanley,et al.  Unsupervised Feature Learning through Divergent Discriminative Feature Accumulation , 2014, AAAI.

[32]  V. Ramakrishnan,et al.  Measurement of the top-quark mass with dilepton events selected using neuroevolution at CDF. , 2008, Physical review letters.