Evolution of an artificial visual cortex for image recognition

Evolutionary robotics has been successful in creating agents that successfully link perception with appropriate action. However, the visual fields utilized by such agents is usually extremely small compared to the retinas linked to the visual cortex of animals. Evolving a cortex that processes larger fields of view in a selective and robust manner is challenging becausefitnesslandscapes thatare sensitive tothis levelof details are difficult to design. Here, we decouple the perception from the action part of evolutionary robotics, and present a new way to evolve logic circuits to perform image recognition on the well-known MNIST data set, which comprises 60,000 training and 10,000 testing handwritten numerals. The logic circuits are encoded in a genome that is evolved using a fitness function based on the true positive and true negative classification rates of the numerals. Following evolution, individual circuits achieve in excess of 80% recognition accuracy on the testing data. By pooling highly evolved individual circuits from multiple evolutionary histories into a committee, testing accuracy is increased to 93.5%. This work demonstrates that evolving logic circuits to solve a classification task is feasible. We also found the evolved circuits to be much smaller in scale compared to other machine learning methods that are conventionally used on such problems. To our knowledge, this represents the first time that relatively small logic circuits have been evolved to reach this level of performance on the automated recognition of handwriting, and promises new approaches to the integration of evolutionary algorithms and intelligent systems.

[1]  Francesco Mondada,et al.  Evolutionary neurocontrollers for autonomous mobile robots , 1998, Neural Networks.

[2]  Arend Hintze,et al.  Integrated Information Increases with Fitness in the Evolution of Animats , 2011, PLoS Comput. Biol..

[3]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[4]  L. Munari How the body shapes the way we think — a new view of intelligence , 2009 .

[5]  Randall D. Beer,et al.  The Dynamics of Active Categorical Perception in an Evolved Model Agent , 2003, Adapt. Behav..

[6]  Dario Floreano,et al.  Active Vision and Receptive Field Development in Evolutionary Robots , 2005, Evolutionary Computation.

[7]  Thomas Serre,et al.  A feedforward architecture accounts for rapid categorization , 2007, Proceedings of the National Academy of Sciences.

[8]  D. Floreano,et al.  Evolution of Adaptive Behaviour in Robots by Means of Darwinian Selection , 2010, PLoS biology.

[9]  Geoffrey E. Hinton,et al.  Learning a Nonlinear Embedding by Preserving Class Neighbourhood Structure , 2007, AISTATS.

[10]  Luca Maria Gambardella,et al.  Deep, Big, Simple Neural Nets for Handwritten Digit Recognition , 2010, Neural Computation.

[11]  Jim Torresen,et al.  Two-Step Incremental Evolution of a Prosthetic Hand Controller Based on Digital Logic Gates , 2001, ICES.

[12]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[13]  Bernhard Schölkopf,et al.  Training Invariant Support Vector Machines , 2002, Machine Learning.

[14]  Arend Hintze,et al.  The Evolution of Representation in Simple Cognitive Networks , 2012, Neural Computation.

[15]  Gregory J. Barlow,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Fitness Functions in Evolutionary Robotics: a Survey and Analysis , 2022 .

[16]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Eric O. Postma,et al.  Reactive Agents and Perceptual Ambiguity , 2005, Adapt. Behav..

[18]  Julian Francis Miller,et al.  Scalability problems of digital circuit evolution evolvability and efficient designs , 2000, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware.

[19]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[20]  Sebastian Thrun,et al.  Autonomous Driving: Context and State-of-the-Art , 2012 .

[21]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[22]  Pattie Maes,et al.  Toward the Evolution of Dynamical Neural Networks for Minimally Cognitive Behavior , 1996 .

[23]  Tatiana Kalganova,et al.  On evolution of relatively large combinational logic circuits , 2005, 2005 NASA/DoD Conference on Evolvable Hardware (EH'05).

[24]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[25]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.