An Embodied Approach for Evolving Robust Visual Classifiers

Despite recent demonstrations that deep learning methods can successfully recognize and categorize objects using high dimensional visual input, other recent work has shown that these methods can fail when presented with novel input. However, a robot that is free to interact with objects should be able to reduce spurious differences between objects belonging to the same class through motion and thus reduce the likelihood of overfitting. Here we demonstrate a robot that achieves more robust categorization when it evolves to use proprioceptive sensors and is then trained to rely increasingly on vision, compared to a similar robot that is trained to categorize only with visual sensors. This work thus suggests that embodied methods may help scaffold the eventual achievement of robust visual classification.

[1]  Randall D. Beer,et al.  The Dynamics of Active Categorical Perception in an Evolved Model Agent , 2003, Adapt. Behav..

[2]  S. Harnad To Cognize is to Categorize: Cognition is Categorization , 2005 .

[3]  R. Fumerton,et al.  THE INTERNALISM/EXTERNALISM CONTROVERSY* , 1988 .

[4]  Gregory S. Hornby,et al.  Automated Antenna Design with Evolutionary Algorithms , 2006 .

[5]  Stevan Harnad,et al.  Symbol grounding problem , 1990, Scholarpedia.

[6]  Randall D. Beer,et al.  Further Experiments in the Evolution of Minimally Cognitive Behavior: From Perceiving Affordances to Selective Attention , 2000 .

[7]  Gregory J. Barlow,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Fitness Functions in Evolutionary Robotics: a Survey and Analysis , 2022 .

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[10]  A. Glenberg,et al.  Symbols and Embodiment: Debates on Meaning and Cognition , 2008 .

[11]  Peter Jackson,et al.  Introduction to expert systems , 1986 .

[12]  Ursula Hess,et al.  Handbook of Categorization in Cognitive Science , 2017 .

[13]  Stefano Nolfi,et al.  Active Categorical Perception of Object Shapes in a Simulated Anthropomorphic Robotic Arm , 2010, IEEE Transactions on Evolutionary Computation.

[14]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[15]  Hod Lipson,et al.  Evolutionary Robotics for Legged Machines: From Simulation to Physical Reality , 2006, IAS.

[16]  J. Plumert,et al.  Parental Scaffolding of Young Children's Spatial Communication , 1996 .

[17]  Giorgio Metta,et al.  Grounding vision through experimental manipulation , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[18]  E. Thompson,et al.  Mind in life : biology, phenomenology, and the sciences of mind , 2007 .

[19]  Masaki Ogino,et al.  Cognitive Developmental Robotics: A Survey , 2009, IEEE Transactions on Autonomous Mental Development.

[20]  Stéphane Doncieux,et al.  Crossing the reality gap in evolutionary robotics by promoting transferable controllers , 2010, GECCO '10.

[21]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[22]  Stanley Coren,et al.  Sensation and perception , 1979 .

[23]  Gillian M. Hayes,et al.  Robot Shaping --- Principles, Methods and Architectures , 1996 .

[24]  A. Clark,et al.  Artificial Intelligence: The Very Idea. , 1988 .

[25]  E. Rosch,et al.  The Embodied Mind: Cognitive Science and Human Experience , 1993 .

[26]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[27]  三嶋 博之 The theory of affordances , 2008 .

[28]  Max Weisbuch,et al.  Tough and tender: embodied categorization of gender. , 2010, Psychological science.

[29]  Juhan Nam,et al.  Multimodal Deep Learning , 2011, ICML.

[30]  E. A. Hendriks,et al.  Converting 2D to 3D: A Survey , 2005 .

[31]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[32]  Rolf Pfeifer,et al.  Classification as Sensory-Motor Coordination: A Case Study on Autonomous Agents , 1995, ECAL.

[33]  Marco Colombetti,et al.  Robot Shaping: Developing Autonomous Agents Through Learning , 1994, Artif. Intell..

[34]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[35]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  John Haugeland,et al.  Artificial intelligence - the very idea , 1987 .

[37]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[38]  Marshall M. Haith Preparing for the 21st Century: Some Goals and Challenges for Studies of Infant Sensory and Perceptual Development , 1993 .

[39]  David S. Touretzky,et al.  Shaping robot behavior using principles from instrumental conditioning , 1997, Robotics Auton. Syst..

[40]  Tracy Brown,et al.  The Embodied Mind: Cognitive Science and Human Experience , 2002, Cybern. Hum. Knowing.

[41]  Henri Cohen,et al.  Handbook of categorization in cognitive science , 2005 .

[42]  Geoffrey E. Hinton Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[43]  Stéphane Doncieux,et al.  The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics , 2013, IEEE Transactions on Evolutionary Computation.

[44]  M. Lungarella,et al.  Information Self-Structuring: Key Principle for Learning and Development , 2005, Proceedings. The 4nd International Conference on Development and Learning, 2005..

[45]  G. Lakoff,et al.  Where mathematics comes from : how the embodied mind brings mathematics into being , 2002 .

[46]  Phil Husbands,et al.  Evolution of central pattern generators for bipedal walking in a real-time physics environment , 2002, IEEE Trans. Evol. Comput..

[47]  Phil Husbands,et al.  Evolutionary robotics , 2014, Evolutionary Intelligence.

[48]  Joan Bruna,et al.  Intriguing properties of neural networks , 2013, ICLR.

[49]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[50]  Stefano Nolfi,et al.  Evolutionary robotics , 1998, Lecture Notes in Computer Science.

[51]  Josh Bongard,et al.  Morphological change in machines accelerates the evolution of robust behavior , 2011, Proceedings of the National Academy of Sciences.

[52]  D. Krathwohl A Revision of Bloom's Taxonomy: An Overview , 2002 .

[53]  Giulio Sandini,et al.  Learning about objects through action - initial steps towards artificial cognition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[54]  Andrea Roli,et al.  Bongard - Evolutionary robotics , 2013 .

[55]  Josh C. Bongard,et al.  The Utility of Evolving Simulated Robot Morphology Increases with Task Complexity for Object Manipulation , 2010, Artificial Life.

[56]  Thomas W. Schubert,et al.  Weight as an Embodiment of Importance , 2009, Psychological science.

[57]  L. Steels The symbol grounding problem has been solved, so what’s next? , 2008 .

[58]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[59]  M. E. McCarty,et al.  How infants use vision for grasping objects. , 2001, Child development.

[60]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[61]  Rolf A. Zwaan,et al.  Embodied Language: A Review of the Role of the Motor System in Language Comprehension , 2008, Quarterly journal of experimental psychology.

[62]  Josh C. Bongard Morphological and environmental scaffolding synergize when evolving robot controllers: artificial life/robotics/evolvable hardware , 2011, GECCO '11.

[63]  Susan Goldin-Meadow,et al.  Children Learn When Their Teacher's Gestures and Speech Differ , 2005, Psychological science.

[64]  E. Rosch Cognitive Representations of Semantic Categories. , 1975 .

[65]  C. Hofsten,et al.  Preparation for grasping an object: a developmental study. , 1988, Journal of experimental psychology. Human perception and performance.

[66]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[67]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[68]  W. T. Maddox,et al.  Relations between prototype, exemplar, and decision bound models of categorization , 1993 .