Embodied Cognitive Robotics and the learning of sensorimotor schemes

Embodied Cognitive Robotics focuses its attention on the design of artificial agents capable of performing cognitive tasks autonomously. A central issue in this consists in studying process by which agents learn through interaction with their environment. Embodied Cognitive Robotics aims to implement models of cognitive processes coming from Cognitive Sciences. The guidelines in this research area are a direct response to the shortcomings of Classical Artificial Intelligence, where high-level tasks and behaviors were studied. This article describes the work carried out in the Cognitive Robotics Laboratory at the Universidad Autónoma del Estado de Morelos (UAEM). Our work is based on the concept of low-level sensorimotor schemes coded by Internal Models, thus falling as a matter of course within the tenets of Embodied Cognition, particularly with the idea that cognition must be understood as occurring in agents that have a body with which they interact in a specific environment. It is through this interaction that learning emerges laying the ground for cognitive processes. Our research includes theoretical work laying the foundations of Embodied Cognitive Robotics, as well as work with artificial and with natural agents.

[1]  Michael A. Arbib,et al.  Mirror neurons and imitation: A computationally guided review , 2006, Neural Networks.

[2]  D. Wegner,et al.  Apparent mental causation. Sources of the experience of will. , 1999, The American psychologist.

[3]  Andy Clark,et al.  Towards a Cognitive Robotics , 1999, Adapt. Behav..

[4]  C. Hofsten.  On the development of perception and action. , 2003 .

[5]  J. Kiverstein,et al.  Consciousness in interaction: the role of the natural and social context in shaping consciousness , 2012 .

[6]  Jorge Hermosillo Valadez,et al.  Intentionality and Internal Models in artificial agents , 2016 .

[7]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[8]  A. Clark.  An embodied cognitive science? , 1999, Trends in Cognitive Sciences.

[9]  E. D. Di Paolo.  Extended Life , 2008 .

[10]  S. Blakemore,et al.  The perception of self-produced sensory stimuli in patients with auditory hallucinations and passivity experiences: evidence for a breakdown in self-monitoring , 2000, Psychological Medicine.

[11]  Lawrence A. Shapiro.  The Mind Incarnate , 2004 .

[12]  Karl J. Friston,et al.  Predictions not commands: active inference in the motor system , 2012, Brain Structure and Function.

[13]  John McCarthy,et al.  A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955 , 2006, AI Mag..

[14]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[15]  D. Wolpert,et al.  Explaining the symptoms of schizophrenia: Abnormalities in the awareness of action , 2000, Brain Research Reviews.

[16]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[17]  Bruno Lara,et al.  How do I sound like? forward models for robot ego-noise prediction , 2016, 2016 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[18]  Jun-ichi Imura,et al.  A hybrid framework for ego noise cancellation of a robot , 2010, 2010 IEEE International Conference on Robotics and Automation.

[19]  Bruno Lara,et al.  Coupled inverse-forward models for action execution leading to tool-use in a humanoid robot , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[20]  BlakemoreSarah-J.,et al.  Spatio-Temporal Prediction Modulates the Perception of Self-Produced Stimuli , 1999 .

[21]  Y. Demiris,et al.  From motor babbling to hierarchical learning by imitation: a robot developmental pathway , 2005 .

[22]  M. Giese,et al.  Nonvisual Motor Training Influences Biological Motion Perception , 2006, Current Biology.

[23]  Zoubin Ghahramani,et al.  Perspectives and problems in motor learning , 2001, Trends in Cognitive Sciences.

[24]  C. Heyes.  Where do mirror neurons come from? , 2010, Neuroscience & Biobehavioral Reviews.

[25]  Walter Kellermann,et al.  Ego-noise reduction using a motor data-guided multichannel dictionary , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[26]  G. Knoblich,et al.  Predicting the Effects of Actions: Interactions of Perception and Action , 2001, Psychological science.

[27]  L. Munari.  How the body shapes the way we think — a new view of intelligence , 2009 .

[28]  Herbert A. Simon,et al.  Computer Science as Empirical Inquiry , 2011 .

[29]  R. Pfeifer,et al.  Self-Organization, Embodiment, and Biologically Inspired Robotics , 2007, Science.

[30]  Francesca Happé.  Handbook of Child Psychology. Fifth Edition. Vol. Two: Cognition, Perception and Language. Editor in Chief: W. Damon; Volume Editors: D. Kuhn and R. S. Siegler. John Wiley & Sons, Chichester, U.K., 1998. pp. 1030. £125.00 (pb) for all four volumes. , 2001 .

[31]  Richard Menary.  Introduction to the special issue on 4E cognition , 2010 .

[32]  D. Wolpert,et al.  Spatio-Temporal Prediction Modulates the Perception of Self-Produced Stimuli , 1999, Journal of Cognitive Neuroscience.

[33]  Claes von Hofsten,et al.  Action in development. , 2007 .

[34]  Kai-Uwe Kühnberger,et al.  A Unifying Approach to High- and Low-Level Cognition , 2013 .

[35]  M. Stapleton,et al.  Es are good , 2012 .

[36]  Larry Shapiro.  The Embodied Cognition Research Programme , 2007 .

[37]  Bruno Lara,et al.  Exploration Behaviors, Body Representations, and Simulation Processes for the Development of Cognition in Artificial Agents , 2016, Front. Robot. AI.

[38]  A. Clark,et al.  Introduction: Mind Embodied, Embedded, Enacted: One Church or Many? , 2009 .

[39]  Francesco Lacquaniti,et al.  Development of human locomotion , 2012, Current Opinion in Neurobiology.

[40]  Amir Karniel,et al.  Three creatures named 'forward model' , 2002, Neural Networks.

[41]  P. Haggard,et al.  Sense of agency , 2012, Current Biology.

[42]  Bruno Lara,et al.  Cognitive Robotics: The New Challenges in Artificial Intelligence , 2018 .

[43]  G. Knoblich,et al.  The case for motor involvement in perceiving conspecifics. , 2005, Psychological bulletin.

[44]  John Mingers,et al.  Embodying information systems: the contribution of phenomenology , 2001, Inf. Organ..

[45]  B. Lara,et al.  Self Body Mapping in Mobile Robots Using Vision and Forward Models , 2012, 2012 IEEE Ninth Electronics, Robotics and Automotive Mechanics Conference.

[46]  Bruno Lara,et al.  Modelado de un Sistema de Neuronas Espejo en un Agente Autónomo Artificial , 2014 .

[47]  Martina Zambelli,et al.  Online Ensemble Learning of Sensorimotor Contingencies , 2015 .

[48]  Bruno Lara,et al.  Is that me? Sensorimotor learning and self-other distinction in robotics , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[49]  Alva Noë,et al.  Action in Perception , 2006, Representation and Mind.

[50]  Randall D. Beer,et al.  The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment , 1997, Trends in Neurosciences.

[51]  Angelo Cangelosi,et al.  The Mechanics of Embodiment: A Dialog on Embodiment and Computational Modeling , 2011, Front. Psychology.

[52]  Scott T. Grafton,et al.  Forward modeling allows feedback control for fast reaching movements , 2000, Trends in Cognitive Sciences.

[53]  C. Von Hofsten.  Action, the foundation for cognitive development. , 2009, Scandinavian journal of psychology.

[54]  L. Barsalou.  Grounded cognition. , 2008, Annual review of psychology.

[55]  Allen Newell,et al.  Computer science as empirical inquiry: symbols and search , 1976, CACM.

[56]  Nikunj C. Oza,et al.  Online Ensemble Learning , 2000, AAAI/IAAI.

[57]  R. Miall,et al.  Connecting mirror neurons and forward models. , 2003, Neuroreport.

[58]  D. Wolpert,et al.  Is the cerebellum a smith predictor? , 1993, Journal of motor behavior.

[59]  M. Hadders‐Algra,et al.  Fetal Onset of General Movements , 2008, Pediatric Research.

[60]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[61]  R. Chris Miall,et al.  State Estimation in the Cerebellum , 2008, The Cerebellum.

[62]  B. Webb.  Neural mechanisms for prediction: do insects have forward models? , 2004, Trends in Neurosciences.

[63]  Manos Tsakiris,et al.  The Experience of Agency , 2009 .

[64]  Bruno Lara,et al.  Internal Simulations for Behaviour Selection and Recognition , 2012, HBU.

[65]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[66]  Hubert L. Dreyfus.  Why Computers Must Have Bodies In Order to Be Intelligent , 1967 .

[67]  D. Wolpert,et al.  Why can't you tickle yourself? , 2000, Neuroreport.

[68]  G. Lakoff,et al.  Philosophy in the flesh : the embodied mind and its challenge to Western thought , 1999 .

[69]  Andy Clark,et al.  Culture, embodiment and genes: unravelling the triple helix , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[70]  Sabine U. König,et al.  Embodied cognition , 2018, 2018 6th International Conference on Brain-Computer Interface (BCI).

[71]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[72]  P. Haggard,et al.  Agency in the sensorimotor system and its relation to explicit action awareness , 2014, Neuropsychologia.

[73]  Michael L. Anderson.  Embodied Cognition: A field guide , 2003, Artif. Intell..

[74]  A. Clark.  Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[75]  Wolfram Schenck,et al.  Bootstrapping Cognition from Behavior - A Computerized Thought Experiment , 2008, Cogn. Sci..

[76]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[77]  B. Lara,et al.  Distance Perception in Mobile Robots as an Emergent Consequence of Visuo-Motor Cycles Using Forward Models , 2012, 2012 IEEE Ninth Electronics, Robotics and Automotive Mechanics Conference.

[78]  Theo Moons,et al.  A Guided Tour Through Multiview Relations , 1998, SMILE.

[79]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[80]  Bruno Lara-Guzmán,et al.  A Self-Organized Internal Models Architecture for Coding Sensory–Motor Schemes , 2016, Front. Robot. AI.

[81]  Itzhak Benenson.  Imitation in Animals and Artifacts by Kerstin Dautenhahn and Chrystopher L. Nehaniv (eds.) , 2004, J. Artif. Soc. Soc. Simul..

[82]  Marina Basu.  The Embodied Mind: Cognitive Science and Human Experience , 2004 .

[83]  S. Schütz-Bosbach,et al.  On agency and body-ownership: Phenomenological and neurocognitive reflections , 2007, Consciousness and Cognition.

[84]  T. Gelder,et al.  It's about time: an overview of the dynamical approach to cognition , 1996 .

[85]  Kole Harvey.  An Open-Ended Approach to Piagetian Development of Adaptive Behavior , 2018 .

[86]  Heiko Homann,et al.  Perception through Visuomotor Anticipation in a Mobile Robot , 2006 .

[87]  A. Clark,et al.  Getting ahead: forward models and their place in cognitive architecture , 2014, Trends in Cognitive Sciences.

[88]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[89]  Bruno Lara,et al.  Meaning in Artificial Agents: The Symbol Grounding Problem Revisited , 2011, Minds and Machines.

[90]  Cameron Buckner,et al.  What is cognition? angsty monism, permissive pluralism(s), and the future of cognitive science , 2017, Synthese.

[91]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[92]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[93]  Robert A. Wilson,et al.  The Cambridge Handbook of Situated Cognition: How to Situate Cognition , 2008 .

[94]  Masaki Ogino,et al.  Cognitive Developmental Robotics: A Survey , 2009, IEEE Transactions on Autonomous Mental Development.

[95]  D. Wolpert,et al.  Maintaining internal representations: the role of the human superior parietal lobe , 1998, Nature Neuroscience.

[96]  Angelo Cangelosi,et al.  Epigenetic Robotics Architecture (ERA) , 2010, IEEE Transactions on Autonomous Mental Development.

[97]  Slawomir J. Nasuto,et al.  Anticipation: Beyond synthetic biology and cognitive robotics , 2016, Biosyst..

[98]  Francisco J. Varela,et al.  The Embodied Mind , 2018 .

[99]  Alexander Maye,et al.  Using Sensorimotor Contingencies for Prediction and Action Planning , 2012, SAB.

[100]  Albert Newen,et al.  What are cognitive processes? An example-based approach , 2015, Synthese.

[101]  A. Clark.  Embodied Prediction , 2015 .

[102]  Andreas Elpidorou,et al.  The New Science of the Mind: From Extended Mind to Embodied Phenomenology , 2012 .

[103]  Jun-ichi Imura,et al.  Ego noise suppression of a robot using template subtraction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[104]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[105]  T. Nagel.  Mortal Questions: What is it like to be a bat? , 2012 .

[106]  P. Haggard,et al.  Voluntary action and conscious awareness , 2002, Nature Neuroscience.

[107]  Yann Boniface,et al.  Dynamic self-organising map , 2011, Neurocomputing.

[108]  A. Clark.  Surfing Uncertainty: Prediction, Action, and the Embodied Mind , 2015 .

[109]  Karl J. Friston,et al.  Action and behavior: a free-energy formulation , 2010, Biological Cybernetics.

[110]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[111]  Bruno Lara,et al.  Anticipation by multi-modal association through an artificial mental imagery process , 2014, Connect. Sci..

[112]  Wolfgang Prinz,et al.  Authorship effects in the prediction of handwriting strokes: Evidence for action simulation during action perception , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.