A robot rehearses internally and learns an affordance relation

This paper introduces a novel approach to a crucial problem in robotics: Constructing robots that can learn general affordance relations from their experiences. Our approach has two components. (a) The robot models affordances as statistical relations between actual actions, object properties and the experienced effects of actions on objects. (b) To exploit the general-knowledge potential of its actual experiences, the robot, much like people, engages in internal rehearsal, playing-out ldquoimaginedrdquo scenarios grounded in but different from actual experience. To the extent the robot veridically appreciates affordance relations, the robot can autonomously predict the outcomes of its behaviors before executing them. Accurate outcome prediction in turn facilitates planning of a sequence of behaviors, toward executing the robotpsilas given task successfully. In this paper, we report very first steps in this approach to affordance learning, viz., the results of simulations and humanoid-robot-embodied experiments targeted toward having the robot learn one of the simplest of affordance relations, that a space affords traversability vs. impediment to a goal-object in the space.

[1]  Lucas Paletta,et al.  Perception and Developmental Learning of Affordances in Autonomous Robots , 2007, KI.

[2]  Kazuhiko Kawamura,et al.  Implementation of Cognitive Control for Robots , 2007 .

[3]  A. Fagg,et al.  Learning Grasp Affordances Through Human Demonstration , 2008 .

[4]  K. Kawamura,et al.  Application of a hybrid controller with non-contact impedance to a humanoid robot , 2008, 2008 International Workshop on Variable Structure Systems.

[5]  Towards Affordance-Based Robot Control, 05.06. - 09.06.2006 , 2006, Towards Affordance-Based Robot Control.

[6]  Reinhard Moratz,et al.  Automatic object recognition within an of .ce environment , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[7]  Gary McGraw,et al.  Emergent Control and Planning in an Autonomous Vehicle , 1993 .

[8]  T. Stoffregen Affordances as Properties of the Animal-Environment System , 2003, How Shall Affordances be Refined? Four Perspectives.

[9]  M. Shanahan A cognitive architecture that combines internal simulation with a global workspace , 2006, Consciousness and Cognition.

[10]  Stefano Nolfi,et al.  Learning to perceive the world as articulated: an approach for hierarchical learning in sensory-motor systems , 1998, Neural Networks.

[11]  Kaz Kawamura "Synthetic Approach to Cognitive Systems: A Perspective from Cognitive Robotics" , 2007 .

[12]  James M. Keller,et al.  A Biologically Inspired Adaptive Working Memory for Robots , 2004, AAAI Technical Report.

[13]  Manuel Lopes,et al.  Affordance-based imitation learning in robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  A. Stoytchev Toward Learning the Binding Affordances of Objects : A Behavior-Grounded Approach , 2022 .

[15]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[16]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Maya Cakmak,et al.  The learning and use of traversability affordance using range images on a mobile robot , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[18]  Patrick Doherty,et al.  06231 Executive Summary - Towards Affordance-based Robot Control , 2006, Towards Affordance-Based Robot Control.

[19]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[20]  P. L. Adams THE ORIGINS OF INTELLIGENCE IN CHILDREN , 1976 .

[21]  Kazuhiko Kawamura,et al.  Implementation of Cognitive Control for a Humanoid Robot , 2008, Int. J. Humanoid Robotics.

[22]  K. Inoue,et al.  Defining a neural network controller structure for a rubbertuator robot , 2000, Neural Networks.

[23]  Giulio Sandini,et al.  Learning about objects through action - initial steps towards artificial cognition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[24]  D. Witherington The Development of Prospective Grasping Control Between 5 and 7 Months: A Longitudinal Study. , 2005, Infancy : the official journal of the International Society on Infant Studies.

[25]  Germund Hesslow,et al.  EXPLORING INTERNAL SIMULATION OF PERCEPTION IN MOBILE ROBOTS , 2001 .