Using learned affordances for robotic behavior development

"Developmental robotics" proposes that, instead of trying to build a robot that shows intelligence once and for all, what one must do is to build robots that can develop. These robots should be equipped with behaviors that are simple but enough to bootstrap the system. Then, as the robot interacts with its environment, it should display increasingly complex behaviors. In this paper, we propose such a development scheme for a mobile robot. J.J. Gibson's concept of "affordances" and a formalization of this concept provides the basis of this development scheme. We show that an autonomous robot can start with pre-coded primitive behaviors, and as it executes its behaviors randomly in an environment, it can learn the affordance relations between the environment and its behaviors. We then present two ways of using these learned structures, in achieving more complex, intentional behaviors. In the first case, the sequencing of these primitive behaviors are such that new more complex behaviors emerge. In the second case, the robot makes a "blending" of its pre-coded primitive behaviors to create new behaviors.

[1]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[2]  E. Gibson The World Is So Full of a Number of Things: On Specification and Perceptual Learning , 2003 .

[3]  Mehmet R. Doùgar Affordances as a Framework for Robot Control , 2007 .

[4]  Maya Cakmak,et al.  From primitive behaviors to goal-directed behavior using affordances , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  E. Bizzi,et al.  Linear combinations of primitives in vertebrate motor control. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[6]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[7]  Ronald C. Arkin,et al.  Selection of behavioral parameters: integration of discontinuous switching via case-based reasoning with continuous adaptation via learning momentum , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[8]  Maya Cakmak,et al.  To Afford or Not to Afford: A New Formalization of Affordances Toward Affordance-Based Robot Control , 2007, Adapt. Behav..

[9]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[10]  E. Markman The essential Piaget , 1978 .

[11]  Maya Cakmak,et al.  The learning and use of traversability affordance using range images on a mobile robot , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Ronald C. Arkin,et al.  Learning behavioral parameterization using spatio-temporal case-based reasoning , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[13]  Pierre-Yves Oudeyer,et al.  The Playground Experiment: Task-Independent Development of a Curious Robot , 2005 .

[14]  Minoru Asada,et al.  Purposive Behavior Acquisition for a Real Robot by Vision-Based Reinforcement Learning , 2005, Machine Learning.

[15]  Jean Piaget Piaget’s Theory , 1976 .

[16]  E. Sahin,et al.  Curiosity-driven learning of traversability affordance on a mobile robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[17]  S. Iversen Motor control , 2000, Clinical Neurophysiology.

[18]  Giulio Sandini,et al.  Learning about objects through action - initial steps towards artificial cognition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  E. Gibson Perceptual Learning in Development: Some Basic Concepts , 2000 .

[20]  A. Szokolszky An Interview With Eleanor Gibson , 2003 .