Learning Object Affordances: From Sensory--Motor Coordination to Imitation

Affordances encode relationships between actions, objects, and effects. They play an important role on basic cognitive capabilities such as prediction and planning. We address the problem of learning affordances through the interaction of a robot with the environment, a key step to understand the world properties and develop social skills. We present a general model for learning object affordances using Bayesian networks integrated within a general developmental architecture for social robots. Since learning is based on a probabilistic model, the approach is able to deal with uncertainty, redundancy, and irrelevant information. We demonstrate successful learning in the real world by having an humanoid robot interacting with objects. We illustrate the benefits of the acquired knowledge in imitation games.

[1]  Maya Cakmak,et al.  To Afford or Not to Afford: A New Formalization of Affordances Toward Affordance-Based Robot Control , 2007, Adapt. Behav..

[2]  Lucas Paletta,et al.  Learning Predictive Features in Affordance based Robotic Perception Systems , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  J. Konczak,et al.  Changing affordances in stair climbing: the perception of maximum climbability in young and older adults. , 1992, Journal of experimental psychology. Human perception and performance.

[4]  Adnan Darwiche,et al.  Inference in belief networks: A procedural guide , 1996, Int. J. Approx. Reason..

[5]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[6]  大西 仁,et al.  Pearl, J. (1988, second printing 1991). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan-Kaufmann. , 1994 .

[7]  M. Carpenter,et al.  Three sources of information in social learning , 2002 .

[8]  Ed Symes,et al.  Visual object affordances: object orientation. , 2007, Acta psychologica.

[9]  Kevin P. Murphy,et al.  Exact Bayesian structure learning from uncertain interventions , 2007, AISTATS.

[10]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[11]  Maya Cakmak,et al.  From primitive behaviors to goal-directed behavior using affordances , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Chrystopher L. Nehaniv,et al.  Three Sources of Information in Social Learning , 2002 .

[13]  Gert Westermann,et al.  Evidence of rapid correlation-based perceptual category learning by 4-month-olds , 2005 .

[14]  J. York,et al.  Bayesian Graphical Models for Discrete Data , 1995 .

[15]  Giulio Sandini,et al.  Learning about objects through action - initial steps towards artificial cognition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[16]  John Juyang Weng The Developmental Approach to Intelligent Robots , 1998 .

[17]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[18]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[19]  A. Chemero An Outline of a Theory of Affordances , 2003, How Shall Affordances be Refined? Four Perspectives.

[20]  Randall D. Beer,et al.  Further Experiments in the Evolution of Minimally Cognitive Behavior: From Perceiving Affordances to Selective Attention , 2000 .

[21]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[22]  Alexander Stoytchev,et al.  Behavior-Grounded Representation of Tool Affordances , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[23]  Nir Friedman,et al.  The Bayesian Structural EM Algorithm , 1998, UAI.

[24]  José Santos-Victor,et al.  A Developmental Roadmap for Learning by Imitation in Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  José Santos-Victor,et al.  Visual learning by imitation with motor representations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Katherine D. Kinzler,et al.  Core knowledge. , 2007, Developmental science.

[27]  M. Turvey,et al.  Affordance, proper function, and the physical basis of perceived heaviness , 1999, Cognition.

[28]  Nora S. Newcombe Defining the "Radical Middle" : Essay Review of "Rethinking Innateness: A Connectionist Perspective on Development.". , 1998 .

[29]  Michael Tomasello,et al.  Emulation learning and cultural learning , 1998, Behavioral and Brain Sciences.

[30]  M. Arbib,et al.  Infant grasp learning: a computational model , 2004, Experimental Brain Research.

[31]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[32]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[33]  Manuel Lopes,et al.  Affordance-based imitation learning in robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Lola Cañamero,et al.  Using a SOFM to learn Object Affordances , 2004 .

[35]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[36]  J. Elman,et al.  Rethinking Innateness: A Connectionist Perspective on Development , 1996 .

[37]  Hideki Kozima,et al.  Emergence of imitation mediated by objects , 2002 .

[38]  K. Dautenhahn,et al.  Imitation in Animals and Artifacts , 2002 .

[39]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.