Heteroscedastic Regression and Active Learning for Modeling Affordances in Humanoids

We investigate the learning of object and tool affordances in the iCub robot. We adopt the setup proposed in a previous experiment, using a Bayesian network (BN) in place of a least square support vector machine (LSSVM). The collected data, consisting of continuous and discrete variables, are used for learning the structure of the BN. Hence, the model is leveraged to: 1) identify a regression function for the prediction of the effects of actions on objects, calculated as the mean of the observed values; and 2) provide information on the reliability of the predicted values through the estimation of the variance for subsets of local observations. The information on the input-dependent variance is used to guide the learning algorithm in order to improve the performance of the robot, and hence to reduce the variance from the predicted values. The replacement of the LSSVM with the BN model provides a general probabilistic framework for dependencies among random variables; we perform conditional probability queries that enable the robot to choose the actions to perform on objects and select the most appropriate tool to obtain desired effects. The capability to make inference enables the robot to gather a better understanding of the world.

[1]  Giorgio Metta,et al.  Real-time model learning using Incremental Sparse Spectrum Gaussian Process Regression. , 2013, Neural networks : the official journal of the International Neural Network Society.

[2]  Adnan Darwiche,et al.  Inference in belief networks: A procedural guide , 1996, Int. J. Approx. Reason..

[3]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[4]  Jacqueline Fagard,et al.  The emergence of tool use during the second year of life. , 2012, Journal of experimental child psychology.

[5]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[6]  Ugo Pattacini,et al.  A Bayesian approach towards affordance learning in artificial agents , 2015, 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[7]  T. Stoffregen Affordances as Properties of the Animal-Environment System , 2003, How Shall Affordances be Refined? Four Perspectives.

[8]  Jeffrey J. Lockman,et al.  Infant Manual Exploration of Objects, Surfaces, and Their Interrelations , 2005 .

[9]  Manuel Lopes,et al.  Modeling affordances using Bayesian networks , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  R. Amant,et al.  Revisiting the definition of animal tool use , 2008, Animal Behaviour.

[11]  Dirk Kraft,et al.  A Survey of the Ontogeny of Tool Use: From Sensorimotor Experience to Planning , 2013, IEEE Transactions on Autonomous Mental Development.

[12]  B. Beck Animal Tool Behavior , 1980 .

[13]  Angelo Cangelosi,et al.  Affordances in Psychology, Neuroscience, and Robotics: A Survey , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[14]  J. Lockman A perception--action perspective on tool use development. , 2000, Child development.

[15]  J. Sinapov,et al.  Detecting the functional similarities between tools using a hierarchical representation of outcomes , 2008, 2008 7th IEEE International Conference on Development and Learning.

[16]  Stefan Wermter,et al.  Learning contextual affordances with an associative neural architecture , 2016, ESANN.

[17]  Alexandre Bernardino,et al.  Gaussian mixture models for affordance learning using Bayesian Networks , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Danica Kragic,et al.  Visual object-action recognition: Inferring object affordances from human demonstration , 2011, Comput. Vis. Image Underst..

[19]  Alexandre Bernardino,et al.  Learning intermediate object affordances: Towards the development of a tool concept , 2014, 4th International Conference on Development and Learning and on Epigenetic Robotics.

[20]  Giulio Sandini,et al.  Learning about objects through action - initial steps towards artificial cognition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[21]  A. Chemero An Outline of a Theory of Affordances , 2003, How Shall Affordances be Refined? Four Perspectives.

[22]  Pierre-Yves Oudeyer,et al.  Object Learning Through Active Exploration , 2014, IEEE Transactions on Autonomous Mental Development.

[23]  Hans-Joachim Böhme,et al.  Learning the Consequences of Actions: Representing Effects as Feature Changes , 2010, 2010 International Conference on Emerging Security Technologies.

[24]  Danica Kragic,et al.  Learning task constraints for robot grasping using graphical models , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Kevin Murphy,et al.  Bayes net toolbox for Matlab , 1999 .

[26]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[27]  M. Dogar,et al.  Afford or Not to Afford : A New Formalization of Affordances Toward Affordance-Based Robot , 2007 .

[28]  Tetsunari Inamura,et al.  Bayesian learning of tool affordances based on generalization of functional feature to estimate effects of unseen tools , 2013, Artificial Life and Robotics.

[29]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[30]  Mark Steedman,et al.  Plans, Affordances, And Combinatory Grammar , 2002 .

[31]  M. Turvey Affordances and Prospective Control: An Outline of the Ontology , 1992 .

[32]  G. Metta,et al.  Exploring affordances and tool use on the iCub , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[33]  Manuel Lopes,et al.  Learning Object Affordances: From Sensory--Motor Coordination to Imitation , 2008, IEEE Transactions on Robotics.

[34]  Giulio Sandini,et al.  The iCub humanoid robot: An open-systems platform for research in cognitive development , 2010, Neural Networks.

[35]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[36]  E. Bushnell,et al.  Motor development and the mind: the potential role of motor abilities as a determinant of aspects of perceptual development. , 1993, Child development.

[37]  Ugo Pattacini,et al.  Grounding speech utterances in robotics affordances: An embodied statistical language model , 2016, 2016 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[38]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[39]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[40]  Alexander Stoytchev,et al.  Behavior-Grounded Representation of Tool Affordances , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.