Transferring spatial perception between robots operating in a shared workspace

We use a Katana robotic arm to teach an iCub humanoid robot how to perceive the location of the objects it sees. To do this, the Katana positions an object within the shared workspace, and tells the iCub where it has placed it. While the iCub moves it observes the object, and a neural network then learns how to relate its pose and visual inputs to the object location. We show that satisfactory results can be obtained for localisation even in scenarios where the kinematic model is imprecise or not available. Furthermore, we demonstrate that this task can be accomplished safely. For this task we extend our collision avoidance software for the iCub to prevent collisions between multiple, independently controlled, heterogeneous robots in the same workspace.

[1]  Giulio Sandini,et al.  The iCub humanoid robot: An open-systems platform for research in cognitive development , 2010, Neural Networks.

[2]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Gino van den Bergen.  Collision Detection in Interactive 3D Environments , 2003 .

[4]  Jodi Forlizzi,et al.  Service robots in the domestic environment: a study of the roomba vacuum in the home , 2006, HRI '06.

[5]  Rob Knight,et al.  The Anthropomimetic Principle , 2006 .

[6]  Alexandre Bernardino,et al.  A review of log-polar imaging for visual perception in robotics , 2010, Robotics and Autonomous Systems.

[7]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[8]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[9]  Christoph Borst,et al.  A Humanoid Two-Arm System for Dexterous Manipulation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[10]  Seth Hutchinson,et al.  Coordinating the motions of multiple robots with specified trajectories , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  K. C. Gupta.  Kinematic Analysis of Manipulators Using the Zero Reference Position Description , 1986 .

[12]  Nikolaos G. Tsagarakis,et al.  iCub: the design and realization of an open humanoid platform for cognitive and neuroscience research , 2007, Adv. Robotics.

[13]  Jürgen Leitner,et al.  icVision: A modular vision system for cognitive robotics research , 2012 .

[14]  Dejan Pangercic,et al.  Robotic roommates making pancakes , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[15]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[16]  Alexander Gloye,et al.  Reinforcing the Driving Quality of Soccer Playing Robots by Anticipation (Verbesserung der Fahreigenschaften von fußballspielenden Robotern durch Antizipation) , 2005, it Inf. Technol..

[17]  Jürgen Schmidhuber,et al.  Reflexive Collision Response with Virtual Skin - Roadmap Planning Meets Reinforcement Learning , 2016, ICAART.

[18]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[19]  Wolfram Burgard,et al.  Coordinated multi-robot exploration , 2005, IEEE Transactions on Robotics.

[20]  Albert Y. Zomaya,et al.  Obstacle Avoidance in Multi-Robot Systems - Experiments in Parallel Genetic Algorithms , 1998, World Scientific Series in Robotics and Intelligent Systems.

[21]  Kerstin Dautenhahn,et al.  New Frontiers in Human-Robot Interaction , 2011 .

[22]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[23]  Mikhail Frank,et al.  Towards Spatial Perception: Learning to Locate Objects From Vision , 2012 .

[24]  Dirk Schulz,et al.  A probabilistic approach to coordinated multi-robot indoor surveillance , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[26]  William B. Langdon,et al.  Evolving Hand-Eye Coordination for a Humanoid Robot with Machine Code Genetic Programming , 2001, EuroGP.

[27]  Thierry Siméon,et al.  Roadmap composition for multi-arm systems path planning , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Juergen Leitner,et al.  Multi-Robot Formations for Area Coverage in Space Applications , 2009 .

[29]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[30]  Jean-Claude Latombe,et al.  On multi-arm manipulation planning , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[31]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[32]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .