Template-based manipulation in unstructured environments for supervised semi-autonomous humanoid robots

Humanoid robotic manipulation in unstructured environments is a challenging problem. Limited perception, communications and environmental constraints present challenges that prevent fully autonomous or purely teleoperated robots from reliably interacting with their environment. In order to achieve higher reliability in manipulation we present an approach involving remote human supervision. Strengths from both human operator and humanoid robot are leveraged through a user interface that allows the operator to perceive the remote environment through an aggregated worldmodel based on onboard sensing, while the robot can efficiently receive perceptual and semantic information from the operator. A template based manipulation approach has been successfully applied to the Atlas humanoid robot; we show real world footage of the results obtained in the DARPA Robotics Challenge Trials 2013.

[1]  Mark Steedman,et al.  Object-Action Complexes: Grounded abstractions of sensory-motor processes , 2011, Robotics Auton. Syst..

[2]  三嶋 博之.  The theory of affordances , 2008 .

[3]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[4]  Robert D. Howe,et al.  A compliant, underactuated hand for robust manipulation , 2013, Int. J. Robotics Res..

[5]  Oskar von Stryk,et al.  Supervised footstep planning for humanoid robots in rough terrain tasks using a black box walking controller , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[6]  Holly A. Yanco,et al.  Analysis of Human‐robot Interaction at the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[7]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Ieee Robotics,et al.  IEEE robotics & automation magazine , 1994 .

[9]  Sachin Chitta,et al.  MoveIt! [ROS Topics] , 2012, IEEE Robotics Autom. Mag..

[10]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[11]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[12]  Maya Cakmak,et al.  To Afford or Not to Afford: A New Formalization of Affordances Toward Affordance-Based Robot Control , 2007, Adapt. Behav..

[13]  Doug A. Bowman,et al.  Human‐robot Teaming for Rescue Missions: Team ViGIR's Approach to the 2013 DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[14]  R. Shaw,et al.  Perceiving, Acting and Knowing : Toward an Ecological Psychology , 1978 .

[15]  Maren Bennewitz,et al.  Anytime search-based footstep planning with suboptimality bounds , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[16]  Jörg Stückler,et al.  Shape-Primitive Based Object Recognition and Grasping , 2012, ROBOTIK.

[17]  Tamim Asfour,et al.  Discovery, segmentation and reactive grasping of unknown objects , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[18]  Tamim Asfour,et al.  Robot placement based on reachability inversion , 2013, 2013 IEEE International Conference on Robotics and Automation.

[19]  Tamim Asfour,et al.  Autonomous acquisition of visual multi-view object representations for object recognition on a humanoid robot , 2010, 2010 IEEE International Conference on Robotics and Automation.

[20]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[21]  Doug A. Bowman,et al.  Overview of team ViGIR's approach to the Virtual Robotics Challenge , 2013, 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[22]  Alexander Bierbaum,et al.  Grasp affordances from multi-fingered tactile exploration using dynamic potential fields , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[23]  Seiga Kiribayashi,et al.  Redesign of rescue mobile robot Quince , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[24]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[25]  Scott Kuindersma,et al.  An Architecture for Online Affordance‐based Perception and Whole‐body Planning , 2015, J. Field Robotics.

[26]  Matei Ciocarlie,et al.  Methods for collision-free arm teleoperation in clutter using constraints from 3D sensor data , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).