Mobile Manipulation and Mobility as Manipulation—Design and Algorithms of RoboSimian

This article presents the hardware design and software algorithms of RoboSimian, a statically stable quadrupedal robot capable of both dexterous manipulation and versatile mobility in difficult terrain. The robot has generalized limbs and hands capable of mobility and manipulation, along with almost fully hemispherical three‐dimensional sensing with passive stereo cameras. The system is semiautonomous, enabling low‐bandwidth, high latency control operated from a standard laptop. Because limbs are used for mobility and manipulation, a single unified mobile manipulation planner is used to generate autonomous behaviors, including walking, sitting, climbing, grasping, and manipulating. The remote operator interface is optimized to designate, parametrize, sequence, and preview behaviors, which are then executed by the robot. RoboSimian placed fifth in the DARPA Robotics Challenge Trials, demonstrating its ability to perform disaster recovery tasks in degraded human environments.

[1]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[2]  Paul G. Backes.  Dual-arm supervisory and shared control task description and execution , 1994, Robotics Auton. Syst..

[3]  Tien-Tsin Wong,et al.  Multiresolution Isosurface Extraction with Adaptive Skeleton Climbing , 1998, Comput. Graph. Forum.

[4]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[5]  Tao Ju,et al.  Dual contouring of hermite data , 2002, ACM Trans. Graph..

[6]  Donald B. Gennery,et al.  Generalized Camera Calibration Including Fish-Eye Lenses , 2006, International Journal of Computer Vision.

[7]  Carl D. Crane.  The 2005 DARPA Grand Challenge , 2007, 2007 International Symposium on Computational Intelligence in Robotics and Automation.

[8]  Sanjiv Singh,et al.  The 2005 DARPA Grand Challenge: The Great Robot Race , 2007 .

[9]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[10]  Stefan Schaal,et al.  Skill learning and task outcome prediction for manipulation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Larry H. Matthies,et al.  End-to-end dexterous manipulation with deliberate interactive estimation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  A. Howard,et al.  Real-time 3D Stereo Mapping in Complex Dynamic Environments , 2012 .

[13]  Stefan Schaal,et al.  Learning objective functions for manipulation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Larry H. Matthies,et al.  Model-based autonomous system for performing dexterous, human-level manipulation tasks , 2014, Auton. Robots.

[15]  Foreword to the special issue on autonomous grasping and manipulation , 2014, Auton. Robots.

[16]  John M. Hsu,et al.  Inside the Virtual Robotics Challenge: Simulating Real-Time Robotic Disaster Response , 2015, IEEE Transactions on Automation Science and Engineering.