Team RoboSimian: Semi‐autonomous Mobile Manipulation at the 2015 DARPA Robotics Challenge Finals

This paper discusses hardware and software improvements to the RoboSimian system leading up to and during the 2015 DARPA Robotics Challenge DRC Finals. Team RoboSimian achieved a 5th place finish by achieving 7 points in 47:59 min. We present an architecture that was structured to be adaptable at the lowest level and repeatable at the highest level. The low-level adaptability was achieved by leveraging tactile measurements from force torque sensors in the wrist coupled with whole-body motion primitives. We use the term "behaviors" to conceptualize this low-level adaptability. Each behavior is a contact-triggered state machine that enables execution of short-order manipulation and mobility tasks autonomously. At a high level, we focused on a teach-and-repeat style of development by storing executed behaviors and navigation poses in an object/task frame for recall later. This enabled us to perform tasks with high repeatability on competition day while being robust to task differences from practice to execution.

[1]  Sanjiv Singh,et al.  The 2005 DARPA Grand Challenge: The Great Robot Race , 2007 .

[2]  P. Backes,et al.  Automated rover positioning and instrument placement , 2005, 2005 IEEE Aerospace Conference.

[3]  Scott Kuindersma,et al.  A summary of team MIT's approach to the virtual robotics challenge , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Joel W. Burdick,et al.  Supervised Remote Robot with Guided Autonomy and Teleoperation (SURROGATE): A framework for whole-body manipulation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[5]  S. Buss.  Introduction to Inverse Kinematics with Jacobian Transpose , Pseudoinverse and Damped Least Squares methods , 2004 .

[6]  Siddhartha S. Srinivasa,et al.  CHIMP, the CMU Highly Intelligent Mobile Platform , 2015, J. Field Robotics.

[7]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[8]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[9]  Paul Timothy Furgale,et al.  Visual teach and repeat for long‐range rover autonomy , 2010, J. Field Robotics.

[10]  Steven Dubowsky,et al.  Robotic automation for space: planetary surface exploration, terrain-adaptive mobility, and multirobot cooperative tasks , 2001, SPIE Optics East.

[11]  Scott Kuindersma,et al.  Optimization-based locomotion planning, estimation, and control design for the atlas humanoid robot , 2015, Autonomous Robots.

[12]  Suya You,et al.  Automatic 3D Industrial Point Cloud Classification and Modeling , 2015 .

[13]  Scott Kuindersma,et al.  An Architecture for Online Affordance‐based Perception and Whole‐body Planning , 2015, J. Field Robotics.

[14]  Andrew Howard,et al.  Real-time stereo visual odometry for autonomous ground vehicles , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Sanjiv Singh,et al.  The 2005 DARPA Grand Challenge , 2007 .

[16]  Stefan Schaal,et al.  STOMP: Stochastic trajectory optimization for motion planning , 2011, 2011 IEEE International Conference on Robotics and Automation.

[17]  Nathaniel I. Durlach,et al.  Note on Information Transfer Rates in Human Communication , 1998, Presence.

[18]  Gill A. Pratt,et al.  Foreword to the special issue on autonomous grasping and manipulation , 2014, Auton. Robots.

[19]  P.G. Backes.  Generalized compliant motion with sensor fusion , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[20]  Mark Adler,et al.  zlib compression library , 2012 .

[21]  Twan Koolen,et al.  Summary of Team IHMC's virtual robotics challenge entry , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[22]  Wolfram Burgard,et al.  Robust on-line model-based object detection from range images , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[24]  S. Schaal.  Dynamic Movement Primitives -A Framework for Motor Control in Humans and Humanoid Robotics , 2006 .

[25]  Larry H. Matthies,et al.  Model-based autonomous system for performing dexterous, human-level manipulation tasks , 2014, Auton. Robots.

[26]  Robert Ivlev,et al.  The Rocky 7 rover: a Mars sciencecraft prototype , 1997, Proceedings of International Conference on Robotics and Automation.

[27]  Larry H. Matthies,et al.  End-to-end dexterous manipulation with deliberate interactive estimation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[28]  Scott Kuindersma,et al.  An efficiently solvable quadratic program for stabilizing dynamic locomotion , 2013, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Jing Huang,et al.  Automatic 3D industrial point cloud modeling and recognition , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[30]  Andrew E. Johnson,et al.  Computer Vision on Mars , 2007, International Journal of Computer Vision.

[31]  Twan Koolen,et al.  Team IHMC's Lessons Learned from the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[32]  Zoltan-Csaba Marton,et al.  Hierarchical object geometric categorization and appearance classification for mobile manipulation , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[33]  Youngbum Jun,et al.  Continuous trajectory optimization for autonomous humanoid door opening , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[34]  Paul Backes,et al.  An integrated coring and caching concept , 2010, 2010 IEEE Aerospace Conference.

[35]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[36]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Christopher G. Atkeson,et al.  Optimization‐based Full Body Control for the DARPA Robotics Challenge , 2015, J. Field Robotics.

[38]  Siddhartha S. Srinivasa,et al.  CHOMP: Gradient optimization techniques for efficient motion planning , 2009, 2009 IEEE International Conference on Robotics and Automation.

[39]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[40]  Brian W. Satzinger,et al.  Mobile Manipulation and Mobility as Manipulation—Design and Algorithms of RoboSimian , 2015, J. Field Robotics.

[41]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).