An Architecture for Online Affordance‐based Perception and Whole‐body Planning

The DARPA Robotics Challenge Trials held in December 2013 provided a landmark demonstration of dexterous mobile robots executing a variety of tasks aided by a remote human operator using only data from the robot's sensor suite transmitted over a constrained, field‐realistic communications link. We describe the design considerations, architecture, implementation, and performance of the software that Team MIT developed to command and control an Atlas humanoid robot. Our design emphasized human interaction with an efficient motion planner, where operators expressed desired robot actions in terms of affordances fit using perception and manipulated in a custom user interface. We highlight several important lessons we learned while developing our system on a highly compressed schedule.

[1]  Masayuki Inaba,et al.  Footstep planning among obstacles for biped robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[2]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[3]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[4]  J. Chestnutt,et al.  Planning Biped Navigation Strategies in Complex Environments , 2003 .

[5]  Wisama Khalil,et al.  Modeling, Identification and Control of Robots , 2003 .

[6]  Brian Yamauchi,et al.  PackBot: a versatile platform for military robotics , 2004, SPIE Defense + Commercial Sensing.

[7]  S. Buss Introduction to Inverse Kinematics with Jacobian Transpose , Pseudoinverse and Damped Least Squares methods , 2004 .

[8]  Sing Bing Kang,et al.  Parameter-Free Radial Distortion Correction with Center of Distortion Estimation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[10]  三嶋 博之 The theory of affordances , 2008 .

[11]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[12]  Edwin Olson,et al.  LCM: Lightweight Communications and Marshalling , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[14]  Robin R. Murphy,et al.  Utilization of Robot Systems in Disaster Sites of the Great Eastern Japan Earthquake , 2012, FSR.

[15]  Adam Jacoff,et al.  Advancing the State of Urban Search and Rescue Robotics Through the RoboCupRescue Robot League Competition , 2012, FSR.

[16]  Weiwei Huang,et al.  Energy-based optimal step planning for humanoids , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  Dmitry Berenson,et al.  DARPA Robotics Challenge: Towards a user-guided manipulation framework for high-DOF robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Siddhartha S. Srinivasa,et al.  Guided Manipulation Planning at the DARPA Robotics Challenge Trials , 2014, ISER.

[19]  Robin Deits,et al.  Computing Large Convex Regions of Obstacle-Free Space Through Semidefinite Programming , 2014, WAFR.

[20]  Scott Kuindersma,et al.  A summary of team MIT's approach to the virtual robotics challenge , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Scott Kuindersma,et al.  An efficiently solvable quadratic program for stabilizing dynamic locomotion , 2013, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Eiichi Yoshida,et al.  Humanoids , 2016, Springer Handbook of Robotics, 2nd Ed..