Model predictive control for fast reaching in clutter

A key challenge for haptically reaching in dense clutter is the frequent contact that can occur between the robot’s arm and the environment. We have previously used single-time-step model predictive control (MPC) to enable a robot to slowly reach into dense clutter using a quasistatic mechanical model. Rapid reaching in clutter would be desirable, but entails additional challenges due to dynamic phenomena that can lead to higher forces from impacts and other types of contact. In this paper, we present a multi-time-step MPC formulation that enables a robot to rapidly reach a target position in dense clutter, while regulating whole-body contact forces to be below a given threshold. Our controller models the dynamics of the arm in contact with the environment in order to predict how contact forces will change and how the robot’s end effector will move. It also models how joint velocities will influence potential impact forces. At each time step, our controller uses linear models to generate a convex optimization problem that it can solve efficiently. Through tens of thousands of trials in simulation, we show that with our dynamic MPC a simulated robot can, on average, reach goals 1.4 to 2 times faster than our previous controller, while attaining comparable success rates and fewer occurrences of high forces. We also conducted trials using a real 7 degree-of-freedom (DoF) humanoid robot arm with whole-arm tactile sensing. Our controller enabled the robot to rapidly reach target positions in dense artificial foliage while keeping contact forces low.

[1]  Pierre-Brice Wieber,et al.  Trajectory Free Linear Model Predictive Control for Stable Walking in the Presence of Strong Perturbations , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[2]  Stephen P. Boyd,et al.  Real-Time Convex Optimization in Signal Processing , 2010, IEEE Signal Processing Magazine.

[3]  Emanuel Todorov,et al.  First-exit model predictive control of fast discontinuous dynamics: Application to ball bouncing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Alin Albu-Schäffer,et al.  Safe Physical Human-Robot Interaction: Measurements, Analysis and New Insights , 2007, ISRR.

[5]  Pieter Abbeel,et al.  Autonomous Helicopter Aerobatics through Apprenticeship Learning , 2010, Int. J. Robotics Res..

[6]  Jonathan P. How,et al.  Receding horizon control of autonomous aerial vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[7]  Charles C. Kemp,et al.  A Robotic System for Reaching in Dense Clutter that Integrates Model Predictive Control, Learning, Haptic Mapping, and Planning , 2014 .

[8]  Lawson L. S. Wong,et al.  A Vision-Based System for Grasping Novel Objects in Cluttered Environments , 2007, ISRR.

[9]  Charles C. Kemp,et al.  Fast reaching in clutter while regulating forces using model predictive control , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[10]  C.M. Gosselin,et al.  Computationally Efficient Predictive Robot Control , 2007, IEEE/ASME Transactions on Mechatronics.

[11]  James M. Rehg,et al.  Rapid categorization of object properties from incidental contact with a tactile sensing robot arm , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[12]  T. Sincich,et al.  Statistics for business and economics , 1978 .

[13]  Neville Hogan,et al.  Impedance control - An approach to manipulation. I - Theory. II - Implementation. III - Applications , 1985 .

[14]  Russ Tedrake,et al.  Direct Trajectory Optimization of Rigid Body Dynamical Systems through Contact , 2012, WAFR.

[15]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[16]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[17]  J. A. Rossiter,et al.  Model-Based Predictive Control : A Practical Approach , 2017 .

[18]  Antonio Bicchi,et al.  A truly safely moving robot has to know what injury it may cause , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Zoran Popovic,et al.  Discovery of complex behaviors through contact-invariant optimization , 2012, ACM Trans. Graph..

[20]  Zoran Popovic,et al.  Contact-invariant optimization for hand manipulation , 2012, SCA '12.

[21]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[22]  Ian R. Manchester,et al.  Stable dynamic walking over uneven terrain , 2011, Int. J. Robotics Res..

[23]  W. Brogan Modern Control Theory , 1971 .

[24]  Geoffrey A. Hollinger,et al.  HERB: a home exploring robotic butler , 2010, Auton. Robots.

[25]  Matthew T. Mason,et al.  Mechanics of Robotic Manipulation , 2001 .

[26]  Alessandro De Luca,et al.  Collision detection and reaction: A contribution to safe physical Human-Robot Interaction , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Siddhartha S. Srinivasa,et al.  A Framework for Push-Grasping in Clutter , 2011, Robotics: Science and Systems.

[28]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[29]  Peter I. Corke,et al.  A robotics toolbox for MATLAB , 1996, IEEE Robotics Autom. Mag..

[30]  Tien C. Hsia,et al.  Joint trajectory generation for redundant robots in an environment with obstacles , 1993, J. Field Robotics.

[31]  Maren Bennewitz,et al.  Navigation in three-dimensional cluttered environments for mobile manipulation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[32]  Franck Plestan,et al.  Asymptotically stable walking for biped robots: analysis via systems with impulse effects , 2001, IEEE Trans. Autom. Control..

[33]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[34]  Yuval Tassa,et al.  Infinite-Horizon Model Predictive Control for Periodic Tasks with Contacts , 2011, Robotics: Science and Systems.

[35]  Lydia E. Kavraki,et al.  Motion Planning , 2011, Springer Handbook of Robotics, 2nd Ed..

[36]  Stephen P. Boyd,et al.  Automatic code generation for real-time convex optimization , 2010, Convex Optimization in Signal Processing and Communications.

[37]  J. Andrew Bagnell,et al.  Perceiving, learning, and exploiting object affordances for autonomous pile manipulation , 2013, Auton. Robots.

[38]  Marc D. Killpack Model predictive control with haptic feedback for robot manipulation in cluttered scenarios , 2013 .

[39]  Stephen P. Boyd,et al.  CVXGEN: a code generator for embedded convex optimization , 2011, Optimization and Engineering.

[40]  Alessandro De Luca,et al.  An adapt-and-detect actuator FDI scheme for robot manipulators , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[41]  Tamim Asfour,et al.  Manipulation Planning Among Movable Obstacles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[42]  Oussama Khatib,et al.  Instantaneous stiffness effects on impact forces in human-friendly robots , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  Matei Ciocarlie,et al.  Methods for collision-free arm teleoperation in clutter using constraints from 3D sensor data , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[44]  John M. Hollerbach,et al.  Editorial: Mike Brady's Retirement from Oxford , 2011, Int. J. Robotics Res..

[45]  Mike Stilman,et al.  Global Manipulation Planning in Robot Joint Space With Task Constraints , 2010, IEEE Transactions on Robotics.

[46]  Emanuel Todorov,et al.  Trajectory optimization for domains with contacts using inverse dynamics , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Cristóvão Duarte Sousa SymPyBotics v1.0 , 2014 .

[48]  Alessandro De Luca,et al.  Exploiting robot redundancy in collision detection and reaction , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[49]  Advait Jain,et al.  Reaching in clutter with whole-arm tactile sensing , 2013, Int. J. Robotics Res..

[50]  Alessandro De Luca,et al.  Collision Detection and Safe Reaction with the DLR-III Lightweight Manipulator Arm , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  Oussama Khatib,et al.  Capacitive skin sensors for robot impact monitoring , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[53]  Giulio Sandini,et al.  Approximate optimal control for reaching and trajectory planning in a humanoid robot , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[54]  Advait Jain,et al.  Manipulation in Clutter with Whole-Arm Tactile Sensing , 2013, ArXiv.

[55]  Jeffrey C. Trinkle,et al.  An implicit time-stepping scheme for rigid body dynamics with Coulomb friction , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[56]  Cleve B. Moler,et al.  Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five Years Later , 1978, SIAM Rev..

[57]  Jan Tommy Gravdahl,et al.  Motion planning and control of robotic manipulators on seaborne platforms , 2011 .

[58]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..