Hybrid Differential Dynamic Programming for Planar Manipulation Primitives

We present a hybrid differential dynamic programming (DDP) algorithm for closed-loop execution of manipulation primitives with frictional contact switches. Planning and control of these primitives is challenging as they are hybrid, under-actuated, and stochastic. We address this by developing hybrid DDP both to plan finite horizon trajectories with a few contact switches and to create linear stabilizing controllers. We evaluate the performance and computational cost of our framework in ablations studies for two primitives: planar pushing and planar pivoting. We find that generating pose-to-pose closed-loop trajectories from most configurations requires only a couple (one to two) hybrid switches and can be done in reasonable time (one to five seconds). We further demonstrate that our controller stabilizes these hybrid trajectories on a real pushing system. A video describing our work can be found at https://youtu.be/YGSe4cUfq6Q.

[1]  Christopher G. Atkeson,et al.  Differential dynamic programming for graph-structured dynamical systems: Generalization of pouring behavior with different skills , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[2]  Neel Doshi,et al.  Contact-implicit trajectory optimization using variational integrators , 2019, Int. J. Robotics Res..

[3]  Jeffrey C. Trinkle,et al.  On the stability and instantaneous velocity of grasped frictionless objects , 1992, IEEE Trans. Robotics Autom..

[4]  Danica Kragic,et al.  Adaptive control for pivoting with visual and tactile feedback , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Russ Tedrake,et al.  A direct method for trajectory optimization of rigid bodies through contact , 2014, Int. J. Robotics Res..

[6]  Kevin M. Lynch,et al.  Planning and control for dynamic, nonprehensile, and hybrid manipulation tasks , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Mark R. Cutkosky,et al.  Practical Force-Motion Models for Sliding Manipulation , 1996, Int. J. Robotics Res..

[9]  Matthew T. Mason,et al.  Pushing revisited: Differential flatness, trajectory planning, and stabilization , 2019, Int. J. Robotics Res..

[10]  Yuval Tassa,et al.  Control-limited differential dynamic programming , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Jeffrey C. Trinkle,et al.  A framework for planning dexterous manipulation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[12]  Jeffrey C. Trinkle,et al.  An Investigation of Frictionless Enveloping Grasping in the Plane , 1988, Int. J. Robotics Res..

[13]  Matthew T. Mason,et al.  A general framework for open-loop pivoting , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Quang-Cuong Pham,et al.  A framework for fine robotic assembly , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Hirochika Inoue,et al.  Tumbling Objects Using a Multi-fingered Robot , 1991 .

[16]  Alberto Rodriguez,et al.  Feedback Control of the Pusher-Slider System: A Story of Hybrid and Underactuated Contact Dynamics , 2016, WAFR.

[17]  Zoran Popovic,et al.  Discovery of complex behaviors through contact-invariant optimization , 2012, ACM Trans. Graph..

[18]  Alberto Rodriguez,et al.  In-Hand Manipulation via Motion Cones , 2018, Robotics: Science and Systems.

[19]  S. Yakowitz,et al.  Constrained differential dynamic programming and its application to multireservoir control , 1979 .

[20]  Alberto Rodriguez,et al.  Reactive Planar Manipulation with Convex Hybrid MPC , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[21]  A. Ruina,et al.  Planar sliding with dry friction Part 1. Limit surface and moment function , 1991 .

[22]  Jian Shi,et al.  Dynamic in-hand sliding manipulation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Marc Toussaint,et al.  Differentiable Physics and Stable Modes for Tool-Use and Manipulation Planning , 2018, Robotics: Science and Systems.

[24]  David Q. Mayne,et al.  Differential dynamic programming , 1972, The Mathematical Gazette.

[25]  Tsutomu Hasegawa,et al.  Motion planning of intelligent manipulation by a parallel two-fingered gripper equipped with a simple rotating mechanism , 1998, IEEE Trans. Robotics Autom..

[26]  Siddhartha S. Srinivasa,et al.  Hybrid control trajectory optimization under uncertainty , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Kevin M. Lynch,et al.  Stable Pushing: Mechanics, Controllability, and Planning , 1995, Int. J. Robotics Res..

[28]  C. Karen Liu,et al.  Differential dynamic programming with nonlinear constraints , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Matthew T. Mason,et al.  Fast Planning for 3D Any-Pose-Reorienting Using Pivoting , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[31]  Matthew T. Mason,et al.  Mechanics and Planning of Manipulator Pushing Operations , 1986 .

[32]  W. Marsden I and J , 2012 .

[33]  Matthew T. Mason,et al.  An exploration of sensorless manipulation , 1986, IEEE J. Robotics Autom..

[34]  Leslie Pack Kaelbling,et al.  Manipulation with Multiple Action Types , 2012, ISER.

[35]  Alberto Rodriguez,et al.  Tactile Dexterity: Manipulation Primitives with Tactile Feedback , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).