A Certified-Complete Bimanual Manipulation Planner

Planning motions for two robot arms to move an object collaboratively is a difficult problem, mainly because of the closed-chain constraint, which arises whenever two robot hands simultaneously grasp a single rigid object. In this paper, we propose a manipulation planning algorithm to bring an object from an initial stable placement (position and orientation of the object on a support surface) toward a goal stable placement. The key specificity of our algorithm is that it is certified-complete: for a given object and a given environment, we provide a certificate that the algorithm will find a solution to any bimanual manipulation query in that environment whenever one exists. Moreover, the certificate is constructive: at run-time, it can be used to quickly find a solution to a given query. The algorithm is tested in software and hardware on a number of large pieces of furniture. Note to Practitioners—This paper presents an algorithm to solve a difficult class of bimanual manipulation planning problems where a movable object can be moved only when grasped by two robots. This problem arises naturally when manipulating a large and/or heavy object such as a piece of furniture and is therefore essential to industrial automation. The algorithm first precomputes a certificate, a set of robot motions to move the object between different placement classes that helps guarantee that the algorithm will find a solution to any planning query whenever one exists. This certificate is then used to quickly construct a solution trajectory to a planning query and can be reused under the same environment. The algorithm has been empirically verified through software and hardware experiments on a number of large pieces of furniture. An open-source implementation is provided.

[1]  Thierry Siméon,et al.  A random loop generator for planning the motions of closed kinematic chains using PRM methods , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[2]  Kensuke Harada,et al.  Developing and Comparing Single-Arm and Dual-Arm Regrasp , 2015, IEEE Robotics and Automation Letters.

[3]  John T. Wen,et al.  A Sensor-Based Dual-Arm Tele-Robotic System , 2015, IEEE Transactions on Automation Science and Engineering.

[4]  Yoshihiko Nakamura,et al.  Admissible velocity propagation: Beyond quasi-static path planning for high-dimensional robots , 2017, Int. J. Robotics Res..

[5]  Josep M. Porta,et al.  Planning Singularity-Free Paths on Closed-Chain Manipulators , 2013, IEEE Transactions on Robotics.

[6]  Dinesh K. Pai,et al.  Genericity and singularities of robot manipulators , 1992, IEEE Trans. Robotics Autom..

[7]  Seong Youb Chung,et al.  Motion planning of bimanual robot for assembly , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[8]  Kensuke Harada,et al.  Optimizing the parameters of tilting surfaces in robotic workcells , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[9]  Quang-Cuong Pham,et al.  A General, Fast, and Robust Implementation of the Time-Optimal Path Parameterization Algorithm , 2013, IEEE Transactions on Robotics.

[10]  Thierry Siméon,et al.  Planning pick-and-place tasks with two-hand regrasping , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Quang-Cuong Pham,et al.  A Single-Query Manipulation Planner , 2016, IEEE Robotics and Automation Letters.

[12]  Dragoljub Surdilovic,et al.  Compliance control with dual-arm humanoid robots: Design, planning and programming , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[13]  Charles C. Kemp,et al.  Two Arms Are Better Than One: A Behavior Based Control System for Assistive Bimanual Manipulation , 2007 .

[14]  Yoshihiko Nakamura,et al.  Completeness of randomized kinodynamic planners with state-based steering , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Victor Ng-Thow-Hing,et al.  Randomized multi-modal motion planning for a humanoid robot manipulation task , 2011, Int. J. Robotics Res..

[16]  Olivier Stasse,et al.  Time-Optimal Path Parameterization for Redundantly Actuated Robots: A Numerical Integration Approach , 2015, IEEE/ASME Transactions on Mechatronics.

[17]  Quang-Cuong Pham,et al.  Time-Optimal Path Parameterization of Rigid-Body Motions: Applications to Spacecraft Reorientation , 2016 .

[18]  Frank Chongwoo Park,et al.  Tangent bundle RRT: A randomized algorithm for constrained motion planning , 2014, Robotica.

[19]  Nikolaos Papanikolopoulos,et al.  Planning of regrasp operations , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[20]  Gaurav S. Sukhatme,et al.  Multi-step planning for robotic manipulation , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Rachid Alami,et al.  Two manipulation planning algorithms , 1995 .

[22]  Alberto Rodriguez,et al.  A two-phase gripper to reorient and grasp , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[23]  Komei Fukuda,et al.  Double Description Method Revisited , 1995, Combinatorics and Computer Science.

[24]  Lydia E. Kavraki,et al.  Randomized path planning for linkages with closed kinematic chains , 2001, IEEE Trans. Robotics Autom..

[25]  Nancy M. Amato,et al.  A Kinematics-Based Probabilistic Roadmap Method for Closed Chain Systems , 2001 .

[26]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[27]  Steven M. LaValle,et al.  Incremental low-discrepancy lattice methods for motion planning , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[28]  J. Burdick On the inverse kinematics of redundant manipulators: characterization of the self-motion manifolds , 1989 .

[29]  Bruno Siciliano,et al.  Differential Kinematics and Statics , 2000 .

[30]  Daniel Leidner,et al.  Exploiting structure in two-armed manipulation tasks for humanoid robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Yasuo Kuniyoshi,et al.  Improving regrasp algorithms to analyze the utility of work surfaces in a workcell , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[32]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[33]  Gaurav S. Sukhatme,et al.  Using Manipulation Primitives for Object Sorting in Cluttered Environments , 2015, IEEE Transactions on Automation Science and Engineering.

[34]  Kensuke Harada,et al.  A manipulation motion planner for dual-arm industrial manipulators , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Leslie Pack Kaelbling,et al.  Hierarchical planning for multi-contact non-prehensile manipulation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Friedrich M. Wahl,et al.  Generating and evaluating regrasp operations , 1997, Proceedings of International Conference on Robotics and Automation.

[37]  Florent Lamiraux,et al.  Manipulation planning: Addressing the crossed foliation issue , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[38]  Tamim Asfour,et al.  Integrated Grasp and motion planning , 2010, 2010 IEEE International Conference on Robotics and Automation.

[39]  Frank Chongwoo Park,et al.  Smooth invariant interpolation of rotations , 1997, TOGS.

[40]  Jean-Claude Latombe,et al.  Experiments in dual-arm manipulation planning , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[41]  Sara Negri,et al.  A Constructive Proof of the Heine-Borel Covering Theorem for Formal Reals , 1995, TYPES.

[42]  Dmitry Berenson,et al.  Humanoid motion planning for dual-arm manipulation and re-grasping tasks , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  M. Gharbi,et al.  A sampling-based path planner for dual-arm manipulation , 2008, 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[44]  James J. Kuffner,et al.  Effective sampling and distance metrics for 3D rigid body path planning , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[45]  S. Agrawal,et al.  Planning motions of a dual-arm free-floating manipulator keeping the base inertially fixed , 1995 .

[46]  Yoshihiko Nakamura,et al.  Leveraging Cone Double Description for Multi-contact Stability of Humanoids with Applications to Statics and Dynamics , 2015, Robotics: Science and Systems.

[47]  Steven M. LaValle,et al.  Rapidly-Exploring Random Trees: Progress and Prospects , 2000 .

[48]  Thierry Siméon,et al.  Manipulation Planning with Probabilistic Roadmaps , 2004, Int. J. Robotics Res..

[49]  Léonard Jaillet,et al.  Path Planning Under Kinematic Constraints by Rapidly Exploring Manifolds , 2013, IEEE Transactions on Robotics.

[50]  Wolfram Burgard,et al.  Optimal, sampling-based manipulation planning , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[51]  Thierry Siméon,et al.  Roadmap composition for multi-arm systems path planning , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Danica Kragic,et al.  Dual arm manipulation - A survey , 2012, Robotics Auton. Syst..

[53]  Kenzo Nonami,et al.  Assembly manipulation of small objects by dual‐arm manipulator , 2011 .

[54]  Takeo Kanade,et al.  Automated Construction of Robotic Manipulation Programs , 2010 .

[55]  Kensuke Harada,et al.  Analyzing the utility of a support pin in sequential robotic manipulation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[56]  Stefano Carpin,et al.  Bimanual regrasping from unimanual machine learning , 2012, 2012 IEEE International Conference on Robotics and Automation.

[57]  Jean-Claude Latombe,et al.  Multi-modal Motion Planning in Non-expansive Spaces , 2010, Int. J. Robotics Res..

[58]  Xian Zhou,et al.  Closed-Chain Manipulation of Large Objects by Multi-Arm Robotic Systems , 2016, IEEE Robotics and Automation Letters.

[59]  Maxim Likhachev,et al.  Single- and dual-arm motion planning with heuristic search , 2014, Int. J. Robotics Res..

[60]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..