Efficient and High-quality Prehensile Rearrangement in Cluttered and Confined Spaces

Prehensile object rearrangement in cluttered and confined spaces has broad applications but is also challenging. For instance, rearranging products in a grocery or home shelf means that the robot cannot directly access all objects and has limited free space. This is harder than tabletop rearrangement where objects are easily accessible with top-down grasps, which simplifies robot-object interactions. This work focuses on problems where such interactions are critical for completing tasks and extends state-of-the-art results in rearrangement planning. It proposes a new efficient and complete solver under general constraints for monotone instances, which can be solved by moving each object at most once. The monotone solver reasons about robot-object constraints and uses them to effectively prune the search space. The new monotone solver is integrated with a global planner to solve non-monotone instances with high-quality solutions fast. Furthermore, this work contributes an effective pre-processing tool to speed up arm motion planning for rearrangement in confined spaces. The pre-processing tool provide significant speed-ups (49.1% faster on average) in online query resolution. Comparisons in simulations further demonstrate that the proposed monotone solver, equipped with the pre-processing tool, results in 57.3% faster computation and 3 times higher success rate than alternatives. Similarly, the resulting global planner is computationally more efficient and has a higher success rate given the more powerful monotone solver and the pre-processing tool, while producing high-quality solutions for non-monotone instances (i.e., only 1.3 buffers are needed on average). Videos of demonstrating solutions on a real robotic system and codes can be found at https://github.com/Rui1223/uniform object rearrangement.

[1]  Danica Kragic,et al.  Rearrangement with Nonprehensile Manipulation Using Deep Reinforcement Learning , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Baichuan Huang,et al.  DIPN: Deep Interaction Prediction Network with Application to Clutter Removal , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Yong K. Hwang,et al.  Practical path planning among movable obstacles , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[4]  Peter R. Florence,et al.  Transporter Networks: Rearranging the Visual World for Robotic Manipulation , 2020, CoRL.

[5]  Dinesh Manocha,et al.  Centralized path planning for multiple robots: Optimal decoupling into sequential plans , 2009, Robotics: Science and Systems.

[6]  Christopher Amato,et al.  Online Planning for Target Object Search in Clutter under Partial Observability , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[7]  Kris K. Hauser,et al.  The minimum constraint removal problem with three robotics applications , 2014, Int. J. Robotics Res..

[8]  Masayuki Inaba,et al.  Working with movable obstacles using on-line environment perception reconstruction using active sensing and color range sensor , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  James J. Kuffner,et al.  Navigation among movable obstacles: real-time reasoning in complex environments , 2004, 4th IEEE/RAS International Conference on Humanoid Robots, 2004..

[10]  Si Wei Feng,et al.  On Minimizing the Number of Running Buffers for Tabletop Rearrangement , 2021, Robotics: Science and Systems.

[11]  Mathieu Aubry,et al.  Monte-Carlo Tree Search for Efficient Visually Guided Rearrangement Planning , 2019, IEEE Robotics and Automation Letters.

[12]  Christos H. Papadimitriou,et al.  The Euclidean Traveling Salesman Problem is NP-Complete , 1977, Theor. Comput. Sci..

[13]  Joshua A. Haustein,et al.  Multi-Object Rearrangement with Monte Carlo Tree Search: A Case Study on Planar Nonprehensile Sorting , 2019, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  E. Rivlin,et al.  Practical pushing planning for rearrangement tasks , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[15]  Tamim Asfour,et al.  Manipulation Planning Among Movable Obstacles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[16]  Baichuan Huang,et al.  Visual Foresight Trees for Object Retrieval From Clutter With Nonprehensile Rearrangement , 2021, IEEE Robotics and Automation Letters.

[17]  Mike Stilman,et al.  Navigation Among Movable Obstacles in unknown environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Dan Halperin,et al.  Fast, High-Quality Two-Arm Rearrangement in Synchronous, Monotone Tabletop Setups , 2021, IEEE Transactions on Automation Science and Engineering.

[19]  Kevin M. Lynch,et al.  Estimating the friction parameters of pushed objects , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[20]  Kostas E. Bekris,et al.  Efficiently solving general rearrangement tasks: A fast extension primitive for an incremental sampling-based planner , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[21]  E. J.,et al.  ON THE COMPLEXITY OF MOTION PLANNING FOR MULTIPLE INDEPENDENT OBJECTS ; PSPACE HARDNESS OF THE " WAREHOUSEMAN ' S PROBLEM " . * * ) , 2022 .

[22]  Gordon T. Wilfong Motion planning in the presence of movable obstacles , 1988, SCG '88.

[23]  Mark H. Overmars,et al.  An Effective Framework for Path Planning Amidst Movable Obstacles , 2006, WAFR.

[24]  Esra Erdem,et al.  Geometric rearrangement of multiple movable objects on cluttered surfaces: A hybrid reasoning approach , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[25]  James J. Kuffner,et al.  Planning Among Movable Obstacles with Artificial Constraints , 2008, WAFR.

[26]  Silvio Savarese,et al.  Mechanical Search: Multi-Step Retrieval of a Target Object Occluded by Clutter , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[27]  Jingjin Yu,et al.  Toward Fast and Optimal Robotic Pick-and-Place on a Moving Conveyor , 2019, IEEE Robotics and Automation Letters.

[28]  Siddhartha S. Srinivasa,et al.  Robust trajectory selection for rearrangement planning as a multi-armed bandit problem , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[29]  Micha Sharir,et al.  Space-Aware Reconfiguration , 2020, Discrete & Computational Geometry.

[30]  Changjoo Nam,et al.  Where to relocate?: Object rearrangement inside cluttered and confined environments for robotic manipulation , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[31]  Eric Huang,et al.  Large-Scale Multi-Object Rearrangement , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[32]  Changjoo Nam,et al.  Fast and Resilient Manipulation Planning for Object Retrieval in Cluttered and Confined Environments , 2021, IEEE Transactions on Robotics.

[33]  Jun Ota,et al.  Rearrangement planning of multiple movable objects by using real-time search methodology , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[34]  Siddhartha S. Srinivasa,et al.  Object search by manipulation , 2013, 2013 IEEE International Conference on Robotics and Automation.

[35]  Leslie Pack Kaelbling,et al.  Reliably Arranging Objects in Uncertain Domains , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[36]  ChangHwan Kim,et al.  Efficient Obstacle Rearrangement for Object Manipulation Tasks in Cluttered Environments , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[37]  Kostas E. Bekris,et al.  Complexity Results and Fast Methods for Optimal Tabletop Rearrangement with Overhand Grasps , 2017, Int. J. Robotics Res..

[38]  Dinesh Manocha,et al.  Path Planning among Movable Obstacles: A Probabilistically Complete Approach , 2008, WAFR.

[39]  Siddhartha S. Srinivasa,et al.  A Planning Framework for Non-Prehensile Manipulation under Clutter and Uncertainty , 2012, Autonomous Robots.

[40]  Kostas E. Bekris,et al.  Dealing with Difficult Instances of Object Rearrangement , 2015, Robotics: Science and Systems.

[41]  Zherong Pan,et al.  Decision Making in Joint Push-Grasp Action Space for Large-Scale Object Sorting , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[42]  Kostas E. Bekris,et al.  Uniform Object Rearrangement: From Complete Monotone Primitives to Efficient Non-Monotone Informed Search , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Sergey Bereg,et al.  The Lifting Model for Reconfiguration , 2005, Discret. Comput. Geom..

[44]  Mehmet R. Dogar,et al.  Occlusion-Aware Search for Object Retrieval in Clutter , 2020, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[45]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[46]  Henrik I. Christensen,et al.  Locally optimal navigation among movable obstacles in unknown environments , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.