Planning a Sequence of Base Positions for a Mobile Manipulator to Perform Multiple Pick-and-Place Tasks

In this paper, we present a planner that plans a sequence of base positions for a mobile manipulator to efficiently and robustly collect objects stored in distinct trays. We achieve high efficiency by exploring the common areas where a mobile manipulator can grasp objects stored in multiple trays simultaneously and move the mobile manipulator to the common areas to reduce the time needed for moving the mobile base. We ensure robustness by optimizing the base position with the best clearance to positioning uncertainty so that a mobile manipulator can complete the task even if there is a certain deviation from the planned base positions. Besides, considering different styles of object placement in the tray, we analyze feasible schemes for dynamically updating the base positions based on either the remaining objects or the target objects to be picked in one round of the tasks. In the experiment part, we examine our planner on various scenarios, including different object placement: (1) Regularly placed toy objects; (2) Randomly placed industrial parts; and different schemes for online execution: (1) Apply globally static base positions; (2) Dynamically update the base positions. The experiment results demonstrate the efficiency, robustness and feasibility of the proposed method.

[1]  Takeo Kanade,et al.  Automated Construction of Robotic Manipulation Programs , 2010 .

[2]  Fumio Kanehiro,et al.  Fast grasp planning for hand/arm systems based on convex model , 2008, 2008 IEEE International Conference on Robotics and Automation.

[3]  Tamim Asfour,et al.  Robot placement based on reachability inversion , 2013, 2013 IEEE International Conference on Robotics and Automation.

[4]  Konstantinos-Dionysios Bouzakis,et al.  Determination of optimum robot base location considering discrete end-effector positions by means of hybrid genetic algorithm , 2008 .

[5]  Maxim Likhachev,et al.  Planning with adaptive dimensionality for mobile manipulation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[6]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[7]  Xiaoping Yun,et al.  Unified analysis on mobility and manipulability of mobile manipulators , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[8]  Giuseppe Oriolo,et al.  Kinematic modeling and redundancy resolution for nonholonomic mobile manipulators , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[9]  Jeffrey C. Trinkle,et al.  Orientation-based reachability map for robot base placement , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Saïd Zeghloul,et al.  Multi-criteria optimal placement of robots in constrained environments , 1993, Robotica.

[11]  Robert Muszynski,et al.  Instantaneous kinematics and dexterity of mobile manipulators , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[12]  Giulio Sandini,et al.  Autonomous online generation of a motor representation of the workspace for intelligent whole-body reaching , 2014, Robotics Auton. Syst..

[13]  Kensuke Harada,et al.  Planning an Efficient and Robust Base Sequence for a Mobile Manipulator Performing Multiple Pick-and-place Tasks , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Christoph Borst,et al.  Hybrid Reasoning for Mobile Manipulation based on Object Knowledge , 2013 .

[15]  Michael Beetz,et al.  Learning and Reasoning with Action-Related Places for Robust Mobile Manipulation , 2014, J. Artif. Intell. Res..

[16]  Dmitry Berenson,et al.  Humanoid motion planning for dual-arm manipulation and re-grasping tasks , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Fumio Kanehiro,et al.  Planning Grasps With Suction Cups and Parallel Grippers Using Superimposed Segmentation of Object Meshes , 2020, IEEE Transactions on Robotics.

[18]  Satyandra K. Gupta,et al.  Identifying Feasible Workpiece Placement with Respect to Redundant Manipulator for Complex Manufacturing Tasks , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[19]  Ken Chen,et al.  A Method for Optimizing the Base Position of Mobile Painting Manipulators , 2017, IEEE Transactions on Automation Science and Engineering.

[20]  Krzysztof Tchori,et al.  Instantaneous kinematics and dexterity of mobile manipulators , 2000 .

[21]  Jing Zhao,et al.  Optimal Base Placement and Motion Planning for Mobile Manipulators , 2012 .

[22]  Dmitry Berenson,et al.  An optimization approach to planning for mobile manipulation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[23]  Jonathan Claassens,et al.  An analytical solution for the inverse kinematics of a redundant 7DoF Manipulator with link offsets , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Daniel King,et al.  Fetch & Freight : Standard Platforms for Service Robot Applications , 2016 .

[25]  Venkat N. Krovi,et al.  Experimental Evaluation of Dynamic Redundancy Resolution in a Nonholonomic Wheeled Mobile Manipulator , 2007, IEEE/ASME Transactions on Mechatronics.

[26]  Kazuhiro Kosuge,et al.  Analytical Inverse Kinematic Computation for 7-DOF Redundant Manipulators With Joint Limits and Its Application to Redundancy Resolution , 2008, IEEE Transactions on Robotics.

[27]  François G. Pin,et al.  Multi-criteria position and configuration optimization for redundant platform/manipulator systems , 1990, EEE International Workshop on Intelligent Robots and Systems, Towards a New Frontier of Applications.

[28]  P. Kolesar A Branch and Bound Algorithm for the Knapsack Problem , 1967 .

[29]  John T. Feddema Kinematically optimal robot placement for minimum time coordinated motion , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[30]  Michael Beetz,et al.  Positioning mobile manipulators to perform constrained linear trajectories , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Homayoun Seraji,et al.  An on-line approach to coordinated mobility and manipulation , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[32]  Gerd Hirzinger,et al.  Capturing robot workspace structure: representing robot capabilities , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Rüdiger Dillmann,et al.  Efficient Inverse Kinematics Computation Based on Reachability Analysis , 2012, Int. J. Humanoid Robotics.

[34]  Daniel M. Bodily,et al.  Motion planning for mobile robots using inverse kinematics branching , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Bernard Bayle,et al.  Manipulability of Wheeled Mobile Manipulators: Application to Motion Generation , 2003 .

[36]  David Hsu,et al.  Placing a robot manipulator amid obstacles for optimized execution , 1999, Proceedings of the 1999 IEEE International Symposium on Assembly and Task Planning (ISATP'99) (Cat. No.99TH8470).

[37]  S. Dreyfus,et al.  Thermodynamical Approach to the Traveling Salesman Problem : An Efficient Simulation Algorithm , 2004 .

[38]  Maren Bennewitz,et al.  Stance selection for humanoid grasping tasks by inverse reachability maps , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Shantanu Thakar,et al.  Accounting for Part Pose Estimation Uncertainties during Trajectory Generation for Part Pick-Up Using Mobile Manipulators , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[40]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[41]  Kazuhiko Sumi,et al.  Fast graspability evaluation on single depth maps for bin picking with general grippers , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[42]  Rouhollah Rahmatizadeh,et al.  A Real-Time Technique for Positioning a Wheelchair-Mounted Robotic Arm for Household Manipulation Tasks , 2016, AAAI Workshop: Artificial Intelligence Applied to Assistive Technologies and Smart Environments.