Dexterous Grasping by Manipulability Selection for Mobile Manipulator With Visual Guidance

Industry 4.0 demands the heavy usage of robotic mobile manipulators with high autonomy and intelligence. The goal is to accomplish dexterous manipulation tasks without prior knowledge of the object status in unstructured environments. It is important for the mobile manipulator to recognize and detect the objects, determine manipulation pose, and adjust its pose in the workspace fast and accurately. In this research, we developed a stereo vision algorithm for the object pose estimation using point cloud data from multiple stereo vision systems. An improved iterative closest point algorithm method is developed for the pose estimation. With the pose input, algorithms and several criteria are studied for the robot to select and adjust its pose by maximizing its manipulability on a given manipulation task. The performance of each technical module and the complete robotic system is finally shown by the virtual robot in the simulator and real robot in experiments. This study demonstrates a setup of autonomous mobile manipulator for various flexible manufacturing and logistical scenarios.

[1]  Miroslav Pajic,et al.  Recognition of Planar Segments in Point Cloud Based on Wavelet Transform , 2015, IEEE Transactions on Industrial Informatics.

[2]  Chao Zeng,et al.  A Learning Framework of Adaptive Manipulative Skills From Human to Robot , 2019, IEEE Transactions on Industrial Informatics.

[3]  Tamim Asfour,et al.  Integrated Grasp and motion planning , 2010, 2010 IEEE International Conference on Robotics and Automation.

[4]  Roland Siegwart,et al.  Comparing ICP variants on real-world data sets , 2013, Auton. Robots.

[5]  K. Sridharan,et al.  Real-Time SURF-Based Video Stabilization System for an FPGA-Driven Mobile Robot , 2016, IEEE Transactions on Industrial Electronics.

[6]  Murat Cenk Cavusoglu,et al.  Optimal needle grasp selection for automatic execution of suturing tasks in robotic minimally invasive surgery , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Ole Madsen,et al.  Autonomous industrial mobile manipulation (AIMM): past, present and future , 2012, Ind. Robot.

[8]  Ferdinando Cannella,et al.  Design of a novel dexterous robotic gripper for in-hand twisting and positioning within assembly automation , 2015 .

[9]  Rajiv V. Dubey,et al.  A weighted least-norm solution based scheme for avoiding joint limits for redundant joint manipulators , 1993, IEEE Trans. Robotics Autom..

[10]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[11]  Darwin G. Caldwell,et al.  Robust object localization based on error patterns learning for dexterous mobile manipulation , 2016, 2016 International Conference on Advanced Robotics and Mechatronics (ICARM).

[12]  Bruno Siciliano,et al.  Closed-Loop Inverse Kinematics Schemes for Constrained Redundant Manipulators with Task Space Augmentation and Task Priority Strategy , 1991, Int. J. Robotics Res..

[13]  Tamim Asfour,et al.  Robot placement based on reachability inversion , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  S. Sathiya Keerthi,et al.  A fast procedure for computing the distance between complex objects in three-dimensional space , 1988, IEEE J. Robotics Autom..

[15]  H. Hirschmüller Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[16]  David E. Orin,et al.  Constrained resolved acceleration control for humanoids , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[18]  Rajiv V. Dubey,et al.  A weighted least-norm solution based scheme for avoiding joint limits for redundant manipulators , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[19]  Dah-Jye Lee,et al.  Review of stereo vision algorithms and their suitability for resource-limited systems , 2013, Journal of Real-Time Image Processing.

[20]  Bruno Siciliano,et al.  EuRoC - The Challenge Initiative for European Robotics , 2014, ISR 2014.

[21]  Ole Madsen,et al.  The mobile robot “Little Helper”: Concepts, ideas and working principles , 2009, 2009 IEEE Conference on Emerging Technologies & Factory Automation.

[22]  Stefano Stramigioli,et al.  Port-hamiltonian modeling for soft-finger manipulation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Joachim Schuler Integration von Förder- und Handhabungseinrichtungen , 1987 .

[24]  Gustavo S. Viana,et al.  Supervisory Control-Based Navigation Architecture: A New Framework for Autonomous Robots in Industry 4.0 Environments , 2018, IEEE Transactions on Industrial Informatics.

[25]  Tamim Asfour,et al.  Extracting whole-body affordances from multimodal exploration , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[26]  Darwin G. Caldwell,et al.  Enhancing bilateral teleoperation using camera-based online virtual fixtures generation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Maren Bennewitz,et al.  Stance selection for humanoid grasping tasks by inverse reachability maps , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Fuchun Sun,et al.  Visual–Tactile Fusion for Object Recognition , 2017, IEEE Transactions on Automation Science and Engineering.

[29]  Jian Huang,et al.  Set-Membership-Based Fault Detection and Isolation for Robotic Assembly of Electrical Connectors , 2018, IEEE Transactions on Automation Science and Engineering.

[30]  Giulio Sandini,et al.  Manipulability analysis , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[31]  K. Schwab The Fourth Industrial Revolution , 2013 .

[32]  Naoyuki Kubota,et al.  Self-Localization Based on Multiresolution Map for Remote Control of Multiple Mobile Robots , 2013, IEEE Transactions on Industrial Informatics.

[33]  Fuchun Sun,et al.  Multimodal Measurements Fusion for Surface Material Categorization , 2018, IEEE Transactions on Instrumentation and Measurement.