Grasping and Placing Operation for Labware Transportation in Life Science Laboratories using Mobile Robots

A R T I C L E I N F O A B S T R A C T Article history: Received: 06 June, 2017 Accepted: 07 July, 2017 Online: 21 July, 2017 In automated working environments, mobile robots can be used for different purposes such as material handling, domestic services, and objects transportation. This work presents a grasping and placing operation for multiple labware and tube racks in life science laboratories using the H20 mobile robots. The H20 robot has dual arms where each arm consists of 6 revolute joints with 6-DOF and 2-DOF grippers. The labware, which have to be manipulated and transported, contain chemical and biological components. Therefore, an accurate approach for object recognition and position estimation is required. The recognition and pose estimation of the desired objects are very essential to guide the robotic arm in the manipulation tasks. In this work, the problem statement of H20 transportation system with the proposed methodology are presented. Different strategies (visual and nonvisual) of labware manipulation using mobile robots are described. The H20 robot is equipped with a Kinect V2 sensor to identify and estimate the position of the target. The local features recognition based on SURF algorithm (Speeded-Up Robust Features) is used. The recognition process is performed for the required labware and holder to perform the grasping and placing operation. A strategy is proposed to find the required holder and to check its emptiness for the placing tasks. Different styles of grippers and labware containers are used to manipulate different weights of labware and to realize a safe transportation. The parts of mobile robot transportation system are communicated with each other using Asynchronous socket Channels.

[1]  Magnus Egerstedt,et al.  Humanoid robot teleoperation for tasks with power tools , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[2]  Kimitoshi Yamazaki,et al.  Recognition and manipulation integration for a daily assistive robot working on kitchen environments , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[3]  Yun Q. Shi,et al.  Identifying Computer Graphics using HSV Color Model and Statistical Moments of Characteristic Functions , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[4]  Michael Fiegert,et al.  Robust high precision 6 D pose determination in complex environments for robotic manipulation , 2010 .

[5]  Matei T. Ciocarlie,et al.  Towards Reliable Grasping and Manipulation in Household Environments , 2010, ISER.

[6]  Yu-Shan Chen,et al.  An intelligent service robot for transporting object , 2013, 2013 IEEE International Symposium on Industrial Electronics.

[7]  Zhi-Kai Huang,et al.  Segmentation of Color Image Using EM algorithm in HSV Color Space , 2007, 2007 International Conference on Information Acquisition.

[8]  Norbert Stoll,et al.  Intelligent scheduling method for life science automation systems , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[9]  Jae-Bok Song,et al.  Object tracking and visual servoing using features computed from local feature descriptor , 2010, ICCAS 2010.

[10]  Hui Liu,et al.  Intelligent arm manipulation system in life science labs using H20 mobile robot and Kinect sensor , 2016, 2016 IEEE 8th International Conference on Intelligent Systems (IS).

[11]  T. I. James Tsay,et al.  Development of a mobile robot for visually guided handling of material , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  C. S. George Lee,et al.  Closed-form inverse kinematic joint solution for humanoid robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[15]  Martin Hägele,et al.  Robotic home assistant Care-O-bot® 3 - product vision and innovation platform , 2009, 2009 IEEE Workshop on Advanced Robotics and its Social Impacts.

[16]  Han-Pang Huang,et al.  Stereo-based 3D localization for grasping known objects with a robotic arm system , 2011, 2011 9th World Congress on Intelligent Control and Automation.

[17]  Steffen Junginger,et al.  Mobile Robot for Life Science Automation , 2013 .

[18]  Larry S. Davis,et al.  Iterative Pose Estimation Using Coplanar Feature Points , 1996, Comput. Vis. Image Underst..

[19]  Norbert Stoll,et al.  A New Robust Method for Mobile Robot Multifloor Navigation in Distributed Life Science Laboratories , 2016 .

[20]  Hui Liu,et al.  A common wireless remote control system for mobile robots in laboratory , 2012, 2012 IEEE International Instrumentation and Measurement Technology Conference Proceedings.

[21]  Dmitry Berenson,et al.  Humanoid motion planning for dual-arm manipulation and re-grasping tasks , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Magnus Egerstedt,et al.  Kinematics and Inverse Kinematics for the Humanoid Robot HUBO2 , 2013 .

[23]  Norbert Stoll,et al.  An identification and localization approach of different labware for mobile robot transportation in life science laboratories , 2016, 2016 IEEE 17th International Symposium on Computational Intelligence and Informatics (CINTI).

[24]  Kerstin Thurow,et al.  Arm grasping for mobile robot transportation using Kinect sensor and kinematic analysis , 2015, 2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[25]  Jörg Stückler,et al.  Real-Time 3D Perception and Efficient Grasp Planning for Everyday Manipulation Tasks , 2011, ECMR.

[26]  J. R. Sanchez-Lopez,et al.  Visual Detection, Tracking and Pose Estimation of a Robotic Arm End Effector , 2011 .

[27]  Hui Liu,et al.  A backbone-floyd hybrid path planning method for mobile robot transportation in multi-floor life science laboratories , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[28]  Norbert Stoll,et al.  Kinematic Analysis of 6-DOF Arms for H20 Mobile Robots and Labware Manipulation for Transportation in Life Science Labs , 2016 .

[29]  Norbert Stoll,et al.  Multiple lab ware manipulation in life science laboratories using mobile robots , 2016, 2016 17th International Conference on Mechatronics - Mechatronika (ME).

[30]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[31]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .