ROS Framework for Perception and Dual-Arm Manipulation in Unstructured Environments

In a near future, robotic systems are expected to be able to confront more complex tasks in challenging scenarios. In this context, intelligent perception and dual-arm robotic manipulation capabilities are crucial for improving the autonomy and reliability of these systems. This paper addresses the development of an experimental platform conceived to facilitate the design and assessment of new perception and dual-arm control algorithms in unstructured environments. The proposed testbed is composed of a dual-arm robotic configuration endowed with a visual perception system and a simulation and control platform implemented in ROS (Robot Operating System). The robotic configuration consists of two manipulator arms of 6-DOF (Kinova MICO™) with brushless DC actuators controlled directly through PID controllers, whereas the perception system is formed by a high resolution RGB camera and a Time-of-Flight camera. ROS provides an open source collection of software frameworks, which simplify the task of creating complex and robust robot behaviours across a wide variety of robotic systems. The proposed approach will enable the easy testing and debugging of new applications with zero-risk damage to the real equipment.

[1]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[2]  Sotiris Makris,et al.  Intuitive dual arm robot programming for assembly operations , 2014 .

[3]  Liang Gong,et al.  Dual-arm Robot Design and Testing for Harvesting Tomato in Greenhouse , 2016 .

[4]  Aaron Martinez,et al.  Learning ROS for Robotics Programming , 2013 .

[5]  Saeid Nahavandi,et al.  Towards Trusted Autonomous Surgical Robots , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[6]  Alexandre Campeau-Lecours,et al.  Kinova Modular Robot Arms for Service Robotics Applications , 2017, Int. J. Robotics Appl. Technol..

[7]  Kerstin Thurow,et al.  Application of a Dual-Arm Robot in Complex Sample Preparation and Measurement Processes , 2016, Journal of laboratory automation.

[8]  Moharam Habibnejad Korayem,et al.  Symbolic derivation of governing equations for dual-arm mobile manipulators used in fruit-picking and the pruning of tall trees , 2014 .

[9]  Jianwei Zhang,et al.  Coordinated control of a dual-arm robot for surgical instrument sorting tasks , 2019, Robotics Auton. Syst..

[10]  Manuel A. Armada,et al.  A New Approach for Combining Time-of-Flight and RGB Cameras Based on Depth-Dependent Planar Projective Transformations , 2015, Sensors.

[11]  Luis Rodríguez Ruiz,et al.  XII Workshop of physical agents (WAF'2011) , 2012 .

[12]  Roemi Fernández,et al.  Multisensory System for Fruit Harvesting Robots. Experimental Testing in Natural Scenarios and with Different Kinds of Crops , 2014, Sensors.