Precise and efficient pose estimation of stacked objects for mobile manipulation in industrial robotics challenges

Object manipulation tasks such as picking up, carrying and placing should be executed based on the information of objects which are provided by the perception system. A precise and efficient pose estimation system has been developed to address the requirements and to achieve the objectives for autonomous packaging, specifically picking up of stacked non-rigid objects. For fine pose estimation, a drawing pin shaped kernel and pinhole filtering methods are used on the roughly estimated pose of objects. The system has been applied in a realistic industrial environment as a challenging scenario for the Challenge 2 – Shop Floor Logistics and Manipulation on a mobile manipulator in the context of the European Robotics Challenges (EuRoC) project. GRAPHICAL ABSTRACT

[1]  Svenja Kahn,et al.  Towards precise real-time 3D difference detection for industrial applications , 2013, Comput. Ind..

[2]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[3]  Kimitoshi Yamazaki,et al.  Survey of robotic manipulation studies intending practical applications in real environments -object recognition, soft robot hand, and challenge program and benchmarking- , 2017, Adv. Robotics.

[4]  Jadav Das,et al.  Passivity-based target manipulation inside a deformable object by a robotic system with noncollocated feedback , 2013, Adv. Robotics.

[5]  Rainer Bischoff,et al.  The Strategic Research Agenda for Robotics in Europe [Industrial Activities] , 2010 .

[6]  Arvind K. Ramadorai,et al.  A vision-based framework for the discovery-driven manipulation of non-rigid objects , 1996, Adv. Robotics.

[7]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[8]  Steve B. Furber,et al.  Spiking neural networks for computer vision , 2018, Interface Focus.

[9]  Peter F. Sturm,et al.  Pinhole Camera Model , 2014, Computer Vision, A Reference Guide.

[10]  Arie E. Kaufman,et al.  Fundamentals of Surface Voxelization , 1995, CVGIP Graph. Model. Image Process..

[11]  Luís Paulo Reis,et al.  Human-Robot Collaboration and Safety Management for Logistics and Manipulation Tasks , 2017, ROBOT.

[12]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[13]  Gi Hyun Lim,et al.  Towards lifelong assistive robotics: A tight coupling between object perception and manipulation , 2018, Neurocomputing.

[14]  Rainer Bischoff,et al.  Robotic Visions to 2020 and beyond -- The strategic research agenda for robotics in Europe , 2009 .

[15]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[16]  Luís Paulo Reis,et al.  Rich and robust human-robot interaction on gesture recognition for assembly tasks , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[17]  Jia Pan,et al.  Multi-contour initial pose estimation for 3D registration , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Bruno Siciliano,et al.  EuRoC - The Challenge Initiative for European Robotics , 2014, ISR 2014.

[19]  Luís Paulo Reis,et al.  Skill-based anytime agent architecture for logistics and manipulation tasks: EuRoC Challenge 2, Stage II - Realistic Labs: Benchmarking , 2017, 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[20]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  L. Gan,et al.  Development of Retinal Amacrine Cells and Their Dendritic Stratification , 2014, Current Ophthalmology Reports.

[22]  M. T. Hussein.  A review on vision-based control of flexible manipulators , 2015, Adv. Robotics.

[23]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[24]  Kunihiko Fukushima,et al.  Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition , 1982 .

[25]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Masayuki Inaba,et al.  Pick-and-verify: verification-based highly reliable picking system for various target objects in clutter , 2017, Adv. Robotics.

[27]  Huang-Chia Shih,et al.  SPiraL Aggregation Map (SPLAM): A new descriptor for robust template matching with fast algorithm , 2015, Pattern Recognit..