Robust feature extraction for 3D reconstruction of boundary segmented objects in a robotic Library scenario

In this paper a vision system for robust feature extraction and 3D reconstruction of boundary segmented objects is presented. The goal of the system is reliable perception of a professional life environment in a scenario of the rehabilitation robot FRIEND. Reconstructed scenes are used to plan object manipulation with a 7-DoF manipulator arm. The robustness of boundary feature extraction is achieved by the means of including feedback control at image segmentation level. The objective of feedback is to adjust the segmentation parameters in order to cope with scene uncertainties, such as variable illumination conditions. Robustly extracted 2D object features are provided as input to the 3D object reconstruction module of the FRIEND vision system. The performance of the proposed approach is evaluated through experiments in the Library scenario of the robotic system FRIEND.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Danijela Ristic-Durrant,et al.  ROVIS: Robust machine vision for service robotic system FRIEND , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Tamim Asfour,et al.  Toward humanoid manipulation in human-centred environments , 2008, Robotics Auton. Syst..

[4]  Majid Mirmehdi,et al.  Feedback control strategies for object recognition , 1999, IEEE Trans. Image Process..

[5]  Michael Beetz,et al.  3D model selection from an internet database for robotic vision , 2009, 2009 IEEE International Conference on Robotics and Automation.

[6]  J.M. Zoellner,et al.  Integration of 6D Object Localization and Obstacle Detection for Collision Free Robotic Manipulation , 2008, 2008 IEEE/SICE International Symposium on System Integration.

[7]  Oleg Ivlev,et al.  Rehabilitation Robots FRIEND-I and FRIEND-II with the dexterous lightweight manipulator , 2005 .

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  Danica Kragic,et al.  Advances in robot vision , 2005, Robotics Auton. Syst..

[10]  Danica Kragic,et al.  Vision for robotic object manipulation in domestic settings , 2005, Robotics Auton. Syst..

[11]  Björn Johansson,et al.  Comparison of local image descriptors for full 6 degree-of-freedom pose estimation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[12]  Matei T. Ciocarlie,et al.  The Columbia grasp database , 2009, 2009 IEEE International Conference on Robotics and Automation.

[13]  Bir Bhanu,et al.  Closed-loop object recognition using reinforcement learning , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Axel Gräser,et al.  Camera Calibration for Reliable Object Manipulation in Care-Providing Robot FRIEND , 2010, ISR/ROBOTIK.

[15]  Ashutosh Saxena,et al.  Learning 3-D object orientation from images , 2009, 2009 IEEE International Conference on Robotics and Automation.

[16]  Nico Blodow,et al.  Close-range scene segmentation and reconstruction of 3D point cloud maps for mobile manipulation in domestic environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.