Global registration of mid-range 3D observations and short range next best views

This work proposes a method for autonomous robot exploration of unknown objects by sensor fusion of 3D range data. The approach aims at overcoming the physical limitation of the minimum sensing distance of range sensors. Two range sensors are used with complementary characteristics mounted in eye-in-hand configuration on a robot arm. The first sensor operates at mid-range and is used in the initial phase of exploration when the environment is unknown. The second sensor, which provides short-range data, is used in the following phase where the objects are explored at close distance through next best view planning. Next best view planning is performed using a volumetric representation of the environment. A complete point cloud model of each object is finally computed by global registration of all object observations including mid-range and short range views. In experiments performed in environments with multiple rigid objects the global registration algorithm has proven more accurate than a standard sequential registration approach.

[1]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[3]  Stefano Caselli,et al.  Object categorization and grasping by parts from range scan data , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  Christophe Dumont,et al.  A next-best-view system for autonomous 3-D object reconstruction , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[5]  Roberto Toldo,et al.  Global registration of multiple point clouds embedding the Generalized Procrustes Analysis into an ICP framework , 2010 .

[6]  Hongbin Zha,et al.  Next Best Viewpoint (NBV) Planning for Active Object Modeling Based on a Learning-by-Showing Approach , 1998, ACCV.

[7]  Richard Pito,et al.  A Solution to the Next Best View Problem for Automated Surface Acquisition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Matthias Zwicker,et al.  Global registration of dynamic range scans for articulated model reconstruction , 2011, TOGS.

[9]  Dieter Fox,et al.  Manipulator and object tracking for in-hand 3D object modeling , 2011, Int. J. Robotics Res..

[10]  Justus H. Piater,et al.  Development of Object and Grasping Knowledge by Robot Exploration , 2010, IEEE Transactions on Autonomous Mental Development.

[11]  John B. Moore,et al.  Global registration of multiple 3D point sets via optimization-on-a-manifold , 2005, SGP '05.

[12]  Peter K. Allen,et al.  Constraint-based sensor planning for scene modeling , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[13]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Tamim Asfour,et al.  Autonomous acquisition of visual multi-view object representations for object recognition on a humanoid robot , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  C. Ian Connolly,et al.  The determination of next best views , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[16]  Kamal K. Gupta,et al.  Integrated view and path planning for an autonomous six-DOF eye-in-hand object modeling system , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Hongbin Zha,et al.  Next best viewpoint (NBV) planning for active object modeling based on a learning-by-showing approach , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[18]  Gerd Hirzinger,et al.  Next-best-scan planning for autonomous 3D modeling , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Luis Enrique Sucar,et al.  View planning for 3D object reconstruction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Shengyong Chen,et al.  Vision sensor planning for 3-D model acquisition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Dmitry Berenson,et al.  Grasp planning in complex scenes , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[22]  Youfu Li,et al.  Information entropy-based viewpoint planning for 3-D object reconstruction , 2005, IEEE Transactions on Robotics.

[23]  Kostas Daniilidis,et al.  Fully Automatic Registration of 3D Point Clouds , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[24]  Zoltan-Csaba Marton,et al.  Combining object modeling and recognition for active scene exploration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Masayuki Inaba,et al.  On-line next best grasp selection for in-hand object 3D modeling with dual-arm coordination , 2012, 2012 IEEE International Conference on Robotics and Automation.

[26]  Denis Laurendeau,et al.  A Global Registration Method Based on the Vector Field Representation , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[27]  Yong Yu,et al.  C-space Entropy: A Measure for View Planning and Exploration for General Robot-Sensor Systems in Unknown Environments , 2004, Int. J. Robotics Res..

[28]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[29]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[30]  Carme Torras,et al.  Object modeling using a ToF camera under an uncertainty reduction approach , 2010, 2010 IEEE International Conference on Robotics and Automation.

[31]  Michel Drouin,et al.  Automatic observation for 3D reconstruction of unknown objects using visual servoing , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Wolfram Burgard,et al.  Transformed polynomials for global registration of point clouds , 2011, SCC.

[33]  Frank P. Ferrie,et al.  Autonomous exploration: driven by uncertainty , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.