Efficient next-best-scan planning for autonomous 3D surface reconstruction of unknown objects

This work focuses on autonomous surface reconstruction of small-scale objects with a robot and a 3D sensor. The aim is a high-quality surface model allowing for robotic applications such as grasping and manipulation. Our approach comprises the generation of next-best-scan (NBS) candidates and selection criteria, error minimization between scan patches and termination criteria. NBS candidates are iteratively determined by a boundary detection and surface trend estimation of the acquired model. To account for both a fast and high-quality model acquisition, that candidate is selected as NBS, which maximizes a utility function that integrates an exploration and a mesh-quality component. The modeling and scan planning methods are evaluated on an industrial robot with a high-precision laser striper system. While performing the new laser scan, data are integrated on-the-fly into both, a triangle mesh and a probabilistic voxel space. The efficiency of the system in fast acquisition of high-quality 3D surface models is proven with different cultural heritage, household and industrial objects.

[1]  G. Roth,et al.  View planning for automated three-dimensional object reconstruction and inspection , 2003, CSUR.

[2]  Gerd Hirzinger,et al.  The 3D-Modeller: A Multi-Purpose Vision Platform , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[3]  Anis Sahbani,et al.  An overview of 3D object grasp synthesis algorithms , 2012, Robotics Auton. Syst..

[4]  Paolo Cignoni,et al.  RoboScan: an automatic system for accurate and unattended 3D scanning , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[5]  David Fofi,et al.  View Planning Approach for Automatic 3D Digitization of Unknown Objects , 2012, ECCV Workshops.

[6]  Christopher Schwartz,et al.  A Multi-camera, Multi-projector Super-Resolution Framework for Structured Light , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[7]  Martial Hebert,et al.  A system for semi-automatic modeling of complex environments , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[8]  Richard Pito,et al.  A Solution to the Next Best View Problem for Automated Surface Acquisition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Tanneguy Redarce,et al.  A CAD-based 3D data acquisition strategy for inspection , 2003, Machine Vision and Applications.

[10]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Joachim Denzler,et al.  Online Next-Best-View Planning for Accuracy Optimization Using an Extended E-Criterion , 2010, 2010 20th International Conference on Pattern Recognition.

[12]  Michel Devy,et al.  Perception planning for an exploration task of a 3D environment , 2002, Object recognition supported by user interaction for service robots.

[13]  Anselmo Lastra,et al.  Efficient Constraint Evaluation Algorithms for Hierarchical Next-Best-View Planning , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[14]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[15]  Ruzena Bajcsy,et al.  Occlusions as a Guide for Planning the Next View , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[17]  Christophe Dumont,et al.  Next best view system in a 3D object modeling task , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[18]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[19]  Tim Bodenmüller,et al.  Streaming surface reconstruction from real time 3D-measurements , 2009 .

[20]  Robert Sitnik,et al.  On-line, collision-free positioning of a scanner during fully automated three-dimensional measurement of cultural heritage objects , 2012, Robotics Auton. Syst..

[21]  Zoltan-Csaba Marton,et al.  Combining object modeling and recognition for active scene exploration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Michael Suppa,et al.  Autonomous robot work cell exploration using multisensory eye-in-hand systems , 2008 .

[23]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[24]  Gerd Hirzinger,et al.  Multi-scale 3D-Modeling , 2006, PSIVT.

[25]  Peter Liepa,et al.  Filling Holes in Meshes , 2003, Symposium on Geometry Processing.

[26]  Kamal K. Gupta,et al.  An autonomous six-DOF eye-in-hand system for in situ 3D object modeling , 2012, Int. J. Robotics Res..

[27]  Gaurav S. Sukhatme,et al.  Next Best View Estimation With Eye In Hand Camera , 2011, IROS 2011.

[28]  Darius Burschka,et al.  The self-referenced DLR 3D-modeler , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Sören Larsson,et al.  Path planning for laser scanning with an industrial robot , 2008, Robotics Auton. Syst..

[30]  TREND SURFACE ANALYSIS-A REVIEW , 2004 .

[31]  Luis Enrique Sucar,et al.  View planning for 3D object reconstruction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Robert B. Fisher,et al.  A Best Next View Selection Algorithm Incorporating a Quality Criterion , 1998, BMVC.

[33]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[34]  Shengyong Chen,et al.  Vision sensor planning for 3-D model acquisition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[36]  Benjamin Loriot,et al.  Non-Model Based Method for an Automation of 3D Acquisition and Post-Processing , 2009 .

[37]  Rüdiger Dillmann,et al.  The KIT object models database: An object model database for object recognition, localization and manipulation in service robotics , 2012, Int. J. Robotics Res..

[38]  Shengyong Chen,et al.  Active vision in robotic systems: A survey of recent developments , 2011, Int. J. Robotics Res..

[39]  Peter K. Allen,et al.  Data acquisition and view planning for 3-D modeling tasks , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Gerd Hirzinger,et al.  Next-best-scan planning for autonomous 3D modeling , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Wolfram Burgard,et al.  OctoMap : A Probabilistic , Flexible , and Compact 3 D Map Representation for Robotic Systems , 2010 .

[42]  Carme Torras,et al.  Information-Gain View Planning for Free-Form Object Reconstruction with a 3D ToF Camera , 2012, ACIVS.

[43]  Gerd Hirzinger,et al.  A surface-based Next-Best-View approach for automated 3D model completion of unknown objects , 2011, 2011 IEEE International Conference on Robotics and Automation.

[44]  Claire Lartigue,et al.  Scan Planning Strategy for a General Digitized Surface , 2006, J. Comput. Inf. Sci. Eng..

[45]  Christophe Dumont,et al.  A next-best-view system for autonomous 3-D object reconstruction , 2000, IEEE Trans. Syst. Man Cybern. Part A.