View Planning for 3D Reconstruction Using Time-of-Flight Camera Data

Solving the next best view (NBV) problem is an important task for automated 3D reconstruction. An NBV algorithm provides sensor positions, from which maximal information gain about the measurement object during the next scan can be expected. With no or limited information available during the first views, automatic data driven view planning performs suboptimal. In order to overcome these inefficiencies during startup phase, we examined the use of time-of-flight (TOF) camera data to improve view planning. The additional low resolution 3D information, gathered during sensor movement, allows to plan even the first scans customized to previously unknown objects. Measurement examples using a robot mounted fringe projection stereo 3D scanner with a TOF camera are presented.

[1]  Richard Pito,et al.  A Solution to the Next Best View Problem for Automated Surface Acquisition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  J. E. Banta,et al.  Autonomous placement of a range sensor for acquisition of optimal 3-D models , 1996, Proceedings of the 1996 IEEE IECON. 22nd International Conference on Industrial Electronics, Control, and Instrumentation.

[3]  Roberto Cipolla,et al.  Probabilistic visibility for multi-view stereo , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Youfu Li,et al.  Information entropy-based viewpoint planning for 3-D object reconstruction , 2005, IEEE Transactions on Robotics.

[5]  Robert B. Fisher,et al.  A Best Next View Selection Algorithm Incorporating a Quality Criterion , 1998, BMVC.

[6]  Reinhard Koch,et al.  Pose estimation and map building with a Time-Of-Flight-camera for robot navigation , 2008, Int. J. Intell. Syst. Technol. Appl..

[7]  Shengyong Chen,et al.  Vision sensor planning for 3-D model acquisition , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  A. Lastra,et al.  An Adaptive Hierarchical Next-Best-View Algorithm for 3D Reconstruction of Indoor Scenes , 2006 .

[9]  Joachim Denzler,et al.  An Information Theoretic Approach for Next Best View Planning in 3-D Reconstruction , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  K. Creath.  Temporal Phase Measurement Methods , 1993 .

[11]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[12]  Peter Kovesi,et al.  Automatic Sensor Placement from Vision Task Requirements , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Joachim Denzler,et al.  Benchmarking 3D Reconstructions from Next Best View Planning , 2007, MVA.

[14]  Christian Bräuer-Burchardt,et al.  3D shape measurement with phase correlation based fringe projection , 2007, SPIE Optical Metrology.