Real-time reconstruction of depth sequences using signed distance functions

With the recent influx of inexpensive depth sensors such as the Microsoft Kinect, systems for 3D reconstruction and visual odometry utilizing depth information have garnered new interest. Often these processes are highly parallel and can be realized in real-time through parallel computing architectures for the GPU. We represent fused depth maps as a Truncated Signed Distance Function (TSDF) which is a grid of voxels that contain the distance to the nearest surface. Point clouds of subsequent captures are aligned to the TSDF volume through error minimization, taking advantage of the fact that surfaces are implicitly defined where the distance is zero. We present a new method for minimizing the error based on absolute orientation that does not require linearization or a weighting function. To evaluate the proposed method we compare the number of iterations required for convergence, time per iteration, and final alignment error with existing Gauss-Newton nonlinear minimization methods. While we use the Microsoft Kinect due to its fused depth and color capabilities, the alignment only requires depth and is applicable to current active fused lidar systems with VNIR, SWIR, MWIR or LWIR sensors.

[1]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Daniel Ricao Canelhas Scene Representation, Registration and ObjectDetection in a Truncated Signed Distance FunctionRepresentation of 3D Space , 2012 .

[3]  S. Umeyama,et al.  Least-Squares Estimation of Transformation Parameters Between Two Point Patterns , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[5]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[6]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[7]  Hongkai Zhao,et al.  A fast sweeping method for Eikonal equations , 2004, Math. Comput..

[8]  Daniel Cremers,et al.  Real-Time Camera Tracking and 3D Reconstruction Using Signed Distance Functions , 2013, Robotics: Science and Systems.

[9]  Minh N. Do,et al.  Registration and integration of multiple depth images using signed distance function , 2012, Electronic Imaging.

[10]  Peter-Pike J. Sloan,et al.  Interactive ray tracing for isosurface rendering , 1998 .

[11]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[12]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[13]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.