Depth image application in analysis of automatic 3D reconstruction

In this paper, we present an algorithm which can reconstruct arbitrary scene in real-time automatically by using depth image. ICP algorithm[3] will be used to estimate the pose of the depth sensor, after image was taken from depth sensor. Depth data will be fused into global model using signed distance function[4]. Finally, according to the Marching Cubes[2] algorithm, the model will be presented in real-time automatically. It is worth mentioning that practicing this algorithm, we just need to fix a commodity depth sensor on the robotic hand, and provide a trajectory for the robot to scan the scene, and the model will be generated in real-time. In the last part, experimental result will be shown. Overall, we can make a conclusion that using depth sensor to reconstruct scene in realtime is feasible. We believe that this method will be an excellence solution of simultaneous localization and mapping.

[1]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[2]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[3]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[4]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[5]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Mark J. Harris,et al.  Parallel Prefix Sum (Scan) with CUDA , 2011 .

[8]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[10]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.