3D Moving Object Reconstruction by Temporal Accumulation

Much progress has been made recently in the development of 3D acquisition technologies, which increased the availability of low-cost 3D sensors, such as the Microsoft Kinect. This promotes a wide variety of computer vision applications needing object recognition and 3D reconstruction. We present a novel algorithm for full 3D reconstruction of unknown rotating objects in 2.5D point cloud sequences, such as those generated by 3D sensors. Our algorithm incorporates structural and temporal motion information to build 3D models of moving objects and is based on motion compensated temporal accumulation. The proposed algorithm requires only the fixed centre or axis of rotation, unlike other 3D reconstruction methods, it does not require key point detection, feature description, correspondence matching, provided object models or any geometric information about the object. Moreover, our algorithm integrally estimates the best rigid transformation parameters for registration, applies surface resembling, reduces noise and estimates the optimum angular velocity of the rotating object.

[1]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[2]  Leonidas J. Guibas,et al.  Robust global registration , 2005, SGP '05.

[3]  Kostas Daniilidis,et al.  Fully Automatic Registration of 3D Point Clouds , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Federico Tombari,et al.  Performance Evaluation of 3D Keypoint Detectors , 2012, International Journal of Computer Vision.

[6]  Luc Van Gool,et al.  Accurate and robust registration for in-hand modeling , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[8]  Nico Blodow,et al.  Towards 3D object maps for autonomous household robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Stefano Carpin,et al.  HSM3D: Feature-less global 6DOF scan-matching in the Hough/Radon domain , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Ko Nishino,et al.  Scale-Dependent/Invariant Local 3D Shape Descriptors for Fully Automatic Registration of Multiple Sets of Range Images , 2008, ECCV.

[11]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[12]  C. J. Taylor,et al.  Minimization on the Lie Group SO(3) and Related Manifolds , 1994 .

[13]  Paul H. Lewis,et al.  Extracting moving shapes by evidence gathering , 2002, Pattern Recognit..

[14]  John Illingworth,et al.  3DSVHT: Extraction of 3D Linear Motion via Multi-view, Temporal Evidence Accumulation , 2005, ACIVS.

[15]  Mark S. Nixon,et al.  On automated model-based extraction and analysis of gait , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[16]  Luc Van Gool,et al.  In-hand scanning with online loop closure , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[17]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[18]  David Fofi,et al.  A review of recent range image registration methods with accuracy evaluation , 2007, Image Vis. Comput..

[19]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[20]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[21]  Sebastian Thrun,et al.  Precision tracking with sparse 3D and dense color 2D data , 2013, 2013 IEEE International Conference on Robotics and Automation.

[22]  Mark S. Nixon,et al.  Detecting moving spheres in 3D point clouds via the 3D velocity Hough Transform , 2013, IVMSP 2013.