Real-Time Large-Scale Fusion of High Resolution 3D Scans with Details Preservation

This paper presents a real-time 3D shape fusion system that faithfully integrates very high resolution 3D scans with the goal of maximizing details preservation. The system fully maps complex shapes while allowing free movement similarly to dense SLAM systems in robotics where sensor fusion techniques map large environments. We propose a novel framework to integrate shapes into a volume with fine details preservation of the reconstructed shape which is an important aspect in many applications, especially for industrial inspection. The truncated signed distance function is generalized with a global variational scheme that controls edge preservation and leads to updating cumulative rules adapted for GPU implementation. The framework also embeds a map deformation method to online deform the shape and correct the system trajectory drift at few microns accuracy. Results are presented from the integrated system on two mechanical objects which illustrate the benefits of the proposed approach.

[1]  Thomas Brox,et al.  Point-Based 3D Reconstruction of Thin Objects , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Niloy J. Mitra,et al.  Super4PCS: Fast Global Pointcloud Registration via Smart Indexing , 2019 .

[3]  M. Pauly,et al.  Embedded deformation for shape manipulation , 2007, SIGGRAPH 2007.

[4]  Yin Guo,et al.  Development and calibration of an integrated 3D scanning system for high-accuracy large-scale metrology , 2014 .

[5]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[6]  Matthias Nießner,et al.  BundleFusion , 2016, TOGS.

[7]  Rachid Deriche,et al.  Computing Optical Flow via Variational Techniques , 1999, SIAM J. Appl. Math..

[8]  Tim Weyrich,et al.  Real-Time 3D Reconstruction in Dynamic Scenes Using Point-Based Fusion , 2013, 2013 International Conference on 3D Vision.

[9]  Horst Bischof,et al.  A Globally Optimal Algorithm for Robust TV-L1 Range Image Integration , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[10]  Amar Mitiche,et al.  Dense 3D interpretation of image sequences: a variational approach using anisotropic diffusion , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[11]  Andrew W. Fitzgibbon,et al.  Large-scale and drift-free surface reconstruction using online subvolume registration , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Lena Maier-Hein,et al.  Convergent Iterative Closest-Point Algorithm to Accomodate Anisotropic and Inhomogenous Localization Error , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Joachim Weickert,et al.  Anisotropic Range Image Integration , 2012, DAGM/OAGM Symposium.

[14]  Guido Gerig,et al.  Nonlinear anisotropic filtering of MRI data , 1992, IEEE Trans. Medical Imaging.

[15]  Vladlen Koltun,et al.  Robust reconstruction of indoor scenes , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Nassir Navab,et al.  An Octree-Based Approach towards Efficient Variational Range Data Fusion , 2016, BMVC.

[17]  Sven Behnke,et al.  Approximate surface reconstruction and registration for RGB-D SLAM , 2015, 2015 European Conference on Mobile Robots (ECMR).

[18]  Ayan Chaudhury,et al.  A Method for Global Non-rigid Registration of Multiple Thin Structures , 2015, 2015 12th Conference on Computer and Robot Vision.

[19]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[20]  Luc Van Gool,et al.  In-hand scanning with online loop closure , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[21]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Stefan Leutenegger,et al.  ElasticFusion: Real-time dense SLAM and light source estimation , 2016, Int. J. Robotics Res..

[23]  V. Koltun,et al.  Robust Reconstruction of Indoor Scenes Supplementary Material , 2015 .

[24]  Guy Godin,et al.  High Resolution Projector for 3D Imaging , 2014, 2014 2nd International Conference on 3D Vision.

[25]  John J. Leonard,et al.  Real-time large-scale dense RGB-D SLAM with volumetric fusion , 2014, Int. J. Robotics Res..

[26]  Tim Weyrich,et al.  Anisotropic point-based fusion , 2015, 2015 18th International Conference on Information Fusion (Fusion).

[27]  Daniel Cohen-Or,et al.  4-points congruent sets for robust pairwise surface registration , 2008, ACM Trans. Graph..

[28]  Jean-Michel Morel,et al.  High Fidelity Scan Merging , 2010, Comput. Graph. Forum.

[29]  Michael Kaess,et al.  GravityFusion: Real-time dense mapping without pose graph using deformation and orientation , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).