Signed Distance Fields for Rigid and Deformable 3D Reconstruction

This thesis addresses the tasks of 3D reconstruction of rigid and deformable objects and scenes, scanned with a single handheld RGB-D sensor. To this end, we propose an implicit-to-implicit alignment scheme between pairs of signed distance fields. We first apply it for reconstructing household objects, achieving higher trajectory and model precision than existing approaches, and then adapt it to larger scenes. Finally, we extend it to reconstruct moving objects that undergo topological changes and large motion, which are challenging for previous methods.

[1]  Wolfram Burgard,et al.  An evaluation of the RGB-D SLAM system , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  M. Pauly,et al.  Embedded deformation for shape manipulation , 2007, SIGGRAPH 2007.

[4]  Frank Dellaert,et al.  Structure from motion without correspondence , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Hugh F. Durrant-Whyte,et al.  Simultaneous map building and localization for an autonomous mobile robot , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[6]  Dimitris N. Metaxas,et al.  Textured Liquids based on the Marker Level Set , 2007, Comput. Graph. Forum.

[7]  Dimitris N. Metaxas,et al.  The marker level set method: applications to simulation of liquids , 2007 .

[8]  Andrew W. Fitzgibbon,et al.  Fits Like a Glove: Rapid and Reliable Hand Shape Personalization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Sheng-Wen Shih,et al.  An Efficient and Accurate Method for the Relaxation of Multiview Registration Error , 2008, IEEE Transactions on Image Processing.

[10]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[11]  Nassir Navab,et al.  SDF-2-SDF: Highly Accurate 3D Object Reconstruction , 2016, ECCV.

[12]  Andrew W. Fitzgibbon,et al.  Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences , 2016, ACM Trans. Graph..

[13]  Peter Johannes Neugebauer,et al.  Geometrical cloning of 3D objects via simultaneous registration of multiple range images , 1997, Proceedings of 1997 International Conference on Shape Modeling and Applications.

[14]  Matthias Nießner,et al.  Real-time 3D reconstruction at scale using voxel hashing , 2013, ACM Trans. Graph..

[15]  Nassir Navab,et al.  Volumetric 3D Tracking by Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Maziar Loghman,et al.  Real-Time Refinement of Kinect Depth Maps using Multi-Resolution Anisotropic Diffusion , 2014, Mob. Networks Appl..

[17]  Stefan Leutenegger,et al.  ElasticFusion: Real-time dense SLAM and light source estimation , 2016, Int. J. Robotics Res..

[18]  Jiawen Chen,et al.  Scalable real-time volumetric surface reconstruction , 2013, ACM Trans. Graph..

[19]  Vladlen Koltun,et al.  Elastic Fragments for Dense Scene Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[20]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[21]  Andrew W. Fitzgibbon,et al.  Large-scale and drift-free surface reconstruction using online subvolume registration , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[23]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[24]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[26]  Alexander M. Bronstein,et al.  Fully Spectral Partial Shape Matching , 2017, Comput. Graph. Forum.

[27]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[28]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[29]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[30]  Martin Rumpf,et al.  Robust feature detection and local classification for surfaces based on moment analysis , 2004, IEEE Transactions on Visualization and Computer Graphics.

[31]  Frank Plastria,et al.  On the point for which the sum of the distances to n given points is minimum , 2009, Ann. Oper. Res..

[32]  Luís A. Alexandre 3D Descriptors for Object and Category Recognition: a Comparative Evaluation , 2012 .

[33]  Dieter Fox,et al.  DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Matthias Nießner,et al.  State of the Art on 3D Reconstruction with RGB‐D Cameras , 2018, Comput. Graph. Forum.

[35]  Michael J. Black,et al.  Efficient sparse-to-dense optical flow estimation using a learned basis and layers , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Wojciech Matusik,et al.  Articulated mesh animation from multi-view silhouettes , 2008, ACM Trans. Graph..

[37]  David W. Murray,et al.  Simultaneous Localization and Map-Building Using Active Vision , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Bruno Lévy,et al.  Laplace-Beltrami Eigenfunctions Towards an Algorithm That "Understands" Geometry , 2006, IEEE International Conference on Shape Modeling and Applications 2006 (SMI'06).

[39]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[40]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[41]  Daniel Cremers,et al.  Dense visual SLAM for RGB-D cameras , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[42]  Nassir Navab,et al.  Coloured signed distance fields for full 3D object reconstruction , 2014, BMVC.

[43]  Shahram Izadi,et al.  Modeling Kinect Sensor Noise for Improved 3D Reconstruction and Tracking , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[44]  Matthias Nießner,et al.  BundleFusion , 2016, TOGS.

[45]  Marsette Vona,et al.  Moving Volume KinectFusion , 2012, BMVC.

[46]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[47]  Daniel B. Kubacki Signed distance registration for depth image sequence , 2011 .

[48]  Maximilian Baust,et al.  Variational Level Set Evolution for Non-Rigid 3D Reconstruction From a Single Depth Camera , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Stefan Leutenegger,et al.  ElasticFusion: Dense SLAM Without A Pose Graph , 2015, Robotics: Science and Systems.

[50]  James Diebel,et al.  Representing Attitude : Euler Angles , Unit Quaternions , and Rotation Vectors , 2006 .

[51]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[52]  Achim J. Lilienthal,et al.  SDF Tracker: A parallel algorithm for on-line pose estimation and scene reconstruction from depth images , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[53]  Minh N. Do,et al.  Registration and integration of multiple depth images using signed distance function , 2012, Electronic Imaging.

[54]  Andrew W. Fitzgibbon,et al.  Automatic Camera Recovery for Closed or Open Image Sequences , 1998, ECCV.

[55]  Takeshi Masuda,et al.  Registration and Integration of Multiple Range Images by Matching Signed Distance Fields for Object Shape Modeling , 2002, Comput. Vis. Image Underst..

[56]  Achim J. Lilienthal,et al.  Point set registration through minimization of the L2 distance between 3D-NDT models , 2012, 2012 IEEE International Conference on Robotics and Automation.

[57]  Olga Sorkine-Hornung,et al.  On Linear Variational Surface Deformation Methods , 2008, IEEE Transactions on Visualization and Computer Graphics.

[58]  Sami Romdhani,et al.  Optimal Step Nonrigid ICP Algorithms for Surface Registration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[59]  Slobodan Ilic,et al.  A Bayesian Approach to Multi-view 4D Modeling , 2015, International Journal of Computer Vision.

[60]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[61]  Anthony J. Yezzi,et al.  Image Sharpening via Sobolev Gradient Flows , 2010, SIAM J. Imaging Sci..

[62]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[63]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[64]  Hans-Peter Seidel,et al.  Motion capture using joint skeleton tracking and surface estimation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[65]  Andrew W. Fitzgibbon,et al.  3D scanning deformable objects with a single RGBD sensor , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[66]  Michael Goesele,et al.  Multi-View Stereo Revisited , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[67]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Nikos Paragios,et al.  Non-rigid registration using distance functions , 2003, Comput. Vis. Image Underst..

[69]  Tao Yu,et al.  BodyFusion: Real-Time Capture of Human Motion and Surface Geometry Using a Single Depth Camera , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[70]  Daniel Cohen-Or,et al.  Three-dimensional distance field metamorphosis , 1998, TOGS.

[71]  T. Chan,et al.  A Variational Level Set Approach to Multiphase Motion , 1996 .

[72]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[73]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[74]  Nassir Navab,et al.  Natural gradients for deformable registration , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[75]  Jakob Andreas Bærentzen,et al.  3D distance fields: a survey of techniques and applications , 2006, IEEE Transactions on Visualization and Computer Graphics.

[76]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[77]  Daniel Cremers,et al.  Efficient Dense Scene Flow from Sparse or Dense Stereo Data , 2008, ECCV.

[78]  Takeo Kanade,et al.  Three-dimensional scene flow , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[79]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[80]  Hans P. Moravec Robot spatial perception by stereoscopic vision and 3D evidence grids , 1996 .

[81]  Shahram Izadi,et al.  UltraStereo: Efficient Learning-Based Matching for Active Stereo Systems , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[82]  Andrew Fitzgibbon,et al.  Gaussian Process Implicit Surfaces , 2006 .

[83]  Michael J. Black,et al.  Dynamic FAUST: Registering Human Bodies in Motion , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[84]  Vladlen Koltun,et al.  A Large Dataset of Object Scans , 2016, ArXiv.

[85]  Shang-Hong Lai,et al.  3D non-rigid registration for MPU implicit surfaces , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[86]  Peter-Pike J. Sloan,et al.  Interactive ray tracing for isosurface rendering , 1998 .

[87]  Olivier D. Faugeras,et al.  How to deal with point correspondences and tangential velocities in the level set framework , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[88]  Leonidas J. Guibas,et al.  As‐Killing‐As‐Possible Vector Fields for Planar Deformation , 2011, Comput. Graph. Forum.

[89]  Nico Blodow,et al.  Fast geometric point labeling using conditional random fields , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[90]  Daniel Ricao Canelhas Scene Representation, Registration and ObjectDetection in a Truncated Signed Distance FunctionRepresentation of 3D Space , 2012 .

[91]  Alberto Elfes,et al.  Sensor integration for robot navigation: Combining sonar and stereo range data in a grid-based representataion , 1987, 26th IEEE Conference on Decision and Control.

[92]  Shinji Umeyama,et al.  An Eigendecomposition Approach to Weighted Graph Matching Problems , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[93]  Alexander M. Bronstein,et al.  Spectral descriptors for deformable shapes , 2011, ArXiv.

[94]  Andrew W. Fitzgibbon,et al.  Real-time non-rigid reconstruction using an RGB-D camera , 2014, ACM Trans. Graph..

[95]  Thomas Brox,et al.  Dense Semi-rigid Scene Flow Estimation from RGBD Images , 2014, ECCV.

[96]  Niklas Peinecke,et al.  Laplace-Beltrami spectra as 'Shape-DNA' of surfaces and solids , 2006, Comput. Aided Des..

[97]  Ming Zeng,et al.  A memory-efficient kinectfusion using octree , 2012, CVM'12.

[98]  Justin Solomon,et al.  Near‐Isometric Level Set Tracking , 2016, Comput. Graph. Forum.

[99]  Slobodan Ilic,et al.  SDF-TAR: Parallel Tracking and Refinement in RGB-D Data using Volumetric Registration , 2016, BMVC.

[100]  Daniel Cremers,et al.  Non‐Rigid Puzzles , 2016, Comput. Graph. Forum.

[101]  Qionghai Dai,et al.  Robust Non-rigid Motion Tracking and Surface Reconstruction Using L0 Regularization , 2015, ICCV.

[102]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[103]  Ronald N. Perry,et al.  Designing with distance fields , 2005, International Conference on Shape Modeling and Applications 2005 (SMI' 05).

[104]  Dieter Fox,et al.  A large-scale hierarchical multi-view RGB-D object dataset , 2011, 2011 IEEE International Conference on Robotics and Automation.

[105]  András Frank,et al.  On Kuhn's Hungarian Method—A tribute from Hungary , 2005 .

[106]  Alexander M. Bronstein,et al.  Stable volumetric features in deformable shapes , 2012, Comput. Graph..

[107]  Frederic Devernay,et al.  A Variational Method for Scene Flow Estimation from Stereo Sequences , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[108]  Daniel Cremers,et al.  Real-Time Camera Tracking and 3D Reconstruction Using Signed Distance Functions , 2013, Robotics: Science and Systems.

[109]  S. Burak Gokturk,et al.  A Time-Of-Flight Depth Sensor - System Description, Issues and Solutions , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[110]  John J. Leonard,et al.  Deformation-based loop closure for large scale dense RGB-D SLAM , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[111]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[112]  Dieter Fox,et al.  Self-Supervised Visual Descriptor Learning for Dense Correspondence , 2017, IEEE Robotics and Automation Letters.

[113]  Nicholas Ayache,et al.  Rigid, affine and locally affine registration of free-form surfaces , 1996, International Journal of Computer Vision.

[114]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[115]  Niklas Peinecke,et al.  Laplace-spectra as fingerprints for shape matching , 2005, SPM '05.

[116]  Slobodan Ilic,et al.  SobolevFusion: 3D Reconstruction of Scenes Undergoing Free Non-rigid Motion , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[117]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[118]  Federico Tombari,et al.  Performance Evaluation of 3D Keypoint Detectors , 2012, International Journal of Computer Vision.

[119]  Daniel Cremers,et al.  Real-time visual odometry from dense RGB-D images , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[120]  Tommi Tykkala,et al.  Direct Iterative Closest Point for real-time visual odometry , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[121]  Michael J. Black,et al.  Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[122]  Daniel Cremers,et al.  Fast odometry and scene flow from RGB-D cameras based on geometric clustering , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[123]  Horst Bischof,et al.  GPSlam: Marrying Sparse Geometric and Dense Probabilistic Visual Mapping , 2011, BMVC.

[124]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[125]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[126]  Q. Ye The signed Euclidean distance transform and its applications , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[127]  Angel Domingo Sappa,et al.  The Richer Representation the Better Registration , 2013, IEEE Transactions on Image Processing.

[128]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[129]  Slobodan Ilic,et al.  Probabilistic Deformable Surface Tracking from Multiple Videos , 2010, ECCV.

[130]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[131]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[132]  Katsushi Ikeuchi,et al.  Locally rigid globally non-rigid surface registration , 2011, 2011 International Conference on Computer Vision.

[133]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[134]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[135]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[136]  Andrew I. Comport,et al.  On unifying key-frame and voxel-based dense visual SLAM at large scales , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[137]  Elsa D. Angelini,et al.  State of the Art of Level Set Methods in Segmentation and Registration of Medical Imaging Modalities , 2005 .

[138]  Daniel Cremers,et al.  Robust odometry estimation for RGB-D cameras , 2013, 2013 IEEE International Conference on Robotics and Automation.

[139]  Daniel Cremers,et al.  Volumetric 3D mapping in real-time on a CPU , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[140]  Ken Museth,et al.  Hierarchical RLE level set: A compact and versatile deformable surface representation , 2006, TOGS.

[141]  Leonidas J. Guibas,et al.  Robust global registration , 2005, SGP '05.

[142]  J. Kruskal Rank, decomposition, and uniqueness for 3-way and n -way arrays , 1989 .

[143]  Vladlen Koltun,et al.  Dense scene reconstruction with points of interest , 2013, ACM Trans. Graph..

[144]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[145]  Ming Zeng,et al.  Octree-based fusion for realtime 3D reconstruction , 2013, Graph. Model..

[146]  Raif M. Rustamov,et al.  Laplace-Beltrami eigenfunctions for deformation invariant shape representation , 2007 .

[147]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[148]  Sergio Orts,et al.  HyperDepth: Learning Depth from Structured Light without Matching , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[149]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[150]  Olaf Kähler,et al.  Hierarchical Voxel Block Hashing for Efficient Integration of Depth Images , 2016, IEEE Robotics and Automation Letters.

[151]  Russell H. Taylor,et al.  SpringLS: A Deformable Model Representation to Provide Interoperability between Meshes and Level Sets , 2011, MICCAI.

[152]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[153]  Guillermo Sapiro,et al.  Variational Problems and Partial Differential Equations on Implicit Surfaces: Bye Bye Triangulated Surfaces? , 2003 .

[154]  Nassir Navab,et al.  Model globally, match locally: Efficient and robust 3D object recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[155]  Matthias Nießner,et al.  VolumeDeform: Real-Time Volumetric Non-rigid Reconstruction , 2016, ECCV.

[156]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[157]  Slobodan Ilic,et al.  Patch-Based Non-rigid 3D Reconstruction from a Single Depth Stream , 2018, 2018 International Conference on 3D Vision (3DV).

[158]  Russell H. Taylor,et al.  Spring Level Sets: A Deformable Model Representation to Provide Interoperability between Meshes and Level Sets , 2013, IEEE Transactions on Visualization and Computer Graphics.

[159]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[160]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[161]  Olaf Kähler,et al.  Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices , 2015, IEEE Transactions on Visualization and Computer Graphics.

[162]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[163]  Daniel Cremers,et al.  Large-Scale Multi-resolution Surface Reconstruction from RGB-D Sequences , 2013, 2013 IEEE International Conference on Computer Vision.

[164]  Kun Zhou,et al.  As-Rigid-AsPossible Distance Field Metamorphosis , 2013, Comput. Graph. Forum.

[165]  Alexander M. Bronstein,et al.  Volumetric heat kernel signatures , 2010, 3DOR '10.

[166]  Raif M. Rustamov,et al.  Interpolated eigenfunctions for volumetric shape processing , 2011, The Visual Computer.

[167]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.

[168]  Kazufumi Kaneda,et al.  Softassign and EM-ICP on GPU , 2010, 2010 First International Conference on Networking and Computing.

[169]  Justus Thies,et al.  Real-time expression transfer for facial reenactment , 2015, ACM Trans. Graph..

[170]  Dieter Fox,et al.  Depth kernel descriptors for object recognition , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[171]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[172]  Andrew W. Fitzgibbon Robust registration of 2D and 3D point sets , 2003, Image Vis. Comput..

[173]  Szymon Rusinkiewicz,et al.  Global non-rigid alignment of 3-D scans , 2007, SIGGRAPH 2007.

[174]  Daniel Cremers,et al.  Real-Time Dense Geometry from a Handheld Camera , 2010, DAGM-Symposium.

[175]  Michael J. Black,et al.  FAUST: Dataset and Evaluation for 3D Mesh Registration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[176]  John Amanatides,et al.  A Fast Voxel Traversal Algorithm for Ray Tracing , 1987, Eurographics.

[177]  Leonidas J. Guibas,et al.  On Discrete Killing Vector Fields and Patterns on Surfaces , 2010, Comput. Graph. Forum.

[178]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[179]  Justus Thies,et al.  Face2Face: real-time face capture and reenactment of RGB videos , 2019, Commun. ACM.

[180]  John J. Leonard,et al.  Robust real-time visual odometry for dense RGB-D mapping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[181]  Alvaro Collet,et al.  High-quality streamable free-viewpoint video , 2015, ACM Trans. Graph..

[182]  Ronald Fedkiw,et al.  Animation and rendering of complex water surfaces , 2002, ACM Trans. Graph..

[183]  Leonidas J. Guibas,et al.  Robust single-view geometry and motion reconstruction , 2009, ACM Trans. Graph..

[184]  Michael Riis Andersen,et al.  Kinect Depth Sensor Evaluation for Computer Vision Applications , 2012 .

[185]  John William Neuberger,et al.  Sobolev gradients and differential equations , 1997 .

[186]  Babak Taati,et al.  Difference of Normals as a Multi-scale Operator in Unorganized Point Clouds , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[187]  Anthony J. Yezzi,et al.  Coarse-to-Fine Segmentation and Tracking Using Sobolev Active Contours , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[188]  Daniel Cremers,et al.  Partial Functional Correspondence , 2017 .

[189]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[190]  Radu Horaud,et al.  Articulated shape matching using Laplacian eigenfunctions and unsupervised point registration , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[191]  Olga Sorkine-Hornung,et al.  Digital Representations of the Real World - How to Capture, Model, and Render Visual Reality , 2015, Digital Representations of the Real World.

[192]  Carsten Rother,et al.  PatchMatch Stereo - Stereo Matching with Slanted Support Windows , 2011, BMVC.

[193]  Tao Yu,et al.  Real-time geometry, albedo and motion reconstruction using a single RGBD camera , 2017, TOGS.

[194]  Didier Stricker,et al.  DNA-SLAM: Dense Noise Aware SLAM for ToF RGB-D Cameras , 2016, ACCV Workshops.

[195]  Ken Museth,et al.  Dynamic Tubular Grid: An Efficient Data Structure and Algorithms for High Resolution Level Sets , 2006, J. Sci. Comput..

[196]  Jovan Popović,et al.  Dynamic shape capture using multi-view photometric stereo , 2009, SIGGRAPH 2009.

[197]  Lourdes Agapito,et al.  Co-fusion: Real-time segmentation, tracking and fusion of multiple objects , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[198]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[199]  Szymon Rusinkiewicz,et al.  Non-rigid range-scan alignment using thin-plate splines , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[200]  Daniel Cremers,et al.  KillingFusion: Non-rigid 3D Reconstruction without Correspondences , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[201]  Manolis I. A. Lourakis,et al.  T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-Less Objects , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[202]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[203]  Luc Van Gool,et al.  Robust and accurate partial surface registration based on variational implicit surfaces for automatic 3D model building , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[204]  Marc Alexa,et al.  As-rigid-as-possible surface modeling , 2007, Symposium on Geometry Processing.

[205]  Andrew J. Davison,et al.  A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[206]  Jana Abhijit Kinect for Windows SDK Programming Guide , 2012 .

[207]  Qionghai Dai,et al.  DoubleFusion: Real-Time Capture of Human Performances with Inner Body Shapes from a Single Depth Sensor , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[208]  Stefan Holzer,et al.  Learning to Efficiently Detect Repeatable Interest Points in Depth Data , 2012, ECCV.

[209]  Günther Greiner,et al.  GPU based ARAP Deformation using Volumetric Lattices , 2012, Eurographics.

[210]  Pushmeet Kohli,et al.  Fusion4D , 2016, ACM Trans. Graph..

[211]  Konrad Schindler,et al.  Piecewise Rigid Scene Flow , 2013, 2013 IEEE International Conference on Computer Vision.

[212]  Carl Olsson,et al.  Robust Camera Tracking by Combining Color and Depth Measurements , 2014, 2014 22nd International Conference on Pattern Recognition.

[213]  S. Osher,et al.  Spatially adaptive techniques for level set methods and incompressible flow , 2006 .

[214]  Pieter Abbeel,et al.  BigBIRD: A large-scale 3D database of object instances , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[215]  Nassir Navab,et al.  SDF-2-SDF Registration for Real-Time 3D Reconstruction from RGB-D Data , 2017, International Journal of Computer Vision.

[216]  Heinz Hügli,et al.  Multi-feature matching algorithm for free-form 3D surface registration , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[217]  Tim Weyrich,et al.  Real-Time 3D Reconstruction in Dynamic Scenes Using Point-Based Fusion , 2013, 2013 International Conference on 3D Vision.

[218]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[219]  Horst Bischof,et al.  A Globally Optimal Algorithm for Robust TV-L1 Range Image Integration , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[220]  Slobodan Ilic,et al.  Towards Implicit Correspondence in Signed Distance Field Evolution , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[221]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[222]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[223]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[224]  Didier Stricker,et al.  CoRBS: Comprehensive RGB-D benchmark for SLAM using Kinect v2 , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[225]  Takeo Kanade,et al.  Panoptic Studio: A Massively Multiview System for Social Motion Capture , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[226]  R. Hartley Triangulation, Computer Vision and Image Understanding , 1997 .

[227]  Joaquim Salvi,et al.  The SLAM problem: a survey , 2008, CCIA.

[228]  James F. O'Brien,et al.  Shape transformation using variational implicit functions , 1999, SIGGRAPH Courses.

[229]  Hans-Peter Seidel,et al.  Performance capture from sparse multi-view video , 2008, ACM Trans. Graph..

[230]  Wolfram Burgard,et al.  Range sensor based model construction by sparse surface adjustment , 2011, Advanced Robotics and its Social Impacts.

[231]  Guido Gerig,et al.  Level-set evolution with region competition: automatic 3-D segmentation of brain tumors , 2002, Object recognition supported by user interaction for service robots.

[232]  Shahram Izadi,et al.  Motion2fusion , 2017, ACM Trans. Graph..

[233]  Vladlen Koltun,et al.  Fast Global Registration , 2016, ECCV.

[234]  Vladlen Koltun,et al.  Robust reconstruction of indoor scenes , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[235]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[236]  John J. Leonard,et al.  Kintinuous: Spatially Extended KinectFusion , 2012, AAAI 2012.

[237]  Andrew J. Davison,et al.  DTAM: Dense tracking and mapping in real-time , 2011, 2011 International Conference on Computer Vision.

[238]  Radu Horaud,et al.  Topology-Adaptive Mesh Deformation for Surface Evolution, Morphing, and Multiview Reconstruction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[239]  Leonidas J. Guibas,et al.  A concise and provably informative multi-scale signature based on heat diffusion , 2009 .

[240]  Dieter Fox,et al.  Patch Volumes: Segmentation-Based Consistent Mapping with RGB-D Cameras , 2013, 2013 International Conference on 3D Vision.

[241]  Kostas Daniilidis,et al.  Fully Automatic Registration of 3D Point Clouds , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).