Streaming surface reconstruction from real time 3D-measurements

In dieser Dissertation wird eine robuste Methode zur schnellen, inkrementellen Erstellung von 3D Oberflachenmodellen aus Echtzeit-Datenstromen vorgestellt. Das Ziel ist, dem Benutzer eines manuellen Scannersystems das entstehende 3D Modell wahrend des Scannens als visuelle Ruckkopplung sofort anzuzeigen. Indem kontinuierlich Messpunkte aus dem Echtzeit-Datenstrom eingefugt werden und damit das bestehende Netz lokal verfeinert wird, kann mit der prasentierten Methode iterativ ein dichtes und homogenes Dreiecksnetz erstellt werden. Dabei ermoglicht eine dynamische, raumliche Datenstruktur einen schnellen Zugriff auf die Daten. Eine Verifikation mit simulierten Daten und zwei exemplarische Anwendungen, die Verwendung mit einem handgefuhrten Scannersystem und die Bearbeitung von sehr grosen Datensatzen zur 3D Dokumentation von Gebauden, zeigen die Vielseitigkeit der Methode.

[1]  Szymon Rusinkiewicz,et al.  Spacetime stereo: a unifying framework for depth from triangulation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Gerd Hirzinger,et al.  Optimal Hand-Eye Calibration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Niloy J. Mitra,et al.  Estimating surface normals in noisy point cloud data , 2003, SCG '03.

[4]  J. O´Rourke,et al.  Computational Geometry in C: Arrangements , 1998 .

[5]  Paul J. Besl,et al.  Active, optical range imaging sensors , 1988, Machine Vision and Applications.

[6]  Gerd Hirzinger,et al.  Online surface reconstruction from unorganized 3D-points for the DLR hand-guided scanner system , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[7]  Meenakshisundaram Gopi,et al.  Surface Reconstruction based on Lower Dimensional Localized Delaunay Triangulation , 2000, Comput. Graph. Forum.

[8]  Darius Burschka,et al.  Modelling the World in Real Time , 2007 .

[9]  Dave Shreiner,et al.  OpenGL(R) Programming Guide: The Official Guide to Learning OpenGL(R), Version 2.1 , 2007 .

[10]  Karsten Scheibe,et al.  EYESCAN - A High Resolution Digital Panoramic Camera , 2001, RobVis.

[11]  Martin J. Dürst,et al.  The design and analysis of spatial data structures. Applications of spatial data structures: computer graphics, image processing, and GIS , 1991 .

[12]  Renato Pajarola,et al.  Stream-processing points , 2005, VIS 05. IEEE Visualization, 2005..

[13]  Tomas Akenine-Möller,et al.  Real-time rendering , 1997 .

[14]  Adrian Hilton,et al.  Geometric fusion for a hand-held 3D sensor , 2000 .

[15]  Micha Sharir,et al.  Partial surface and volume matching in three dimensions , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[16]  Joseph O'Rourke,et al.  Computational Geometry in C. , 1995 .

[17]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[18]  Chandrajit L. Bajaj,et al.  Adaptive Reconstruction of Surfaces and Scalar Fields from Dense Scattered Trivariate Data , 1995 .

[19]  Szymon Rusinkiewicz,et al.  Viewpoint-Coded Structured Light , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[21]  Szymon Rusinkiewicz,et al.  Real-time acquisition and rendering of large 3D models , 2001 .

[22]  Darius Burschka.  Robust Feature Correspondences for Vision-Based Navigation with Slow Frame-Rate Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Wolfgang Sepp.  Visual Servoing of Textured Free-Form Objects in 6 Degrees of Freedom , 2008 .

[24]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[25]  Koichi Hashimoto,et al.  3,000-fps 3-D shape measurement using a high-speed camera-projector system , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Raphaëlle Chaine,et al.  A streaming algorithm for surface reconstruction , 2007, Symposium on Geometry Processing.

[27]  Rui Liu,et al.  Photo-realistic 3D modelling - From robotics perception towards cultural heritage , 2005 .

[28]  T. Hales.  The Kepler conjecture , 1998, math/9811078.

[29]  Paolo Cignoni,et al.  Out-of-core MLS reconstruction , 2007 .

[30]  Tom Davis,et al.  Opengl programming guide: the official guide to learning opengl , 1993 .

[31]  Zhidong Deng,et al.  A Realistic 3-D Reverse Modeling System Based on Real-World Sampling Dataset , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Heiko Hirschmüller,et al.  Stereo Vision in Structured Environments by Consistent Semi-Global Matching , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[33]  Luc Van Gool,et al.  Fast 3D Scanning with Automatic Motion Compensation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Christoph Borst,et al.  A Humanoid Two-Arm System for Dexterous Manipulation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[35]  D. Cohen-Or,et al.  Robust moving least-squares fitting with sharp features , 2005, ACM Trans. Graph..

[36]  Rui Liu,et al.  "Matching-Tree - A Novel Data Structure for Global Automatic Matching , 2005 .

[37]  Sven Molkenstruck,et al.  Low-Cost Laser Range Scanner and Fast Surface Registration Approach , 2006, DAGM-Symposium.

[38]  Peter Liepa,et al.  Filling Holes in Meshes , 2003, Symposium on Geometry Processing.

[39]  Dipl.-Ing,et al.  Real-time Rendering , 2022 .

[40]  Gerd Hirzinger,et al.  The 3D-Modeller: A Multi-Purpose Vision Platform , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[41]  Eric Wahl,et al.  The DLR multisensory Hand-Guided Device: the Laser Stripe Profiler , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[42]  Sunghee Choi,et al.  The power crust, unions of balls, and the medial axis transform , 2001, Comput. Geom..

[43]  Tobias Ortmaier,et al.  Accuracy Identification of Markerless Registration with the DLR Handheld 3D-Modeller in Medical Applications , 2007 .

[44]  Leonidas J. Guibas,et al.  Robust global registration , 2005, SGP '05.

[45]  Jean-Daniel Boissonnat,et al.  Geometric structures for three-dimensional shape representation , 1984, TOGS.

[46]  Heiko Hirschmüller,et al.  Stereo vision based mapping and immediate virtual walkthroughs , 2003 .

[47]  G. Hirzinger,et al.  Online surface reconstruction from unorganized 3D-points for the DLR hand-guided scanner system , 2004 .

[48]  Leif Kobbelt,et al.  A Surface-Growing Approach to Multi-View Stereo Reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Gerd Hirzinger,et al.  A laser-triangulation based miniaturized 2-d range-scanner as integral part of a multisensory robot-gripper. , 1997 .

[50]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[51]  Phillip J. McKerrow,et al.  Introduction to robotics , 1991 .

[52]  A. Guttman,et al.  A Dynamic Index Structure for Spatial Searching , 1984, SIGMOD 1984.

[53]  B. Curless.  New Methods for Surface Reconstruction from Range Images , 1997 .

[54]  Adrian Hilton,et al.  Geometric fusion for a hand-held 3D sensor , 2000, Machine Vision and Applications.

[55]  Marco Attene,et al.  Automatic Surface Reconstruction from Point Sets in Space , 2000, Comput. Graph. Forum.

[56]  Tobias Ortmaier,et al.  Surface-based image-to-patient registration using a hand-guided laser-range scanner system , 2004, CARS.

[57]  Robert Sedgewick,et al.  Algorithms in C , 1990 .

[58]  Gerd Hirzinger,et al.  Tackling multi-sensory 3D data acquisition and fusion , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Herbert Edelsbrunner,et al.  Three-dimensional alpha shapes , 1992, VVS.

[60]  Jack Snoeyink,et al.  Theory and practice of sampling and reconstruction for manifolds with boundaries , 2001 .

[61]  Christopher Zach,et al.  High-Performance Multi-View Reconstruction , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[62]  Marc Alexa,et al.  Computing and Rendering Point Set Surfaces , 2003, IEEE Trans. Vis. Comput. Graph..

[63]  Manuel Menezes de Oliveira Neto,et al.  Reconstructing manifold and non-manifold surfaces from point clouds , 2005, VIS 05. IEEE Visualization, 2005..

[64]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[65]  Daniel Cohen-Or,et al.  Eurographics Symposium on Geometry Processing (2007) Data-dependent Mls for Faithful Surface Approximation , 2022 .

[66]  Tokuo Tsuji,et al.  High-speed 3D image acquisition using coded structured light projection , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[67]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[68]  G. Roth,et al.  Pose Error Effects on Range Sensing * , 2002 .

[69]  Gerd Hirzinger,et al.  Extrinsic and depth calibration of ToF-cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[70]  Michael Suppa,et al.  Autonomous robot work cell exploration using multisensory eye-in-hand systems , 2008 .

[71]  Raphaëlle Chaine.  A geometric convection approach of 3-D reconstruction , 2003 .

[72]  William H. Press,et al.  Numerical recipes in C , 2002 .

[73]  Martin Reimers,et al.  Meshless parameterization and surface reconstruction , 2001, Comput. Aided Geom. Des..

[74]  D. Levin,et al.  Mesh-Independent Surface Interpolation , 2004 .

[75]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[76]  Tamal K. Dey,et al.  Tight cocone: a water-tight surface reconstructor , 2003, SM '03.