3D Modelling from Real Data

The genesis of a 3D model has basically two definitely different paths. Firstly we can consider the CAD generated models, where the shape is defined according to a user drawing action, operating with different mathematical “bricks” like B-Splines, NURBS or subdivision surfaces (mathematical CAD modelling), or directly drawing small polygonal planar facets in space, approximating with them complex free form shapes (polygonal CAD modelling). This approach can be used for both ideal elements (a project, a fantasy shape in the mind of a designer, a 3D cartoon, etc.) or for real objects. In the latter case the object has to be first surveyed in order to generate a drawing coherent with the real stuff. If the surveying process is not only a rough acquisition of simple distances with a substantial amount of manual drawing, a scene can be modelled in 3D by capturing with a digital instrument many points of its geometrical features and connecting them by polygons to produce a 3D result similar to a polygonal CAD model, with the difference that the shape generated is in this case an accurate 3D acquisition of a real object (reality-based polygonal modelling). Considering only device operating on the ground, 3D capturing techniques for the generation of reality-based 3D models may span from passive sensors and image data (Remondino and El-Hakim, 2006), optical active sensors and range data (Blais, 2004; Shan & Toth, 2008; Vosselman and Maas, 2010), classical surveying (e.g. total stations or Global Navigation Satellite System GNSS), 2D maps (Yin et al., 2009) or an integration of the aforementioned methods (Stumpfel et al., 2003; Guidi et al., 2003; Beraldin, 2004; Stamos et al., 2008; Guidi et al., 2009a; Remondino et al., 2009; Callieri et al., 2011). The choice depends on the required resolution and accuracy, object dimensions, location constraints, instrument’s portability and usability, surface characteristics, working team experience, project’s budget, final goal, etc. Although aware of the potentialities of the image-based approach and its recent developments in automated and dense image matching for non-expert the easy usability and reliability of optical active sensors in acquiring 3D data is generally a good motivation to decline image-based approaches. Moreover the great advantage of active sensors is the fact that they deliver immediately dense and detailed 3D point clouds, whose coordinate are metrically defined. On the other hand image data require some processing and a mathematical formulation to transform the two-dimensional image measurements into metric three-dimensional coordinates. Image-based modelling techniques (mainly

[1]  Gabriel Taubin,et al.  Building a Digital Model of Michelangelo's Florentine Pietà , 2002, IEEE Computer Graphics and Applications.

[2]  Peter Wonka,et al.  Generating 3D Building Models from Architectural Drawings: A Survey , 2009, IEEE Computer Graphics and Applications.

[3]  Gabriele Guidi,et al.  TOF laser scanner characterization for low-range applications , 2007, Electronic Imaging.

[4]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[5]  Jan-Michael Frahm,et al.  Detailed Real-Time Urban 3D Reconstruction from Video , 2007, International Journal of Computer Vision.

[6]  Paul E. Debevec,et al.  Digitizing the Parthenon: Estimating Surface Reflectance Properties of a Complex Scene under Captured Natural Illumination , 2004, VMV.

[7]  Luc Van Gool,et al.  Special issue on 3D acquisition technology for cultural heritage , 2006, Machine Vision and Applications.

[8]  Armin Gruen,et al.  Comparative geometric and radiometric evaluation of mobile phone and still video cameras , 2009 .

[9]  George Vosselman,et al.  Airborne and terrestrial laser scanning , 2011, Int. J. Digit. Earth.

[10]  A. Gruen,et al.  AN ADVANCED SENSOR MODEL FOR PANORAMIC CAMERAS , 2004 .

[11]  J.-Angelo Beraldin,et al.  INTEGRATION OF LASER SCANNING AND CLOSE-RANGE PHOTOGRAMMETRY – THE LAST DECADE AND BEYOND , 2004 .

[12]  李幼升,et al.  Ph , 1989 .

[13]  M. Rioux,et al.  Influence of speckle on laser range finders. , 1991, Applied optics.

[14]  Maarten Vergauwen,et al.  Web-based 3D Reconstruction Service , 2006, Machine Vision and Applications.

[15]  Gabriel Taubin,et al.  1 An End-to-End Framework for Evaluating Surface Reconstruction , 2011 .

[16]  Simone Gasparini,et al.  Camera Models and Fundamental Concepts Used in Geometric Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[17]  Roberto Scopigno,et al.  Image‐to‐Geometry Registration: a Mutual Information Method exploiting Illumination‐related Geometric Properties , 2009, Comput. Graph. Forum.

[18]  E. Mikhail,et al.  Introduction to modern photogrammetry , 2001 .

[19]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[20]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Roland Bless,et al.  Network Design , 2011, 4WARD Project.

[22]  ChenChao,et al.  Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes , 2008 .

[23]  Fabio Remondino,et al.  Automation in Multi-Image Spherical Photogrammetry for 3D Architectural Reconstructions , 2010, VAST.

[24]  Gabriel Taubin,et al.  The ball-pivoting algorithm for surface reconstruction , 1999, IEEE Transactions on Visualization and Computer Graphics.

[25]  Hans-Peter Seidel,et al.  Multi-level partition of unity implicits , 2003, ACM Trans. Graph..

[26]  Frank A. van den Heuvel,et al.  3D reconstruction from a single image using geometric constraints , 1998 .

[27]  Yongkang Guo,et al.  Large depth-of-view portable three-dimensional laser scanner and its segmental calibration for robot vision , 2007 .

[28]  Leif Kobbelt,et al.  A survey of point-based techniques in computer graphics , 2004, Comput. Graph..

[29]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[30]  Vladimir K. Petrov,et al.  Checking of Large Deployable Reflector Geometry , 2006 .

[31]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[32]  Francois Blais,et al.  Evaluating laser range scanner lateral resolution in 3D metrology , 2009, Electronic Imaging.

[33]  Armin Gruen,et al.  CC-MODELER : A TOPOLOGY GENERATOR FOR 3-D CITY MODELS , 1998 .

[34]  D. Gennery,et al.  Calibration and Orientation of Cameras in Computer Vision , 2001 .

[35]  Joachim Giesen,et al.  Delaunay Triangulation Based Surface Reconstruction , 2006 .

[36]  Michael J. Swain,et al.  Shape from Texture , 1985, IJCAI.

[37]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[38]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[39]  Simon Winkelbach,et al.  Shape from 2D Edge Gradients , 2001, DAGM-Symposium.

[40]  S. El-Hakim A PRACTICAL APPROACH TO CREATING PRECISE AND DETAILED 3D MODELS FROM SINGLE AND MULTIPLE VIEWS , 2000 .

[41]  François Blais Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[42]  Szymon Rusinkiewicz,et al.  Global non-rigid alignment of 3-D scans , 2007, ACM Trans. Graph..

[43]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[44]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[45]  Enrico Gobbetti,et al.  Massive-Model Rendering Techniques: A Tutorial , 2007, IEEE Computer Graphics and Applications.

[46]  C. Fraser,et al.  Digital camera calibration methods: Considerations and comparisons , 2006 .

[47]  M. Pierrot-Deseilligny,et al.  A MULTIRESOLUTION AND OPTIMIZATION-BASED IMAGE MATCHING APPROACH : AN APPLICATION TO SURFACE RECONSTRUCTION FROM SPOT 5-HRS STEREO IMAGERY , 2006 .

[48]  Roberto Scopigno,et al.  Multiscale acquisition and presentation of very large artifacts: The case of portalada , 2011, JOCCH.

[49]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[50]  Gabriele Guidi,et al.  Fusion of range camera and photogrammetry: A systematic procedure for improving 3-D models metric accuracy , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[51]  M. Levoy,et al.  An assessment of laser range measurement on marble surfaces , 2001 .

[52]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[53]  Richard Szeliski,et al.  Building Rome in a day , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[54]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[55]  Richard Szeliski,et al.  Modeling the World from Internet Photo Collections , 2008, International Journal of Computer Vision.

[56]  Robert Bergevin,et al.  Registration of multiple range views for automatic 3-D model building , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[57]  Fabio Remondino,et al.  3D Virtual reconstruction and visualization of complex architectures: The 3D-ARCH project , 2009 .

[58]  Luciano Silva,et al.  A 3D reconstruction pipeline for digital preservation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[59]  Stuart Robson,et al.  Close Range Photogrammetry , 2007 .

[60]  H. Hirschmüller Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Stereo Processing by Semi-global Matching and Mutual Information , 2022 .

[61]  Thomas O. Binford,et al.  Local shape from specularity , 1988, Comput. Vis. Graph. Image Process..

[62]  Hans-Peter Seidel,et al.  Image-based reconstruction of spatial appearance and geometric detail , 2003, TOGS.

[63]  T. Luhmann,et al.  3-D OBJECT RECONSTRUCTION FROM MULTIPLE-STATION PANORAMA IMAGERY , 2004 .

[64]  Paul G. Maropoulos,et al.  Recent developments in large-scale dimensional metrology , 2009 .

[65]  Gabriele Guidi,et al.  Performance Evaluation of Triangulation Based Range Sensors , 2010, Sensors.

[66]  Jean-Philippe Pons,et al.  Towards high-resolution large-scale multi-view stereo , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[67]  Katsushi Ikeuchi,et al.  Hole Filling of a 3D Model by Flipping Signs of a Signed Distance Field in Adaptive Resolution , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[68]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[69]  Denis Laurendeau,et al.  A General Surface Approach to the Integration of a Set of Range Views , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  Gabriele Guidi,et al.  High-accuracy 3D modeling of cultural heritage: the digitizing of Donatello's "Maddalena" , 2004, IEEE Transactions on Image Processing.

[71]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[72]  Marc Levoy,et al.  The digital Michelangelo project , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[73]  Marc Rioux,et al.  Correction of color information of a 3D model using a range intensity image , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[74]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[75]  Robert Bergevin,et al.  A method for the registration of attributed range images , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[76]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[77]  J. Shan,et al.  Topographic laser ranging and scanning : principles and processing , 2008 .

[78]  Andrew Jones,et al.  Digital Reunification of the Parthenon and its Sculptures , 2003, VAST.

[79]  Fei Deng,et al.  Registration between Multiple Laser Scanner Data Sets , 2011 .

[80]  SnavelyNoah,et al.  Modeling the World from Internet Photo Collections , 2008 .

[81]  J.-Angelo Beraldin,et al.  Issues in acquiring, processing and visualizing large and detailed 3D models , 2010, 2010 44th Annual Conference on Information Sciences and Systems (CISS).

[82]  Armin Gruen,et al.  Turning Images into 3-D Models ( Developments and performance analysis of image matching for detailed surface reconstruction of heritage objects ) , 2008 .

[83]  Hans-Peter Seidel,et al.  Automated texture registration and stitching for real world models , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[84]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[85]  Wolfgang Boehler,et al.  Investigating Laser Scanner Accuracy , 2005 .

[86]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[87]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[88]  Hans-Gerd Maas Close range photogrammetry sensors , 2008 .

[89]  Marshall W. Bern,et al.  Surface Reconstruction by Voronoi Filtering , 1998, SCG '98.

[90]  Gabriele Guidi,et al.  Digital Three-Dimensional Modelling of Donatello's David by Frequency-Modulated Laser Radar , 2009 .

[91]  PollefeysMarc,et al.  Visual Modeling with a Hand-Held Camera , 2004 .

[92]  Gabriele Guidi,et al.  A Multi-Resolution Methodology for the 3D Modeling of Large and Complex Archeological Areas , 2009 .

[93]  Gabriele Fangi Polytechnical The Multi-image Spherical Panoramas as a Tool for Architectural Survey , 2007 .

[94]  Gabriele Guidi,et al.  Performances evaluation of a low cost active sensor for Cultural Heritage documentation , 2007 .

[95]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[96]  Kenneth R. Sloan,et al.  Surfaces from contours , 1992, TOGS.

[97]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[98]  Paolo Cignoni,et al.  A comparison of mesh simplification algorithms , 1998, Comput. Graph..

[99]  Gabriele Guidi,et al.  Low cost characterization of TOF range sensors resolution , 2011, Electronic Imaging.

[100]  Fabio Remondino,et al.  Image‐based 3D Modelling: A Review , 2006 .

[101]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[102]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[103]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[104]  Fabio Remondino,et al.  Photogrammetric Reconstruction of the Great Buddha of Bamiyan, Afghanistan , 2004 .

[105]  David Fofi,et al.  A review of recent range image registration methods with accuracy evaluation , 2007, Image Vis. Comput..