IMAGE-BASED 3 D MODELLING : A REVIEW

In this paper the main problems and the available solutions are addressed for the generation of 3D models from terrestrial images. Close range photogrammetry has dealt for many years with manual or automatic image measurements for precise 3D modelling. Nowadays 3D scanners are also becoming a standard source for input data in many application areas, but image-based modelling still remains the most complete, economical, portable, flexible and widely used approach. In this paper the full pipeline is presented for 3D modelling from terrestrial image data, considering the different approaches and analysing all the steps involved.

[1]  Fabio Remondino,et al.  Generation of High-Resolution Mosaic for Photo-Realistic Texture-Mapping of Cultural Heritage 3D Models , 2004, VAST.

[2]  Gabriel Taubin,et al.  Building a Digital Model of Michelangelo's Florentine Pietà , 2002, IEEE Computer Graphics and Applications.

[3]  Daniel Keren,et al.  Tight Fitting of Convex Polyhedral Shapes , 1998, Int. J. Shape Model..

[4]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[5]  Andre Streilein.  Towards automation in architectural photogrammetry: CAD-based 3D-feature extraction , 1994 .

[6]  Marc Rioux,et al.  Digital 3D imaging system for rapid response on remote sites , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[7]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[8]  Fabio Remondino,et al.  3-D reconstruction of static human body shape from image sequence , 2004, Comput. Vis. Image Underst..

[9]  Li Zhang.  Automatic Digital Surface Model (DSM) generation from linear array images , 2005 .

[10]  Richard I. Hartley,et al.  Critical configurations for n-view projective reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  Andrew Zisserman,et al.  Matching and Reconstruction from Widely Separated Views , 1998, SMILE.

[12]  Li Zhang,et al.  Generating a 3D model of a Bayon tower using non-metric imagery , 2001 .

[13]  S. El-Hakim,et al.  Critical Factors and Configurations for Practical 3 D Image-Based Modeling , 2003 .

[14]  Markus H. Gross,et al.  Efficient Triangular Surface Approximations Using Wavelets and Quadtree Data Structures , 1996, IEEE Trans. Vis. Comput. Graph..

[15]  Guido Brunnett,et al.  Polyhedral approximation and first order segmentation of unstructured point sets , 1998, Proceedings. Computer Graphics International (Cat. No.98EX149).

[16]  Shigeru Muraki,et al.  Volumetric shape description of range data using “Blobby Model” , 1991, SIGGRAPH.

[17]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[18]  Bill Triggs,et al.  Critical Motions for Auto-Calibration When Some Intrinsic Parameters Can Vary , 2000, Journal of Mathematical Imaging and Vision.

[19]  Erik Wolfart,et al.  Hybrid 3D reconstruction and image-based rendering techniques for reality modeling , 2000, IS&T/SPIE Electronic Imaging.

[20]  F. Remondinob,et al.  STRUCTURE AND MOTION RECONSTRUCTION OF SHORT MOBILE MAPPING IMAGE SEQUENCES , 2005 .

[21]  Linda G. Shapiro,et al.  Acquisition and visualization of colored 3D objects , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[22]  David Eppstein,et al.  MESH GENERATION AND OPTIMAL TRIANGULATION , 1992 .

[23]  Jan Boehm.  Multi-image fusion for occlusion-free faÇade texturing , 2004 .

[24]  T. Ohdake,et al.  3D MODELING OF HIGH RELIEF SCULPTURE USING IMAGE BASED INTEGRATED MEASUREMENT SYSTEM , 2005 .

[25]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[26]  Simon Winkelbach,et al.  Shape from 2D Edge Gradients , 2001, DAGM-Symposium.

[27]  François Blais.  Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[28]  Joshua Levenberg,et al.  Fast view-dependent level-of-detail rendering using cached geometry , 2002, IEEE Visualization, 2002. VIS 2002..

[29]  Fabio Remondino,et al.  Image‐based 3D Modelling: A Review , 2006 .

[30]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[31]  Marshall W. Bern,et al.  A new Voronoi-based surface reconstruction algorithm , 1998, SIGGRAPH.

[32]  Kia Ng,et al.  Automated reconstruction of 3D models from real environments , 1999 .

[33]  Fabio Remondino,et al.  Photogrammetric Reconstruction of the Great Buddha of Bamiyan, Afghanistan , 2004 .

[34]  Sabry F. El-Hakim,et al.  Integration of range and intensity data to improve vision-based three-dimensional measurements , 1994, Other Conferences.

[35]  Marc Stamminger,et al.  Sequential point trees , 2003, ACM Trans. Graph..

[36]  Daut Daman,et al.  A review on level of detail , 2004, Proceedings. International Conference on Computer Graphics, Imaging and Visualization, 2004. CGIV 2004..

[37]  Valerio Pascucci,et al.  Terrain Simplification Simplified: A General Framework for View-Dependent Out-of-Core Visualization , 2002, IEEE Trans. Vis. Comput. Graph..

[38]  D. Gennery,et al.  Calibration and Orientation of Cameras in Computer Vision , 2001 .

[39]  Jarek Rossignac,et al.  Multi-resolution 3D approximations for rendering complex scenes , 1993, Modeling in Computer Graphics.

[40]  Frederick M. Weinhaus,et al.  Photogrammetric Texture Mapping onto Planar Polygons , 1999, Graph. Model. Image Process..

[41]  Tamal K. Dey,et al.  Detecting undersampling in surface reconstruction , 2001, SCG '01.

[42]  Marc Alexa.  Wiener Filtering of Meshes , 2002, Shape Modeling International.

[43]  W. Boehler,et al.  3D SCANNING AND PHOTOGRAMMETRY FOR HERITAGE RECORDING: A COMPARISON , 2004 .

[44]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[45]  Steven M. Seitz,et al.  Single-view modelling of free-form scenes , 2002, Comput. Animat. Virtual Worlds.

[46]  Frank A. van den Heuvel,et al.  3D reconstruction from a single image using geometric constraints , 1998 .

[47]  A. Grün.  Semi-automated approaches to site recording and modeling , 2000 .

[48]  Gilles Trombettoni,et al.  Scene modeling based on constraint system decomposition techniques , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[49]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[50]  Alberto Guarnieri,et al.  3D modeling of close-range objects: photogrammetry or laser scanning? , 2005 .

[51]  Luc Van Gool,et al.  Wide-baseline multiple-view correspondences , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[52]  Minoru Asada,et al.  Determining Cylindrical Shape from Contour and Shading , 1987, IJCAI.

[53]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[54]  Thomas O. Binford,et al.  Local shape from specularity , 1988, Comput. Vis. Graph. Image Process..

[55]  S. El-Hakim,et al.  EXPLORING A BYZANTINE CRYPT THROUGH A HIGH-RESOLUTION TEXTURE MAPPED 3D MODEL: COMBINING RANGE DATA AND PHOTOGRAMMETRY , 2002 .

[56]  A. Gruen.  ADAPTIVE LEAST SQUARES CORRELATION: A POWERFUL IMAGE MATCHING TECHNIQUE , 1985 .

[57]  Sébastien Roy,et al.  Automatic relighting of overlapping textures of a 3D model , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[58]  Ramakant Nevatia,et al.  Shape from Contour: Straight Homogeneous Generalized Cylinders and Constant Cross Section Generalized Cylinders , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Horst A. Beyer,et al.  System Calibration Through Self-Calibration , 2001 .

[60]  Francois Blais,et al.  GoLD: Interactive Display of Huge Colored and Textured Models Louis Borgeat Guy Godin Franc ‚ois Blais Philippe Massicotte National Research Council of Canada , 2005, SIGGRAPH 2005.

[61]  Michael Wimmer,et al.  Point-Based Impostors for Real-Time Visualization , 2001, Rendering Techniques.

[62]  Wolfgang Niem,et al.  MAPPING TEXTURE FROM MULTIPLE CAMERA VIEWS ONTO 3D-OBJECT MODELS FOR COMPUTER ANIMATION , 1995 .

[63]  Roberto Cipolla,et al.  Combining single view recognition and multiple view stereo for architectural scenes , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[64]  Fabio Remondino,et al.  Human figure reconstruction and modeling from single image or monocular video sequence , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[65]  Paolo Cignoni,et al.  Adaptive tetrapuzzles: efficient out-of-core construction and visualization of gigantic multiresolution polygonal models , 2004, ACM Trans. Graph..

[66]  Fabio Remondino,et al.  Photogrammetry and Ground-based Laser Scanning: Assessment of Metric Accuracy of the 3D Model of Pozzoveggiani Church , 2004 .

[67]  Mi-Suen Lee,et al.  View Synthesis from Unregistered 2-D Images , 1996, Graphics Interface.

[68]  T. Hastie,et al.  Principal Curves , 2007 .

[69]  Mubarak Shah,et al.  Two-frame wide baseline matching , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[70]  Nicola D'Apuzzo.  Surface measurement and tracking of human body parts from multi-image video sequences , 2002 .

[71]  Frank A. van den Heuvel,et al.  Line-photogrammetric mathematical model for the reconstruction of polyhedral objects , 1998 .

[72]  Fabio Remondino,et al.  OCCLUSION-FREE IMAGE GENERATION FOR REALISTIC TEXTURE MAPPING , 2005 .

[73]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[74]  David B. Arnold,et al.  Scene assembly for large scale urban reconstructions , 2001, VAST '01.

[75]  H. Otani,et al.  COMPARISON AND EVALUATION OF LASER SCANNING AND PHOTOGRAMMETRY AND THEIR COMBINED USE FOR DIGITAL RECORDING OF CULTURAL HERITAGE , 2004 .

[76]  Luc Van Gool,et al.  Dense matching of multiple wide-baseline views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[77]  Emmanuel P. Baltsavias,et al.  Multiphoto geometrically constrained matching , 1991 .

[78]  Joachim Bauer,et al.  Virtual Habitat: Models of the Urban Outdoors , 2001 .

[79]  X. Wang,et al.  The Principal Point and CCD Cameras , 1998 .

[80]  Toby Howard,et al.  Interactive reconstruction of virtual environments from video sequences , 2003, Computers & graphics.

[81]  Matthias Zwicker,et al.  Perspective Accurate Splatting , 2004, Graphics Interface.

[82]  Gerhard Roth.  AUTOMATIC CORRESPONDENCES FOR PHOTOGRAMMETRIC MODEL BUILDING , 2004 .

[83]  Paolo Cignoni,et al.  External Memory Management and Simplification of Huge Meshes , 2003, IEEE Trans. Vis. Comput. Graph..

[84]  Mark A. Duchaineau,et al.  ROAMing terrain: Real-time Optimally Adapting Meshes , 1997, Proceedings. Visualization '97 (Cat. No. 97CB36155).

[85]  Denis Laurendeau,et al.  Multi-resolution surface modeling from multiple range views , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[86]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[87]  Hugues Hoppe.  Smooth view-dependent level-of-detail control and its application to terrain rendering , 1998 .

[88]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[89]  Dinesh Manocha,et al.  Hierarchical Back-Face Computation , 1996, Rendering Techniques.

[90]  Sabry F. El-Hakim,et al.  Configuration design for sensor integration , 1995, Other Conferences.

[91]  Ramakant Nevatia,et al.  Interactive 3D building modeling using a hierarchical representation , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[92]  John Ronald Kender,et al.  Shape from texture , 1981 .

[93]  Steven J. Owen,et al.  A Survey of Unstructured Mesh Generation Technology , 1998, IMR.

[94]  Hans J. Tiziani,et al.  New highly efficient binary codes for structured light methods , 1996, Other Conferences.

[95]  Sabry F. El-Hakim.  A FLEXIBLE APPROACH TO 3D RECONSTRUCTION FROM SINGLE IMAGES , 2001, SIGGRAPH 2001.

[96]  C. Heipke,et al.  IMAGE SEQUENCE ANALYSIS OF SURF ZONES : METHODOLOGY AND FIRST RESULTS , 2003 .

[97]  Herbert Edelsbrunner,et al.  Geometry and Topology for Mesh Generation , 2001, Cambridge monographs on applied and computational mathematics.

[98]  Harry Shum,et al.  Review of image-based rendering techniques , 2000, Visual Communications and Image Processing.

[99]  Joe Warren,et al.  Approximation of dense scattered data using algebraic surfaces , 1991, Proceedings of the Twenty-Fourth Annual Hawaii International Conference on System Sciences.

[100]  Peter F. Sturm,et al.  Critical motion sequences for monocular self-calibration and uncalibrated Euclidean reconstruction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[101]  Hugues Hoppe,et al.  View-dependent refinement of progressive meshes , 1997, SIGGRAPH.

[102]  Robert M. O'Bara,et al.  Geometrically deformed models: a method for extracting closed geometric models form volume data , 1991, SIGGRAPH.

[103]  Konrad Schindler,et al.  A model-based method for building reconstruction , 2003, First IEEE International Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 2003. HLK 2003..

[104]  Martin Isenburg,et al.  Large mesh simplification using processing sequences , 2003, IEEE Visualization, 2003. VIS 2003..

[105]  Marc Rioux,et al.  Design Of A Large Depth Of View Three-Dimensional Camera For Robot Vision , 1987 .

[106]  Hansong Zhang,et al.  Effective occlusion culling for the interactive display of arbitrary models , 1998 .

[107]  D. Nistér.  Automatic passive recovery of 3D from images and video , 2004 .

[108]  Andrew W. Fitzgibbon,et al.  Automatic 3D model acquisition and generation of new images from video sequences , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[109]  Fan Wu,et al.  A Developer's Survey of Polygonal Simplification algorithms , 2005 .

[110]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[111]  Herbert Edelsbrunner,et al.  Three-dimensional alpha shapes , 1992, VVS.

[112]  Marc Pollefeys,et al.  Radiometric alignment of image sequences , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[113]  Enrico Puppo,et al.  Efficient implementation of multi-triangulations , 1998 .

[114]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[115]  Reinhard Koch,et al.  Visual Modeling with a Hand-Held Camera , 2004, International Journal of Computer Vision.

[116]  Gabriel Taubin,et al.  Geometric compression through topological surgery , 1998, TOGS.

[117]  Marc Levoy,et al.  QSplat: a multiresolution point rendering system for large meshes , 2000, SIGGRAPH.

[118]  Katsushi Ikeuchi,et al.  Modeling from Reality , 1998 .

[119]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[120]  Robert Sablatnig,et al.  3D Reconstruction of Archaeological Pottery using Profile Primitives , 2001 .

[121]  James F. Brinkley,et al.  Knowledge-Driven Ultrasonic Three-Dimensional Organ Modeling , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[122]  Dmitry Chetverikov,et al.  Affine propagation for surface reconstruction in wide baseline stereo , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[123]  Jean-Daniel Boissonnat,et al.  Geometric structures for three-dimensional shape representation , 1984, TOGS.

[124]  Michael Deering,et al.  Geometry compression , 1995, SIGGRAPH.

[125]  Gabriele Guidi,et al.  Fusion of range camera and photogrammetry: A systematic procedure for improving 3-D models metric accuracy , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[126]  Li Zhang,et al.  Automatic reconstruction and visualization of a complex Buddha tower of Bayon, Angkor, Cambodia , 2001 .

[127]  Sabry F. El-Hakim,et al.  Combining 3D technologies for cultural heritage interpretation and entertainment , 2005 .

[128]  Paul J. Besl,et al.  Active, optical range imaging sensors , 1988, Machine Vision and Applications.

[129]  Richard I. Hartley.  Ambiguous Configurations for 3-View Projective Reconstruction , 2000, ECCV.

[130]  Sabry F. El-Hakim,et al.  Detailed 3D reconstruction of large-scale heritage sites with integrated techniques , 2004, IEEE Computer Graphics and Applications.

[131]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.