Texture mapping 3D models of real-world scenes

Texture mapping has become a popular tool in the computer graphics industry in the last few years because it is an easy way to achieve a high degree of realism in computer-generated imagery with very little effort. Over the last decade, texture-mapping techniques have advanced to the point where it is possible to generate real-time perspective simulations of real-world areas by texture mapping every object surface with texture from photographic images of these real-world areas. The techniques for generating such perspective transformations are variations on traditional texture mapping that in some circles have become known as the Image Perspective Transformation or IPT technology. This article first presents a background survey of traditional texture mapping. It then continues with a description of the texture-mapping variations that achieve these perspective transformations of photographic images of real-world scenes. The style of the presentation is that of a resource survey rather thatn an in-depth analysis.

[1]  James F. Blinn Hyperbolic Interpolation , 1992, IEEE Computer Graphics and Applications.

[2]  Hanan Samet,et al.  Hierarchical data structures and algorithms for computer graphics. I. Fundamentals , 1988, IEEE Computer Graphics and Applications.

[3]  Ralph Bernstein,et al.  Digital Image Processing of Earth Observation Sensor Data , 1976, IBM J. Res. Dev..

[4]  Mark A. Z. Dippé,et al.  Antialiasing through stochastic sampling , 1985, SIGGRAPH.

[5]  Loren C. Carpenter,et al.  The A -buffer, an antialiased hidden surface method , 1984, SIGGRAPH.

[6]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[7]  J. Dozier,et al.  Orthographic terrain views using data derived from digital elevation models , 1986 .

[8]  Philip K. Robertson,et al.  Spatial transformations for rapid scan-line surface shadowing , 1989, IEEE Computer Graphics and Applications.

[9]  Paul S. Heckbert,et al.  Interpolation for Polygon Texture Mapping and Shading , 1991 .

[10]  P. Burt Fast filter transform for image processing , 1981 .

[11]  W. Marvin Bunker,et al.  Perspective Display Simulation of Terrain. , 1976 .

[12]  David Kirk,et al.  The rendering architecture of the DN10000VS , 1990, SIGGRAPH.

[13]  Michael Shantz,et al.  Shading bicubic patches , 1987, SIGGRAPH.

[14]  Franklin C. Crow,et al.  Summed-area tables for texture mapping , 1984, SIGGRAPH.

[15]  David F. Rogers,et al.  Procedural Elements for Computer Graphics , 1984 .

[16]  Schachter,et al.  Computer Image Generation for Flight Simulation , 1981, IEEE Computer Graphics and Applications.

[17]  Alvy Ray Smith,et al.  3-D transformations of images in scanline order , 1980, SIGGRAPH '80.

[18]  B. G. Junkin Development of three-dimensional spatial displays using a geographically based information system , 1982 .

[19]  Lance Williams,et al.  Pyramidal parametrics , 1983, SIGGRAPH.

[20]  C. A. HART,et al.  Manual of Photogrammetry , 1947, Nature.

[21]  Martin Herman,et al.  Geometric Reasoning for Constructing 3D Scene Descriptions from Images , 1988, Artif. Intell..

[22]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[23]  Kurt Akeley,et al.  The accumulation buffer: hardware support for high-quality rendering , 1990, SIGGRAPH.

[24]  James F. Blinn,et al.  The truth about texture mapping , 1990, IEEE Computer Graphics and Applications.

[25]  Robert L. Cook,et al.  The Reyes image rendering architecture , 1987, SIGGRAPH.

[26]  Frederick M. Weinhaus,et al.  Antialiasing-warped imagery using lookup-table-based methods for adaptive resampling , 1991, Optics & Photonics.

[27]  Takeo Kanade,et al.  Incremental Reconstruction of 3D Scenes from Multiple, Complex Images , 1986, Artif. Intell..

[28]  Bruce J. Schachter,et al.  Computer display of height fields , 1980, Comput. Graph..

[29]  Frederick M. Weinhaus,et al.  Flexible approach to image warping , 1990, Other Conferences.

[30]  M. A. Fischetti,et al.  Simulating 'the right stuff' , 1985 .

[31]  J. Painter,et al.  Antialiased ray tracing by adaptive progressive refinement , 1989, SIGGRAPH.

[32]  M. Carter Computer graphics: Principles and practice , 1997 .

[33]  Paul S. Heckbert,et al.  Creating Raster Omnimax Images from Multiple Perspective Views Using the Elliptical Weighted Average Filter , 1986, IEEE Computer Graphics and Applications.

[34]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[35]  S. Rifman Digital rectification of ERTS multispectral imagery , 1973 .

[36]  J. J. Hood,et al.  Image processing techniques for digital orthophotoquad production , 1989 .

[37]  Masaaki Oka,et al.  Real-time manipulation of texture-mapped surfaces , 1987, SIGGRAPH '87.

[38]  Peter Van Wie,et al.  Purdue e-Pubs , 2013 .

[39]  Gavin S. P. Miller,et al.  The definition and rendering of terrain maps , 1986, SIGGRAPH.

[40]  Alyn P. Rockwood,et al.  Clamping: A method of antialiasing textured surfaces by bandwidth limiting in object space , 1982, SIGGRAPH.

[41]  Theodosios Pavlidis,et al.  A hierarchical data structure for picture processing , 1975 .

[42]  Timothy Butler,et al.  Three approaches to terrain rendering , 1989, Proceedings of the IEEE 1991 National Aerospace and Electronics Conference NAECON 1991.

[43]  D. Perny,et al.  Perspective mapping of planar textures , 1982, COMG.

[44]  Mark Segal,et al.  Fast shadows and lighting effects using texture mapping , 1992, SIGGRAPH.

[45]  Andrew Lippman,et al.  Movie-maps: An application of the optical videodisc to computer graphics , 1980, SIGGRAPH '80.

[46]  David W. Paglieroni,et al.  Parametric height field ray tracing , 1992 .

[47]  Mark Ellis,et al.  Digital Generation Of Stereoscopic Perspective Scenes , 1987, Photonics West - Lasers and Applications in Science and Engineering.

[48]  Frederick P. Brooks,et al.  Fast spheres, shadows, textures, transparencies, and imgage enhancements in pixel-planes , 1985, Advances in Computer Graphics.

[49]  Juan Pineda,et al.  A parallel algorithm for polygon rasterization , 1988, SIGGRAPH.

[50]  Frederick M. Weinhaus,et al.  Photogrammetric Texture Mapping onto Planar Polygons , 1999, Graph. Model. Image Process..

[51]  Hanan Samet,et al.  Hierarchical data structures and algorithms for computer graphics. II. Applications , 1988, IEEE Computer Graphics and Applications.

[52]  John G. Eyles,et al.  PixelFlow: high-speed rendering using image composition , 1992, SIGGRAPH.

[53]  K. J. Hussey,et al.  Image processing methods used to simulate flight over remotely sensed data , 1988 .

[54]  Kirk G. Smedley,et al.  Digital Perspective Generation And Stereo Display Of Composite Ocean Bottom And Coastal Terrain Images , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[55]  George Sutty,et al.  Texture tile considerations for raster graphics , 1978, SIGGRAPH '78.

[56]  Johnson K. Yan Advances in Computer-Generated Imagery for Flight Simulation , 1985, IEEE Computer Graphics and Applications.

[57]  William A. Barrett,et al.  New morphological algorithm for automated interpolation of height grids from contour images , 1990, Other Conferences.

[58]  Mark J. Carlotto,et al.  Connection Machine System For Planetary Terrain Reconstruction And Visualization , 1990, Other Conferences.

[59]  Donald P. Greenberg,et al.  Texture rendering system for architectural design , 1980 .

[60]  Pascal Fua,et al.  Objective functions for feature discrimination: applications to semiautomated and automated feature extraction , 1989 .

[61]  Ralph Bernstein,et al.  Analysis And Processing of LANDSAT-4 Sensor Data Using Advanced Image Processing Techniques And Technologies , 1984, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Alvy Ray Smith,et al.  Planar 2-pass texture mapping and warping , 1987, SIGGRAPH.

[63]  Ned Greene,et al.  Environment Mapping and Other Applications of World Projections , 1986, IEEE Computer Graphics and Applications.

[64]  Michel Gangnet,et al.  Shaded Display of Digital Maps , 1984, IEEE Computer Graphics and Applications.

[65]  Takayuki Tanaka,et al.  ARTS: Accelerated Ray-Tracing System , 1986, IEEE Computer Graphics and Applications.

[66]  A. Nicolas,et al.  Inverse Perspective Mapping in Scanline Order onto Non-Planar Quadrilaterals , 1983, Eurographics.

[67]  M. A. Fischetti,et al.  Simulating `the right stuff' [military simulators] , 1985, IEEE Spectrum.

[68]  Robert N. Devich,et al.  Image Perspective Transformations—Urban Scenes , 1981 .

[69]  Paul S. Heckbert,et al.  Filtering by repeated integration , 1986, SIGGRAPH.

[70]  N. Magnenat-Thalmann,et al.  Image Synthesis Theory and Practice , 1988 .

[71]  Vaughan R. Pratt,et al.  Adaptive forward differencing for rendering curves and surfaces , 1987, SIGGRAPH.

[72]  Robert L. Cook,et al.  Stochastic sampling in computer graphics , 1988, TOGS.

[73]  George Wolberg,et al.  Digital image warping , 1990 .

[74]  A. Peled,et al.  Analytical generation of orthophotos from panoramic photographs , 1984 .

[75]  Karl M. Fant,et al.  A Nonaliasing, Real-Time Spatial Transform Technique , 1986, IEEE Computer Graphics and Applications.

[76]  William Dungan A terrain and cloud computer image generation model , 1979, SIGGRAPH '79.

[77]  Larry J. Thayer,et al.  A fast shaded-polygon renderer , 1986, SIGGRAPH.

[78]  James B. Case The analytical reduction of panoramic and strip photography , 1967 .

[79]  John Staudhammer,et al.  Visibility determination on projected grid surfaces , 1990, IEEE Computer Graphics and Applications.

[80]  Eric A. Bier,et al.  Two-Part Texture Mappings , 1986, IEEE Computer Graphics and Applications.

[81]  H. Tanaka,et al.  Three dimensional Terrain modeling and display for environmental assessment , 1989, SIGGRAPH.

[82]  Paul S. Heckbert,et al.  Survey of Texture Mapping , 1986, IEEE Computer Graphics and Applications.

[83]  Andrew S. Glassner Adaptive precision in texture mapping , 1986, SIGGRAPH.

[84]  Maria Teresa Pareschi,et al.  Modeling and Image Processing for Visualization of Volcanic Mapping , 1989, IBM J. Res. Dev..

[85]  Paul S. Heckbert,et al.  Fundamentals of Texture Mapping and Image Warping , 1989 .

[86]  James R. Baker Linearized Collinearity Equations for Scanned Data , 1977 .

[87]  Venkat Devarajan Image Processing In Visual Systems For Flight Simulation , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[88]  Arliss E. Whiteside Preparing Data Bases For Perspective Scene Generation , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[89]  Michael P. Battaglia,et al.  Real Time Perspective Image Generation , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[90]  Neil Hunt,et al.  The triangle processor and normal vector shader: a VLSI system for high performance graphics , 1988, SIGGRAPH.

[91]  IV DanielF.Stanfill Using image pyramids for the visualization of large terrain data sets , 1991, Int. J. Imaging Syst. Technol..

[92]  A. Ardeshir Goshtasby,et al.  Piecewise cubic mapping functions for image registration , 1987, Pattern Recognit..

[93]  A. Hanson,et al.  Overview of the SRI Cartographic Modeling Environment , 1992 .

[94]  Marc Levoy,et al.  Synthetic texturing using digital filters , 1980, SIGGRAPH '80.

[95]  Robert N. Devich,et al.  Image Perspective Transformations , 1980, Optics & Photonics.

[96]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[97]  Martin D. Levine,et al.  Computer generation of realistic pictures , 1978, Comput. Graph..

[98]  Eugene Fiume,et al.  Constant-time filtering with space-variant kernels , 1988, SIGGRAPH.

[99]  James F. Blinn,et al.  Texture and reflection in computer generated images , 1976, CACM.

[100]  Henry Gouraud,et al.  Computer Display of Curved Surfaces , 1971, Outstanding Dissertations in the Computer Sciences.

[101]  A. Ardeshir Goshtasby,et al.  Piecewise linear mapping functions for image registration , 1986, Pattern Recognit..

[102]  共立出版株式会社 コンピュータ・サイエンス : ACM computing surveys , 1978 .

[103]  Peter Hughes Building a Terrain Renderer , 1991 .

[104]  Philip K. Robertson Fast Perspective Views of Images Using One-Dimensional Operations , 1987, IEEE Computer Graphics and Applications.

[105]  P. J. Burt,et al.  Fast Filter Transforms for Image Processing , 1981 .

[106]  D. P. Anderson Hidden Line Elimination in Projected Grid Surfaces , 1982, TOGS.