Semi-Automated DIRSIG scene modeling from 3D lidar and passive imagery

The Digital Imaging and Remote Sensing Image Generation (DIRSIG) model is an established, first-principles based scene simulation tool that produces synthetic multispectral and hyperspectral images from the visible to long wave infrared (0.4 to 20 microns). Over the last few years, significant enhancements such as spectral polarimetric and active Light Detection and Ranging (lidar) models have also been incorporated into the software, providing an extremely powerful tool for multi-sensor algorithm testing and sensor evaluation. However, the extensive time required to create large-scale scenes has limited DIRSIG’s ability to generate scenes ”on demand.” To date, scene generation has been a laborious, time-intensive process, as the terrain model, CAD objects and background maps have to be created and attributed manually. To shorten the time required for this process, this research developed an approach to reduce the man-in-the-loop requirements for several aspects of synthetic scene construction. Through a fusion of 3D lidar data with passive imagery, we were able to semi-automate several of the required tasks in the DIRSIG scene creation process. Additionally, many of the remaining tasks realized a shortened implementation time through this application of multi-modal imagery. Lidar data is exploited to identify ground and object features as well as to define initial tree location and building parameter estimates. These estimates are then refined by analyzing high-

[1]  Wolfgang Förstner,et al.  Towards automatic building extraction from high-resolution digital elevation models , 1995 .

[2]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[3]  Paul E. Lewis,et al.  Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XV , 2006 .

[4]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[5]  Herbert Edelsbrunner,et al.  Three-dimensional alpha shapes , 1994, ACM Trans. Graph..

[6]  Emmanuel P. Baltsavias,et al.  DTM and orthoimage generation - a thorough analysis and comparison of four digital photogrammetric systems , 1998 .

[7]  Richard J. Pollock,et al.  Model-based approach to automatically locating tree crowns in high spatial resolution images , 1994, Remote Sensing.

[8]  Uwe Weidner,et al.  An Approach to Building Extraction from Digital Surface Models , 1996 .

[9]  Michael S. Foster Using Lidar to geometrically-constrain signature spaces for physics-based target detection , 2007 .

[10]  T. Schenk FUSION OF LIDAR DATA AND AERIAL IMAGERY FOR A MORE COMPLETE SURFACE DESCRIPTION , 2002 .

[11]  Gail P. Anderson,et al.  Atmospheric correction for shortwave spectral imagery based on MODTRAN4 , 1999, Optics & Photonics.

[12]  Chengcui Zhang,et al.  A progressive morphological filter for removing nonground measurements from airborne LIDAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[13]  Hung C. Li A Generalized Problem of Least Squares , 1984 .

[14]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[15]  Ramakant Nevatia,et al.  Automatic description of complex buildings from multiple images , 2004, Comput. Vis. Image Underst..

[16]  John Trinder,et al.  Using the Dempster-Shafer method for the fusion of LIDAR data and multi-spectral images for building detection , 2005, Inf. Fusion.

[17]  A. Ardeshir Goshtasby,et al.  Registration of images with geometric distortions , 1988 .

[18]  Claus Brenner BUILDING RECONSTRUCTION FROM LASER SCANNING AND IMAGES , 2003 .

[19]  John P. Kerekes,et al.  Processing misregistered hyperspectral data , 2007, SPIE Defense + Commercial Sensing.

[20]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[21]  Joseph L. Mundy,et al.  Relationship between photogrammmetry and computer vision , 1993, Defense, Security, and Sensing.

[22]  John R. Schott,et al.  Remote Sensing: The Image Chain Approach , 1996 .

[24]  M. Elmqvist GROUND SURFACE ESTIMATION FROM AIRBORNE LASER SCANNER DATA USING ACTIVE SHAPE MODELS , 2002 .

[25]  G. Vosselman SLOPE BASED FILTERING OF LASER ALTIMETRY DATA , 2000 .

[26]  J. Shan,et al.  Building boundary tracing and regularization from airborne lidar point clouds , 2007 .

[27]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  P. Reiss,et al.  Laser scanning—surveying and mapping agencies are using a new technique for the derivation of digital terrain models , 1999 .

[29]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Monocular Building Extraction From Aerial Imagery , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  S. R. Lach,et al.  Semi-automated DIRSIG scene modeling from 3D LIDAR and passive imaging sources , 2006, SPIE Defense + Commercial Sensing.

[31]  John P. Kerekes,et al.  3D Scene Reconstruction through a Fusion of Passive Video and Lidar Imagery , 2007, 36th Applied Imagery Pattern Recognition Workshop (aipr 2007).

[32]  Cedric Nishan Canagarajah,et al.  Image segmentation using a texture gradient based watershed transform , 2003, IEEE Trans. Image Process..

[33]  P. Wolf,et al.  Elements of Photogrammetry(with Applications in GIS) , 2000 .

[34]  Ali Mohammad-Djafari,et al.  EVALUATION AND PRACTICAL ISSUES OF SUBPIXEL IMAGE REGISTRATION USING PHASE CORRELATION METHODS , 2005 .

[35]  C. Briese,et al.  AUTOMATIC GENERATION OF BUILDING MODELS FROM LIDAR DATA AND THE INTEGRATION OF AERIAL IMAGES , 2003 .

[36]  George Vosselman,et al.  Two algorithms for extracting building models from raw laser altimetry data , 1999 .

[37]  Franz Rottensteiner,et al.  Semi-automatic extraction of buildings based on hybrid adjustment using 3D surface models and management of building data in a TIS , 2001 .

[38]  K R Piech INTERPRETATION OF SOILS , 1974 .

[39]  Dorin Comaniciu,et al.  Nonparametric robust methods for computer vision , 2000 .

[40]  John R. Schott,et al.  Characterization techniques for incorporating backgrounds into DIRSIG , 2000, Defense, Security, and Sensing.

[41]  K. Kraus,et al.  Determination of terrain models in wooded areas with airborne laser scanner data , 1998 .

[42]  D. C. Robertson,et al.  MODTRAN cloud and multiple scattering upgrades with application to AVIRIS , 1998 .

[43]  Morten Ødegaard Nielsen True orthophoto generation , 2004 .

[44]  Avril Behan,et al.  Steps towards Quality Improvement of Airborne Laser Scanner Data , 2000 .

[45]  Armin B. Cremers,et al.  Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D , 1998, Comput. Vis. Image Underst..

[46]  K. Piech,et al.  Aerial Color Analysis of Water Quality , 1971 .

[47]  Ayman Habib,et al.  INTERPOLATION OF LIDAR DATA AND AUTOMATIC BUILDING EXTRACTION , 2002 .

[48]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[49]  G. Sithole FILTERING OF LASER ALTIMETRY DATA USING A SLOPE ADAPTIVE FILTER , 2001 .

[50]  Alan Shuchat Generalized Least Squares and Eigenvalues , 1985 .

[51]  Tee-Ann Teo,et al.  Building reconstruction from LIDAR data and aerial imagery , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[52]  Ruijin Ma DEM Generation and Building Detection from Lidar Data , 2005 .

[53]  Scott D. Brown,et al.  Advances in wide-area hyperspectral image simulation , 2003, SPIE Defense + Commercial Sensing.

[54]  Zhilin Li,et al.  A Split-and-Merge Technique for Automated Reconstruction of Roof Planes , 2005 .

[55]  Edwin M. Winter,et al.  New procedures for the calibration of COMPASS , 2004, SPIE Defense + Commercial Sensing.

[56]  Stefan Mayer Constrained optimization of building contours from high-resolution ortho-images , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[57]  Eli Saber,et al.  Automatic registration of multisensor airborne imagery , 2005, 34th Applied Imagery and Pattern Recognition Workshop (AIPR'05).

[58]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[59]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[60]  Ruijin Ma,et al.  Building model reconstruction from LIDAR data and aerial photographs , 2005 .

[61]  YingLiang Ma,et al.  A Parallelized Surface Extraction Algorithm for Large Binary Image Data Sets Based on an Adaptive 3-D Delaunay Subdivision Strategy , 2008, IEEE Transactions on Visualization and Computer Graphics.

[62]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[63]  Eli Saber,et al.  A harris corner label enhanced MMI algorithm for multi-modal airborne image registration , 2007, VISAPP.

[64]  Babak Ameri Shahrabi Automatic Recognition and 3D Reconstruction of Buildings through Computer Vision and Digital Photogrammetry , 2000 .