Automatic Line-Based Registration of DSM and Hyperspectral Images

Data fusion techniques require a good registration of all the used datasets. In remote sensing, images are usually geo-referenced using the GPS and IMU data. However, if more precise registration is required, image processing techniques can be employed. We propose a method for multi-modal image coregistration between hyperspectral images (HSI) and digital surface models (DSM). The method is divided in three parts: object and line detection of the same object in HSI and DSM, line matching and determination of transformation parameters. Homogeneous coordinates are used to implement matching and adjustment of transformation parameters. The common object in HSI and DSM are building boundaries. They have apparent change in height and material, that can be detected in DSM and HSI, respectively. Thus, before the matching and transformation parameter computation, building outlines are detected and adjusted in HSI and DSM. We test the method on a HSI and two DSM, using extracted building outbounds and for comparison also extracted lines with a line detector. The results show that estimated building boundaries provide more line assignments, than using line detector.

[1]  I. Dowman,et al.  Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extraction * , 2007 .

[2]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[3]  George Vosselman,et al.  Two algorithms for extracting building models from raw laser altimetry data , 1999 .

[4]  Janja Avbelj,et al.  SPECTRAL INFORMATION RETRIEVAL FOR SUB-PIXEL BUILDING EDGE DETECTION , 2012 .

[5]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[6]  Hui Zeng,et al.  A new normalized method on line-based homography estimation , 2008, Pattern Recognit. Lett..

[7]  Uwe Stilla Map-aided structural analysis of aerial images , 1995 .

[8]  Uwe Stilla,et al.  Line based Matching of Uncertain 3D Building Models with IR Image Sequences for Precise Texture Extraction , 2012 .

[9]  Toni Schenk,et al.  From point-based to feature-based aerial triangulation , 2004 .

[10]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[11]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[12]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Nirmal Keshava,et al.  A Survey of Spectral Unmixing Algorithms , 2003 .

[14]  Chein-I Chang,et al.  An information-theoretic approach to spectral variability, similarity, and discrimination for hyperspectral image analysis , 2000, IEEE Trans. Inf. Theory.

[15]  MARKUS GERKE,et al.  Automatic Detection of Buildings and Trees from Aerial Imagery Using Different Levels of Abstraction , 2001 .

[16]  Uwe Soergel,et al.  Matching of straight line segments from aerial stereo images of urban areas , 2012 .

[17]  Peter Reinartz,et al.  Low-cost optical Camera System for real-time Mapping Applications , 2012 .