Automatic Georeferencing of Airborne Pushbroom Scanner Images With Missing Ancillary Data Using Mutual Information

We describe a methodology that is used for the automatic georeferencing of multispectral images acquired from airborne pushbroom imaging cameras. This methodology is based upon the dense registration of flight strips data onto a reference orthoimage and uses the mutual information criterion to make the raw (source) image and the orthoimage (target) aligned. By taking into account a rigorous modeling of the pushbroom imaging process, we show how the mutual information between the raw image and the orthoimage can be used to estimate unknown or inaccurate flight attitude parameters [(tilt bias angles, instantaneous yaw, and height above ground level (AGL)] without using any ground control nor tie points. Moreover, we show how a coarse digital elevation model can be incorporated in the proposed procedure to improve the geocorrection and even estimate a digital surface model of the surveyed area. Two experiments using Compact Airborne Spectrographic Imager (CASI) and Airborne Imaging Spectroradiometer for Applications (AISA) Eagle sensor data are described and show the effectiveness of our approach, with planimetric root mean square errors being in the range of two to four pixels, depending on the flatness and land cover, and altimetric root mean square errors being less than 1% of the flight altitude AGL.

[1]  Jacqueline Le Moigne,et al.  Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient , 2003, IEEE Trans. Image Process..

[2]  Gary E. Christensen,et al.  Consistent Linear-Elastic Transformations for Image Matching , 1999, IPMI.

[3]  Cheng-Chang Lu,et al.  Multi-modality Image Registration Using Mutual Information Based on Gradient Vector Flow , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  David M. Mount,et al.  Image Registration and Fusion Studies for the Integration of Multiple Remote Sensing Data , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[5]  A. Ardeshir Goshtasby,et al.  2-D and 3-D Image Registration: for Medical, Remote Sensing, and Industrial Applications , 2005 .

[6]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[7]  Claude Cariou,et al.  Semi-Rigid Registration of Remote Sensing Airborne Scanner Images , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[8]  Olivier D. Faugeras,et al.  Variational Methods for Multimodal Image Matching , 2002, International Journal of Computer Vision.

[9]  Wim Bakker,et al.  Imaging Spectrometry: Basic Analytical Techniques , 2002 .

[10]  Jacqueline Le Moigne,et al.  Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery , 2005, IEEE Transactions on Image Processing.

[11]  Paul R. Wolf,et al.  Elements of photogrammetry with air photo interpretation and remote sensing / Paul R. Wolf , 1974 .

[12]  Christian Germain,et al.  Partial unmixing of multi or hyperspectral images using ICA and Fuzzy Clustering techniques. Application to vegetation mapping on vineyards. , 2006 .

[13]  Pramod K. Varshney,et al.  Tighter Performance Bounds on Image Registration , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[14]  Jean-Yves Tourneret,et al.  Bivariate Gamma Distributions for Image Registration and Change Detection , 2007, IEEE Transactions on Image Processing.

[15]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[16]  Jordi Inglada,et al.  On the possibility of automatic multisensor image registration , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Eli Saber,et al.  Automatic registration of multisensor airborne imagery , 2005, 34th Applied Imagery and Pattern Recognition Workshop (AIPR'05).

[18]  D. Fritsch,et al.  ON THE PREFORMANCE OF DIGITAL AIRBORNE PUSHBROOM CAMERAS FOR PHOTOGRAMMETRIC DATA PROCESSING - A CASE STUDY , 2000 .

[19]  Jordi Inglada,et al.  A New Statistical Similarity Measure for Change Detection in Multitemporal SAR Images and Its Extension to Multiscale Change Analysis , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Michael I. Miller,et al.  Group Actions, Homeomorphisms, and Matching: A General Framework , 2004, International Journal of Computer Vision.

[21]  Pramod K. Varshney,et al.  Performance of mutual information similarity measure for registration of multitemporal remote sensing images , 2003, IEEE Trans. Geosci. Remote. Sens..

[22]  Marios S. Pattichis,et al.  Robust Multispectral Image Registration Using Mutual-Information Models , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[24]  Guoqing Zhou,et al.  True orthoimage generation in urban areas with very tall buildings , 2004 .