A Coarse Elevation Map-based Registration Method for Super-resolution of Three-line Scanner Images

Three-line scanner imagery provides three overlapped images in an along-base direction, and creates a possible avenue to obtain higher quality images through the application of the super-resolution. Accurate co-registration of the three images is a key step for super-resolution. However, discontinuities and occlusions resulting from the 3D-to-2D projection cause mis-registration in traditional 2D-image-level co-registration methods. In this paper, we address this problem by introducing 3D information extracted from image triplets by using GPS/IMU data as an approximation. The core of the proposed method is to use a number of height layers derived from feature points and image partitions, in the form of a coarse elevation map (CEM), as a 3D constraint to restrict registration on the corresponding height. In terms of super-resolution, we also propose a tree-based fast adaptive template matching method for Knife-edge detection to fully automate the SRKE super-resolution algorithm. Experimental results show that the proposed method produces improved registered images and accordingly yields signifi cant resolution enhancement as compared to other methods.

[1]  Ralf Reulke,et al.  Photogrammetric solftware for the LH Systems ADS40 Airborne Digital Sensors , 2000 .

[2]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Q. Du,et al.  Automatic Registration and Mosaicking for Airborne Multispectral Image Sequences , 2008 .

[4]  Jianya Gong,et al.  Multi-frame Image super-resolution based on knife-edges , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[5]  Leila Maria Garcia Fonseca,et al.  Automatic registration and mosaicking system for remotely sensed imagery , 2003, SPIE Remote Sensing.

[6]  Yiannis Aloimonos,et al.  A Roadmap to the Integration of Early Visual Modules , 2007, International Journal of Computer Vision.

[7]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Jan Flusser,et al.  Multiframe blind deconvolution coupled with frame registration and resolution enhancement , 2007 .

[9]  Gong Jianya,et al.  A robust method of calculating point spread function from knife-edge without angular constraint in remote sensing images , 2011 .

[10]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[11]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for surveillance images , 2010, Signal Process..

[12]  Li Zhang Automatic Digital Surface Model (DSM) generation from linear array images , 2005 .

[13]  Philippe Saint-Marc,et al.  Adaptive Smoothing: A General Tool for Early Vision , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  B. S. Manjunath,et al.  Registration Techniques for Multisensor Remotely Sensed Imagery , 1996 .

[16]  Jan Flusser,et al.  Multichannel blind iterative image restoration , 2003, IEEE Trans. Image Process..

[17]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[18]  Feng Li,et al.  Super Resolution for Remote Sensing Images Based on a Universal Hidden Markov Tree Model , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[20]  Zhang Li,et al.  AUTOMATIC DSM GENERATION FROM LINEAR ARRAY IMAGERY DATA , 2004 .

[21]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Luís B. Almeida,et al.  Blind and Semi-Blind Deblurring of Natural Images , 2010, IEEE Transactions on Image Processing.

[23]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[24]  R. A. Hamzah,et al.  Sum of Absolute Differences algorithm in stereo correspondence problem for stereo matching in computer vision application , 2010, 2010 3rd International Conference on Computer Science and Information Technology.