A fast image registration approach based on SIFT key-points applied to super-resolution

Abstract An accurate image registration is a fundamental stage in many image processing problems. In this paper, a new and fast registration approach based on scale invariant feature transform (SIFT) key-points, under Euclidean transformation model, is proposed. The core idea of the proposed method is estimation of rotation angle and vertical and horizontal shifts using averaging of differences of SIFT key-point pairs locations. The method is simple but requires some tuning modules for accurate estimation. Orientation modification and compensation and shift compensation are some of the proposed modules. The proposed method is fast, about ive times faster than RANSAC method for model parameters estimation. The accuracy of the proposed method is compared with some popular registration methods. Various comparisons have been done with LIVE database images with known motion vectors. The experimental results over two real video sequences show the high performance of the proposed algorithm in a super-resolution application.

[1]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[2]  Thomas S. Huang,et al.  Multiframe image restoration and registration , 1984 .

[3]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[4]  Mahmood Fathy,et al.  Reconstruction+Synthesis: A Hybrid Method for Multi-Frame Super-Resolution , 2008 .

[5]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[7]  Z. Yi,et al.  Multi-spectral remote image registration based on SIFT , 2008 .

[8]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[10]  Sung-Jea Ko,et al.  Fast digital image stabilizer based on Gray-coded bit-plane matching , 1999, IEEE Trans. Consumer Electron..

[11]  Mahmood Fathy,et al.  Outlier Removal for Super-Resolution Problem Using QR-Decomposition , 2008, IPCV.

[12]  Mahmood Fathy,et al.  Regional Varying Image Super-Resolution , 2009, 2009 International Joint Conference on Computational Sciences and Optimization.

[13]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[15]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[16]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[17]  Sean Borman,et al.  Topics in Multiframe Superresolution Restoration , 2004 .

[18]  M. Vetterli,et al.  Super-resolution from Unregistered Aliased Images , 2006 .

[19]  Alan C. Bovik,et al.  Image quality assessment using natural scene statistics , 2004 .

[20]  Beatrice Gralton,et al.  Washington DC - USA , 2008 .

[21]  Sheng Li,et al.  Super resolution based on scale invariant feature transform , 2008, 2008 International Conference on Audio, Language and Image Processing.

[22]  Tuan Q. Pham.  Spatiotonal adaptivity in super-resolution of under-sampled image sequences , 2006 .