Image Stitching based on Feature Extraction Techniques: A Survey

stitching (Mosaicing) is considered as an active research area in computer vision and computer graphics. Image stitching is concerned with combining two or more images of the same scene into one high resolution image which is called panoramic image. Image stitching techniques can be categorized into two general approaches: direct and feature based techniques. Direct techniques compare all the pixel intensities of the images with each other, whereas feature based techniques aim to determine a relationship between the images through distinct features extracted from the processed images. The last approach has the advantage of being more robust against scene movement, faster, and has the ability to automatically discover the overlapping relationships among an unordered set of images. The purpose of this paper is to present a survey about the feature based image stitching. The main components of image stitching will be described. A framework of a complete image stitching system based on feature based approaches will be introduced. Finally, the current challenges of image stitching will be discussed. Keywordsstitching/mosaicing, panoramic image, features based detection, SIFT, SURF, image blending.

[1]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[4]  K. Shashank,et al.  A Survey and Review Over Image Alignment and Stitching Methods , 2014 .

[5]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[7]  Richard Szeliski,et al.  Seamless Image Stitching of Scenes with Large Motions and Exposure Differences , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Chao Wang,et al.  Improved SIFT-Features Matching for Object Recognition , 2008, BCS Int. Acad. Conf..

[9]  Hetal M. Patel,et al.  Comprehensive Study And Review Of Image Mosaicing Methods , 2012 .

[10]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[12]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[13]  Ryszard Tadeusiewicz,et al.  Computer Vision and Graphics , 2014, Lecture Notes in Computer Science.

[14]  Hetal M. Patel,et al.  Panoramic Image Mosaicing , 2013 .

[15]  Edward H. Adelson,et al.  PYRAMID METHODS IN IMAGE PROCESSING. , 1984 .

[16]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  H. K. Abhyankar,et al.  Image Registration Techniques: An overview , 2009 .

[19]  Greg Ward,et al.  Hiding seams in high dynamic range panoramas , 2006, SIGGRAPH '06.

[20]  Tong Zhang,et al.  Generating panorama photos , 2003, SPIE ITCom.

[21]  Philip F. McLauchlan,et al.  Image mosaicing using sequential bundle adjustment , 2002, Image Vis. Comput..

[22]  Richard Szeliski,et al.  Image Alignment and Stitching , 2006, Handbook of Mathematical Models in Computer Vision.

[23]  Wenqing Huang,et al.  Automatic image stitching using SIFT , 2008, 2008 International Conference on Audio, Language and Image Processing.

[24]  Umesh C. Pati,et al.  A Robust Technique for Feature-based Image Mosaicing using Image Fusion , 2013 .

[25]  Muhammad Shakir,et al.  Video Summarization: Techniques and Classification , 2012, ICCVG.

[26]  A. V. Kulkarni,et al.  Object recognition with ORB and its Implementation on FPGA , 2013 .

[27]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[28]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[29]  Shmuel Peleg,et al.  Seamless Image Stitching in the Gradient Domain , 2004, ECCV.

[30]  Dieter Schmalstieg,et al.  Real-time self-localization from panoramic images on mobile devices , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[31]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[32]  Russol Abdelfatah,et al.  Automatic Seamless of Image Stitching , 2013 .

[33]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[34]  ZhangZhengyou.  A Flexible New Technique for Camera Calibration , 2000 .

[35]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[36]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[37]  Philip F. McLauchlan,et al.  Image Mosaicing using Sequential Bundle Adjustments , 2000, BMVC.

[38]  D. K. Jain,et al.  Image Mosaicing Using Corner Techniques , 2012, 2012 International Conference on Communication Systems and Network Technologies.

[39]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.