Wide baseline image mosaicing by integrating MSER and Hessian-Affine

In this paper we propose a novel approach for wide-baseline image mosaicing which integrates MSER and Hessian-Affine detectors. MSER and Hessian-Affine are both robust detectors for wide-baseline stereo matching and they can be integrated owing to their availability in the structured scenes and the rich-textured scenes separately. However, the output shape of them is different, so they cannot be directly integrated. We use an affine covariant construction method to unify their output shape. At the same time, we introduce a standard elliptic equation to unify the ellipse parameters. The axial length and rotation matrix of ellipse with scale are calculated in accordance to the eigenvalue and eigenvector of image feature regions. Then MSER and Hessian-Affine regions are constructed as standard elliptical regions, and described as a unified parameter form. Our method provides more plentiful and robust features so that wide-baseline images can be stitched well. We design an experiment to compare the proposed method with the method based on SIFT. By testing 30 various image pairs, our experiment indicates that the proposed method is effective and available for the wide baseline images mosaicing, especially in the structured scenes with rich texture.

[1]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[2]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[3]  Juho Kannala,et al.  Quasi-Dense Wide Baseline Matching Using Match Propagation , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Ameesh Makadia,et al.  Feature Tracking for Wide-Baseline Image Retrieval , 2010, ECCV.

[5]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[6]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[7]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[8]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Andrea Vedaldi An Implementation of Multi-Dimensional Maximally Stable Extremal Regions , 2007 .

[10]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[12]  Lu Wang,et al.  Wide-baseline image matching using Line Signatures , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[14]  Alexander M. Bronstein,et al.  Are MSER Features Really Interesting? , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.