Local self-similarity frequency descriptor for multispectral feature matching

This paper describes a robust feature descriptor called the local self-similarity frequency (LSSF) for the multispectral RGB-NIR feature matching, which uses the frequency response of the local internal layout of self-similarities. A nonlinear relationship between multi-spectral image pairs makes conventional descriptors be sensitive to spectral deformation. To alleviate this problem, the LSSF employs a weighted correlation surface reducing the discrepancy between mul-tispectral images. Furthermore, the LSSF provides a rotation invariance exploiting the frequency response of maximal values on logpolar bins based on the fact that a cyclic shift on the log-polar representation leads only a phase shift in a frequency domain. Experimental results show that LSSF outperforms state-of-the-art descriptors in terms of a recognition rate for multispectral RGB-NIR image pairs.

[1]  Steven D. Hordley,et al.  Scene illuminant estimation: Past, present, and future , 2006 .

[2]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Yee-Hong Yang,et al.  Rotation Invariant Local Frequency Descriptors for Texture Classification , 2013, IEEE Transactions on Image Processing.

[4]  Sabine Süsstrunk,et al.  Multispectral interest points for RGB-NIR image registration , 2011, 2011 18th IEEE International Conference on Image Processing.

[5]  Guillaume-Alexandre Bilodeau,et al.  Fast and Accurate Registration of Visible and Infrared Videos , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Guillaume-Alexandre Bilodeau,et al.  Local self-similarity-based registration of human ROIs in pairs of stereo thermal-visible videos , 2013, Pattern Recognit..

[7]  Gabriela Csurka,et al.  Semantic Image Segmentation Using Visible and Near-Infrared Channels , 2012, ECCV Workshops.

[8]  R. Fergus,et al.  Dark flash photography , 2009, ACM Trans. Graph..

[9]  Seungryong Kim,et al.  ABFT: Anisotropic binary feature transform based on structure tensor space , 2013, 2013 IEEE International Conference on Image Processing.

[10]  Wolfgang Hübner,et al.  Local multi-modal image matching based on self-similarity , 2010, 2010 IEEE International Conference on Image Processing.

[11]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[12]  Matti Pietikäinen,et al.  Rotation-Invariant Image and Video Description With Local Binary Pattern Features , 2012, IEEE Transactions on Image Processing.

[13]  Sabine Süsstrunk,et al.  Multi-spectral SIFT for scene category recognition , 2011, CVPR 2011.

[14]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  James M. Morand,et al.  A performance evaluation , 1980 .

[16]  Vincent Lepetit,et al.  BRIEF: Computing a Local Binary Descriptor Very Fast , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Sajid Saleem,et al.  A Performance Evaluation of SIFT and SURF for Multispectral Image Matching , 2012, ICIAR.

[18]  Cheng Lu,et al.  On the removal of shadows from images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Sabine Süsstrunk,et al.  Color image dehazing using the near-infrared , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[20]  Z. Yi,et al.  Multi-spectral remote image registration based on SIFT , 2008 .

[21]  Gerald Schaefer,et al.  Solving for Colour Constancy using a Constrained Dichromatic Reflection Model , 2001, International Journal of Computer Vision.

[22]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[23]  Gabriela Csurka,et al.  Combining Visible and Near-Infrared Cues for image Categorisation , 2011, BMVC.