Illumination-Invariant Feature Point Detection Based on Neighborhood Information

Feature point detection is the basis of computer vision, and the detection methods with geometric invariance and illumination invariance are the key and difficult problem in the field of feature detection. This paper proposes an illumination-invariant feature point detection method based on neighborhood information. The method can be summarized into two steps. Firstly, the feature points are divided into eight types according to the number of connected neighbors. Secondly, each type of feature points is classified again according to the position distribution of neighboring pixels. The theoretical deduction proves that the proposed method has lower computational complexity than other methods. The experimental results indicate that, when the photometric variation of the two images is very large, the feature-based detection methods are usually inferior, while the learning-based detection methods performs better. However, our method performs better than the learning-based detection method in terms of the number of feature points, the number of matching points, and the repeatability rate stability. The experimental results demonstrate that the proposed method has the best illumination robustness among state-of-the-art feature detection methods.

[1]  Torsten Sattler,et al.  D2-Net: A Trainable CNN for Joint Description and Detection of Local Features , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Shree K. Nayar,et al.  Determining the Camera Response from Images: What Is Knowable? , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Hwann-Tzong Chen,et al.  Histogram-based interest point detectors , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Tomasz Malisiewicz,et al.  SuperPoint: Self-Supervised Interest Point Detection and Description , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Krystian Mikolajczyk,et al.  Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filters , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[7]  Qi Tian,et al.  A survey of recent advances in visual feature detection , 2015, Neurocomputing.

[8]  Ling Guan,et al.  A Novel Key-Point Detector Based on Sparse Coding , 2020, IEEE Transactions on Image Processing.

[9]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[10]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[11]  Xudong Jiang,et al.  Contrast Invariant Interest Point Detection by Zero-Norm LoG Filter , 2016, IEEE Transactions on Image Processing.

[12]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[13]  Vincent Lepetit,et al.  LIFT: Learned Invariant Feature Transform , 2016, ECCV.

[14]  Murat Gevrekci,et al.  Illumination robust interest point detection , 2009, Comput. Vis. Image Underst..

[15]  Long Quan,et al.  ASLFeat: Learning Local Features of Accurate Shape and Localization , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Rui Fang,et al.  Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization , 2019, Sensors.

[17]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[18]  Shiqian Wu,et al.  Exposure-Robust Alignment of Differently Exposed Images , 2014, IEEE Signal Processing Letters.

[19]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[20]  Greg Ward,et al.  Fast, Robust Image Registration for Compositing High Dynamic Range Photographs from Hand-Held Exposures , 2003, J. Graphics, GPU, & Game Tools.

[21]  Hans P. Moravec Obstacle avoidance and navigation in the real world by a seeing robot rover , 1980 .

[22]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[23]  Flore Faille,et al.  A fast method to improve the stability of interest point detection under illumination changes , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[24]  Torsten Sattler,et al.  Quad-Networks: Unsupervised Learning to Rank for Interest Point Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Tianhan Gao,et al.  Feature Point Extraction and Matching Method Based on Akaze in Illumination Invariant Color Space , 2020, 2020 IEEE 5th International Conference on Image, Vision and Computing (ICIVC).

[26]  Zhengguo Li,et al.  Instant Color Matching for Mobile Panorama Imaging , 2015, IEEE Signal Processing Letters.

[27]  Pascal Fua,et al.  LF-Net: Learning Local Features from Images , 2018, NeurIPS.

[28]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[29]  Liangcai Zeng,et al.  A robust method for aligning large-photometric-variation and noisy images , 2015, 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP).

[30]  Henawy John,et al.  Accurate IMU Factor Using Switched Linear Systems for VIO , 2020, IEEE Transactions on Industrial Electronics.

[31]  Mudassar Raza,et al.  Object detection and classification: a joint selection and fusion strategy of deep convolutional neural network and SIFT point features , 2018, Multimedia Tools and Applications.

[32]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[33]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[34]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Vincent Lepetit,et al.  TILDE: A Temporally Invariant Learned DEtector , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Vaclav Hlavaÿc Exposure time estimation for high dynamic range imaging with hand held camera , 2006 .

[37]  Xudong Jiang,et al.  Interest point detection using rank order LoG filter , 2013, Pattern Recognit..