A high-speed feature matching method of high-resolution aerial images

This paper presents a novel corner detection and scale estimation algorithm for image feature description and matching. Inspired by Adaboost’s weak classifier, a series of sub-detectors is elaborately designed to obtain reliable corner pixels. The new corner detection algorithm is more robust than the FAST and HARRIS algorithm, and it is especially suitable for the implementation in FPGA. The new scale estimation method can be directly implemented in the original image without building Gaussian pyramid and searching max response value in each level, which not only increase computational efficiency but also greatly reduces memory requirement. Based on the proposed algorithm, a CPU-FPGA cooperative parallel processing architecture is presented. The architecture overcomes the memory space limitation of FPGA and achieves high-speed feature matching for massive high-resolution aerial images. The speed of the CPU-FPGA cooperative process is hundred times faster than SIFT algorithm running on CPU, and dozens of times faster than SIFT running in CPU + GPU system.

[1]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[2]  Antonio J. Plaza,et al.  Recent Developments in High Performance Computing for Remote Sensing: A Review , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Zhang Bing,et al.  Intelligent remote sensing satellite system , 2011, National Remote Sensing Bulletin.

[4]  Cordelia Schmid,et al.  A Comparison of Affine Region Detectors , 2005, International Journal of Computer Vision.

[5]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[6]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[8]  Vibha Patel,et al.  Indexing SURF Features by SVD Based Basis on GPU with Multi-Query Support , 2014, ICIC.

[9]  Jin Zhao,et al.  Real-time traffic sign detection using SURF features on FPGA , 2013, 2013 IEEE High Performance Extreme Computing Conference (HPEC).

[10]  Yung-Chang Chen,et al.  High-Performance SIFT Hardware Accelerator for Real-Time Image Feature Extraction , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[12]  Trevor Hastie,et al.  Multi-class AdaBoost ∗ , 2009 .

[13]  Yannis Avrithis,et al.  The medial feature detector: Stable regions from image boundaries , 2011, 2011 International Conference on Computer Vision.

[14]  Eriko Nurvitadhi,et al.  Accelerating Binarized Neural Networks: Comparison of FPGA, CPU, GPU, and ASIC , 2016, 2016 International Conference on Field-Programmable Technology (FPT).

[15]  Kin Hong Wong,et al.  An efficient FPGA implementation of the Harris corner feature detector , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[16]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[17]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[18]  S. Buckley,et al.  Automatic Illumination‐Invariant Image‐to‐Geometry Registration in Outdoor Environments , 2017 .

[19]  Chao Jiang,et al.  SIFT implementation based on GPU , 2013, Other Conferences.

[20]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[21]  Tom Drummond,et al.  ORB feature extraction and matching in hardware , 2015, ICRA 2015.

[22]  Zhiguo Cao,et al.  A real-time embedded architecture for SIFT , 2013, J. Syst. Archit..

[23]  Luciano Lavagno,et al.  High-Level Synthesis for Semi-Global Matching: Is the Juice Worth the Squeeze? , 2017, IEEE Access.

[24]  Guoqing Zhou,et al.  On-Board Detection and Matching of Feature Points , 2017, Remote. Sens..

[25]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[26]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[27]  Jorge Stolfi,et al.  Measuring the Information Content of Fracture Lines , 2005, International Journal of Computer Vision.

[28]  Óscar Martínez Mozos,et al.  A comparative evaluation of interest point detectors and local descriptors for visual SLAM , 2010, Machine Vision and Applications.

[29]  Philippe Fillatreau,et al.  FPGA based accelerator for visual features detection , 2015, 2015 IEEE International Workshop of Electronics, Control, Measurement, Signals and their Application to Mechatronics (ECMSM).

[30]  Sathish S. Vadhiyar,et al.  A real-time implementation of SIFT using GPU , 2018, Journal of Real-Time Image Processing.

[31]  Oana Boncalo,et al.  An FPGA sliding window-based architecture harris corner detector , 2014, 2014 24th International Conference on Field Programmable Logic and Applications (FPL).

[32]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[33]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Giancarlo Raiconi,et al.  Real-Time Low-Power FPGA Architecture for Stereo Vision , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[35]  Yunquan Zhang,et al.  HartSift: A High-Accuracy and Real-Time SIFT Based on GPU , 2017, 2017 IEEE 23rd International Conference on Parallel and Distributed Systems (ICPADS).

[36]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Scott Krig,et al.  Computer Vision Metrics: Survey, Taxonomy, and Analysis , 2014 .

[38]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..