Machine Learning for High-Speed Corner Detection

Where feature points are used in real-time frame-rate applications, a high-speed feature detector is necessary. Feature detectors such as SIFT (DoG), Harris and SUSAN are good methods which yield high quality features, however they are too computationally intensive for use in real-time applications of any complexity. Here we show that machine learning can be used to derive a feature detector which can fully process live PAL video using less than 7% of the available processing time. By comparison neither the Harris detector (120%) nor the detection stage of SIFT (300%) can operate at full frame rate. Clearly a high-speed detector is of limited use if the features produced are unsuitable for downstream processing. In particular, the same scene viewed from two different positions should yield features which correspond to the same real-world 3D locations [1]. Hence the second contribution of this paper is a comparison corner detectors based on this criterion applied to 3D scenes. This comparison supports a number of claims made elsewhere concerning existing corner detectors. Further, contrary to our initial expectations, we show that despite being principally constructed for speed, our detector significantly outperforms existing feature detectors according to this criterion.

[1]  Hans P. Moravec Obstacle avoidance and navigation in the real world by a seeing robot rover , 1980 .

[2]  D. J. Langridge,et al.  Curve encoding and the detection of discontinuities , 1982, Comput. Graph. Image Process..

[3]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.

[4]  Gérard G. Medioni,et al.  Corner detection and curve representation using cubic B-splines , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[5]  Harry Wechsler,et al.  High-speed 3D imaging of the beating heart using temporal estimation , 1987 .

[6]  J. Alison Noble,et al.  Finding Corners , 1988, Alvey Vision Conference.

[7]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[8]  Antonio Guiducci,et al.  Corner characterization by differential geometry techniques , 1988, Pattern Recognit. Lett..

[9]  Gérard G. Medioni,et al.  Corner detection and curve representation using cubic B-splines , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[10]  James W. Cooper,et al.  Early jump-out corner detectors , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[12]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[14]  Vikram Srinivasan,et al.  A neural network based corner detection method , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[15]  Han Wang,et al.  Real-time corner detection algorithm for motion estimation , 1995, Image Vis. Comput..

[16]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[17]  Cordelia Schmid,et al.  Comparing and evaluating interest points , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[18]  Han Wang,et al.  Gray Level Corner Detection , 1998, MVA.

[19]  Mark Hedley,et al.  Fast corner detection , 1998, Image Vis. Comput..

[20]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Han Wang,et al.  Analysis of gray level corner detection , 1999, Pattern Recognit. Lett..

[22]  Cordelia Schmid,et al.  Indexing Based on Scale Invariant Interest Points , 2001, ICCV.

[23]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[24]  J. Crowley,et al.  Fast Computation of Characteristic Scale Using a Half-Octave Pyramid , 2002 .

[25]  Alexander Zelinsky,et al.  A Fast Radial Symmetry Transform for Detecting Points of Interest , 2002, ECCV.

[26]  Andrew Zisserman,et al.  Multi-view Matching for Unordered Image Sets, or "How Do I Organize My Holiday Snaps?" , 2002, ECCV.

[27]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[28]  B. S. Manjunath,et al.  A Condition Number for Point Matching with Application to Registration and Postregistration Error Estimation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[30]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[31]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[32]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[33]  B. S. Manjunath,et al.  A Mathematical Comparison of Point Detectors , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[34]  Tom Drummond,et al.  Real-Time Video Annotations for Augmented Reality , 2005, ISVC.

[35]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.