Multi-line buffer based pipeline architecture with junction connectivity analysis for high frame rate and ultra-low delay contour-based corner detection

High frame rate and ultra-low delay corner detection plays an increasingly important role in factory automated scenarios with a demand for accurate and robust corner features. However, classic intensity-based corner detection like the Harris method has limitations in determining corner types and parameter selection. Conventional contour-based corner detection like Chord to Triangular Arms Ratio (CTAR) method uses global level curve extraction based on the whole frame, leading to high delay. Achieving corner detection nearly simultaneous with capturing the same image provides a workable solution to minimize the delay. To modify the conventional detection methods which arbitrarily process any pixels within the scope of the entire input, a multi-line buffer based pipeline architecture is proposed. Using this pipeline, the whole frame is divided into lines processed independently. Junction connectivity analysis is proposed to define corner types based on the architecture. The proposed algorithm almost keeps the robustness (Average Repeatability of 0.5715, Localization Error of 0.4285) with the original CTAR method (AR of 0.5832, LE of 0.4374), better than the Harris method (AR of 0.5322, LE of 0.7324).

[1]  Songlin Du,et al.  Straight-Line Detection Within 1 Millisecond Per Frame for Ultrahigh-Speed Industrial Automation , 2023, IEEE Transactions on Industrial Informatics.

[2]  Takeshi Ikenaga,et al.  Highly-Parallel Hardwired Deep Convolutional Neural Network for 1-ms Dual-Hand Tracking , 2022, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Songlin Du,et al.  Subpixel Displacement Measurement at 784 FPS: From Algorithm to Hardware System , 2022, IEEE Transactions on Instrumentation and Measurement.

[4]  Yui-Lam Chan,et al.  Efficient Depth Intra Frame Coding in 3D-HEVC by Corner Points , 2020, IEEE Transactions on Image Processing.

[5]  Hei Law,et al.  CornerNet: Detecting Objects as Paired Keypoints , 2018, International Journal of Computer Vision.

[6]  Takeshi Ikenaga,et al.  Pixel Selection and Intensity Directed Symmetry for High Frame Rate and Ultra-Low Delay Matching System , 2018, IEICE Trans. Inf. Syst..

[7]  Junqing Wang,et al.  A Survey of Corner Detection Methods , 2018, ICEE18.

[8]  Sébastien Ourselin,et al.  Corner-Based Geometric Calibration of Multi-focus Plenoptic Cameras , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Guojun Lu,et al.  Effective and efficient contour-based corner detectors , 2015, Pattern Recognit..

[10]  Guojun Lu,et al.  Performance Comparisons of Contour-Based Corner Detectors , 2012, IEEE Transactions on Image Processing.

[11]  Guojun Lu,et al.  A Fast Corner Detector Based on the Chord-to-Point Distance Accumulation Technique , 2009, 2009 Digital Image Computing: Techniques and Applications.

[12]  Ling Xu,et al.  Robust image corner detection based on scale evolution difference of planar curves , 2009, Pattern Recognit. Lett..

[13]  Guojun Lu,et al.  Robust Image Corner Detection Based on the Chord-to-Point Distance Accumulation Technique , 2008, IEEE Transactions on Multimedia.

[14]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[15]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[17]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Hans P. Moravec Towards Automatic Visual Obstacle Avoidance , 1977, IJCAI.