Accelerating image boundary detection by hardware parallelism

Image boundary can provide useful information for high-level tasks in computer vision applications. However, high-quality image boundary detection algorithms are computationally intensive, which limits their applicability in real-world applications. In this paper, a study on accelerating algorithms of image boundary detection by hardware parallelism is presented. The Pb (Probability boundary) algorithm, as one representative high-quality algorithm of gradient-based boundary detection, is selected. Firstly, different types of parallelisms existing in Pb are analyzed. Then, suitable hardware structures to accelerate Pb based on those parallelisms are discussed. Finally, time performance, accuracy and scalability of the parallel Pb detector accelerated by hardware are presented. After being implemented in a Xilinx Virtex-7 FPGA, XC7VX485T-2FFG1761C, the parallel Pb detector with the working frequency of 200MHz takes 6.3ms to process an 321x481 image. It is more competitive than Pb implemented on CPUs when larger images are processed. This paper demonstrates a promising way to improve the real-time performance of high-quality image boundary detection systems, especially when embedded and real-time systems are taken into account.

[1]  Jitendra Malik,et al.  Using contours to detect and localize junctions in natural images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Xiaofeng Ren,et al.  Multi-scale Improves Boundary Detection in Natural Images , 2008, ECCV.

[4]  Kurt Keutzer,et al.  Efficient, high-quality image contour detection , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[5]  Patrick Pérez,et al.  JetStream: probabilistic contour extraction with particles , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  Suhaib A. Fahmy,et al.  Architecture for Real-Time Nonparametric Probability Density Function Estimation , 2013, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[7]  Jie Jiang,et al.  An improved real-time hardware architecture for Canny edge detection based on FPGA , 2012, 2012 Third International Conference on Intelligent Control and Information Processing.

[8]  Luc Van Gool,et al.  Efficient Non-Maximum Suppression , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[9]  Michael A. Pusateri,et al.  Towards real-time hardware gamma correction for dynamic contrast enhancement , 2009, 2009 IEEE Applied Imagery Pattern Recognition Workshop (AIPR 2009).

[10]  M.-A. Ibarra-Manzano,et al.  Design and Optimization of Real-Time Texture Analysis Using Sum and Difference Histograms Implemented on an FPGA , 2010, 2010 IEEE Electronics, Robotics and Automotive Mechanics Conference.

[11]  Robert Simon Sherratt,et al.  Parallel pipelined array architectures for real-time histogram computation in consumer devices , 2011, IEEE Transactions on Consumer Electronics.

[12]  J. Yang,et al.  Directional morphology and its application in boundary detection , 1995 .

[13]  Zhuowen Tu,et al.  Supervised Learning of Edges and Object Boundaries , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Tiberiu Seceleanu,et al.  Multiprocessor real time edge detection using FPGA IP cores , 2011, 2011 IEEE 7th International Conference on Intelligent Computer Communication and Processing.

[15]  Spiridon Nikolaidis,et al.  Real-time canny edge detection parallel implementation for FPGAs , 2010, 2010 17th IEEE International Conference on Electronics, Circuits and Systems.

[16]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[17]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  D. Sagi,et al.  Gabor filters as texture discriminator , 1989, Biological Cybernetics.

[19]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[20]  Jitendra Malik,et al.  Learning to detect natural image boundaries using local brightness, color, and texture cues , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jitendra Malik,et al.  Contour and Texture Analysis for Image Segmentation , 2001, International Journal of Computer Vision.

[22]  Martial Hebert,et al.  Discriminative Sparse Image Models for Class-Specific Edge Detection and Image Interpretation , 2008, ECCV.

[23]  Richard D. Green,et al.  Real-time Texture Boundary Detection from Ridges in the Standard Deviation Space , 2009, BMVC.