Towards a multi-softcore FPGA approach for the HOG algorithm

Object detection in images is a computing demanding task which usually needs to deal with the detection of different classes of objects, and thus requiring variations and adaptations easily provided by software solutions. Object detection algorithms are being part of real-time smarter embedded systems, such as automotive, medical, robotics and security systems. In most embedded systems, efficient implementations of object oriented algorithms need to provide high performance, low power consumption, and programmability to allow greater development flexibility. The Histogram of Oriented Gradients (HOG) is one of the most widely used algorithms for object detection in images. In this paper, we show our work towards mapping the HOG algorithm to an FPGA-based system consisting of multiple Nios II softcore processors and bearing in mind high-performance and programmability issues. We show how to reduce 19x the algorithms execution time by source to source transformations and specially avoiding redundant processing. Furthermore, we show how the use of pipelining processing using three Nios II processors allows a speedup of 49x compared to the embedded baseline application.

[1]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Bernt Schiele,et al.  Ten Years of Pedestrian Detection, What Have We Learned? , 2014, ECCV Workshops.

[3]  Marek Gorgon,et al.  Floating point HOG implementation for real-time multiple object detection , 2012, 22nd International Conference on Field Programmable Logic and Applications (FPL).

[4]  Mohan M. Trivedi,et al.  Efficient Lane and Vehicle Detection with Integrated Synergies (ELVIS) , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Roger F. Woods,et al.  Histogram of oriented gradients front end processing: An FPGA based processor approach , 2014, 2014 IEEE Workshop on Signal Processing Systems (SiPS).

[6]  Vittorio Murino,et al.  FPGA-based pedestrian detection using array of covariance features , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[7]  Narayanan Vijaykrishnan,et al.  A scalable architecture for multi-class visual object detection , 2015, 2015 25th International Conference on Field Programmable Logic and Applications (FPL).

[8]  Ryusuke Miyamoto,et al.  Hardware architecture for high-accuracy real-time pedestrian detection with CoHOG features , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[9]  Silvio Savarese,et al.  EFFEX: An embedded processor for computer vision based feature extraction , 2011, 2011 48th ACM/EDAC/IEEE Design Automation Conference (DAC).

[10]  Shintaro Izumi,et al.  Architectural Study of HOG Feature Extraction Processor for Real-Time Object Detection , 2012, 2012 IEEE Workshop on Signal Processing Systems.

[11]  Ulrich Brunsmann,et al.  FPGA-Based Real-Time Pedestrian Detection on High-Resolution Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Amit K. Roy-Chowdhury,et al.  Evaluation and Acceleration of High-Throughput Fixed-Point Object Detection on FPGAs , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Ramakant Nevatia,et al.  Optimizing discrimination-efficiency tradeoff in integrating heterogeneous local features for object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Jian Cheng,et al.  Pedestrian Detection Based on HOG-LBP Feature , 2011, 2011 Seventh International Conference on Computational Intelligence and Security.

[16]  Seung-Eun Lee,et al.  Accelerating Histograms of Oriented Gradients descriptor extraction for pedestrian recognition , 2013, Comput. Electr. Eng..

[17]  Hiroyuki Ochi,et al.  Hardware Architecture for HOG Feature Extraction , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[18]  Qingquan Li,et al.  Traffic sign detection and recognition for intelligent vehicle , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[19]  Smaïl Niar,et al.  HOG Feature Extractor Hardware Accelerator for Real-Time Pedestrian Detection , 2014, 2014 17th Euromicro Conference on Digital System Design.