Real-time multi-scale pedestrian detection for driver assistance systems

Pedestrian detection is one of the most challenging and vital tasks of driver assistance systems (DAS). Among several algorithms developed for human detection, histogram of oriented gradients (HOG) followed by support vector machine (SVM) has shown the most promising results. This paper presents a hardware accelerator for real-time pedestrian detection at different scales to fulfill the real-time requirements of DAS. It proposes an algorithmic modification to the conventional multi-scale object detection by means of HOG+SVM to increase the throughput and maintain the accuracy reasonably high. Our hardware accelerator detects pedestrians at the rate of 60 fps for HDTV (1080×1920) frame.

[1]  Long Chen,et al.  Fast pedestrian detection based on object proposals and HOG , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[2]  Thambipillai Srikanthan,et al.  Real-Time Image Resizing Hardware Accelerator for Object Detection Algorithms , 2013, 2013 International Symposium on Electronic System Design.

[3]  Shintaro Izumi,et al.  Architectural Study of HOG Feature Extraction Processor for Real-Time Object Detection , 2012, 2012 IEEE Workshop on Signal Processing Systems.

[4]  Pietro Perona,et al.  The Fastest Pedestrian Detector in the West , 2010, BMVC.

[5]  Marc Green,et al.  "How Long Does It Take to Stop?" Methodological Analysis of Driver Perception-Brake Times , 2000 .

[6]  F. Xavier Roca,et al.  Toward Real-Time Pedestrian Detection Based on a Deformable Template Model , 2014, IEEE Transactions on Intelligent Transportation Systems.

[7]  Luc Van Gool,et al.  Pedestrian detection at 100 frames per second , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Theocharis Theocharides,et al.  A Parallel Hardware Architecture for Real-Time Object Detection with Support Vector Machines , 2012, IEEE Transactions on Computers.

[9]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[10]  Navneet Dalal,et al.  Finding People in Images and Videos , 2006 .

[11]  Smaïl Niar,et al.  HOG Feature Extractor Hardware Accelerator for Real-Time Pedestrian Detection , 2014, 2014 17th Euromicro Conference on Digital System Design.

[12]  Ulrich Brunsmann,et al.  FPGA-Based Real-Time Pedestrian Detection on High-Resolution Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[13]  Seung-Eun Lee,et al.  Accelerating Histograms of Oriented Gradients descriptor extraction for pedestrian recognition , 2013, Comput. Electr. Eng..

[14]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[18]  Seonyoung Lee,et al.  HOG feature extractor circuit for real-time human and vehicle detection , 2012, TENCON 2012 IEEE Region 10 Conference.

[19]  Mohan M. Trivedi,et al.  Looking at Vehicles on the Road: A Survey of Vision-Based Vehicle Detection, Tracking, and Behavior Analysis , 2013, IEEE Transactions on Intelligent Transportation Systems.