Hand-Crafted Features vs Deep Learning for Pedestrian Detection in Moving Camera

Received: 7 January 2020 Accepted: 8 March 2020 Detecting pedestrians and other objects in images taken from moving platforms is an essential task needed for many applications such as smart surveillance systems and intelligent transportation systems. However, most detectors in this domain still rely on handcrafted features to separate the foreground objects from the background. While these types of methods have presented good results with good response times, they still have some weaknesses to overcome. In recent years, alternative object detection methods are being proposed, with deep learning based approaches rising in popularity thanks to their promising results. In this paper, we propose two pedestrian detectors for use in images taken from a moving vehicle: The first detector uses a block matching algorithm and handcraft features for pedestrian detection, and the second uses a Faster R-CNN deep detector. We also compare both systems’ performances to other state-of-the-art pedestrian detectors. Our results show that although handcraft feature-based approach achieves good results within acceptable detection times, it suffers from a high false positive rate. However, we found that Faster R-CNN detector performs better in terms of precision and recall, but these improved results come at a cost of detection time.

[1]  Dong-Sun Kim,et al.  Moving Object Detection Based on Optical Flow Estimation and a Gaussian Mixture Model for Advanced Driver Assistance Systems , 2019, Sensors.

[2]  Najoua Essoukri Ben Amara,et al.  Pedestrian detection using a moving camera: A novel framework for foreground detection , 2020, Cognitive Systems Research.

[3]  Gianpaolo Francesco Trotta,et al.  Computer vision and deep learning techniques for pedestrian detection and tracking: A survey , 2018, Neurocomputing.

[4]  Abdelmalik Taleb-Ahmed,et al.  OLIMP: A Heterogeneous Multimodal Dataset for Advanced Environment Perception , 2020, Electronics.

[5]  David Ribeiro,et al.  Efficient and robust Pedestrian Detection using Deep Learning for Human-Aware Navigation , 2016, Robotics Auton. Syst..

[6]  Sherali Zeadally,et al.  Sensor Technologies for Intelligent Transportation Systems , 2018, Sensors.

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Anouar Ben Khalifa,et al.  Pedestrian Detection Based on Background Compensation with Block-Matching Algorithm , 2018, 2018 15th International Multi-Conference on Systems, Signals & Devices (SSD).

[9]  Kaushal Kumar,et al.  A Robust mRMR Based Pedestrian Detection Approach Using Shape Descriptor , 2019, Traitement du Signal.

[10]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Imen Jegham,et al.  Pedestrian Detection in Poor Weather Conditions Using Moving Camera , 2017, 2017 IEEE/ACS 14th International Conference on Computer Systems and Applications (AICCSA).

[12]  Yan Ding,et al.  An Optical Flow based Moving Objects Detection Algorithm for the UAV , 2019, 2019 IEEE 4th International Conference on Computer and Communication Systems (ICCCS).

[13]  Keun-Chang Kwak,et al.  A Performance Comparison of Pedestrian Detection Using Faster RCNN and ACF , 2017, 2017 6th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI).

[14]  Imen Jegham,et al.  MDAD: A Multimodal and Multiview in-Vehicle Driver Action Dataset , 2019, CAIP.

[15]  Mehran Yazdi,et al.  New trends on moving object detection in video images captured by a moving camera: A survey , 2018, Comput. Sci. Rev..

[16]  P. Fua,et al.  Detecting Flying Objects Using a Single Moving Camera , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Kang-Hyun Jo,et al.  Moving Object Detection for a Moving Camera Based on Global Motion Compensation and Adaptive Background Model , 2019, International Journal of Control, Automation and Systems.

[18]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jongin Lim,et al.  Scene conditional background update for moving object detection in a moving camera , 2017, Pattern Recognit. Lett..

[20]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jin Young Choi,et al.  Appearance and motion based deep learning architecture for moving object detection in moving camera , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[22]  Imen Jegham,et al.  Vision-based human action recognition: An overview and real world challenges , 2020, Digit. Investig..

[23]  Nannan Li,et al.  Deep Pedestrian Detection Using Contextual Information and Multi-level Features , 2018, MMM.