A Parallel Convolutional Neural Network for Pedestrian Detection

Pedestrian detection is a crucial task in many vision-based applications, such as video surveillance, human activity analysis and autonomous driving. Recently, most of the existing pedestrian detection frameworks only focus on the detection accuracy or model parameters. However, how to balance the detection accuracy and model parameters, is still an open problem for the practical application of pedestrian detection. In this paper, we propose a parallel, lightweight framework for pedestrian detection, named ParallelNet. ParallelNet consists of four branches, each of them learns different high-level semantic features. We fused them into one feature map as the final feature representation. Subsequently, the Fire module, which includes Squeeze and Expand parts, is employed for reducing the model parameters. Here, we replace some convolution modules in the backbone with Fire modules. Finally, the focal loss is led into the ParallelNet for end-to-end training. Experimental results on the Caltech–Zhang dataset and KITTI dataset show that: Compared with the single-branch network, such as ResNet and SqueezeNet, ParallelNet has improved detection accuracy with fewer model parameters and lower Giga Floating Point Operations (GFLOPs).

[1]  Jie Huang,et al.  RobNet: real-time road-object 3D point cloud segmentation based on SqueezeNet and cyclic CRF , 2019, Soft Comput..

[2]  Shuicheng Yan,et al.  Scale-Aware Fast R-CNN for Pedestrian Detection , 2015, IEEE Transactions on Multimedia.

[3]  John E. Ball,et al.  Machine Learning and Embedded Computing in Advanced Driver Assistance Systems (ADAS) , 2019, Electronics.

[4]  Nasser Kehtarnavaz,et al.  Semi-Supervised Faster RCNN-Based Person Detection and Load Classification for Far Field Video Surveillance , 2019, Mach. Learn. Knowl. Extr..

[5]  Sergio Orts-Escolano,et al.  A New Dataset and Performance Evaluation of a Region-based CNN for Urban Object Detection , 2018 .

[6]  Jesus Morales,et al.  Motion Detection from Mobile Robots with Fuzzy Threshold Selection in Consecutive 2D Laser Scans , 2015 .

[7]  Woo-Sung Jung,et al.  Lightweight Driver Monitoring System Based on Multi-Task Mobilenets , 2019, Sensors.

[8]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Bernt Schiele,et al.  Towards Reaching Human Performance in Pedestrian Detection , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Tae-Hyoung Park,et al.  Channel-Based Network for Fast Object Detection of 3D LiDAR , 2020, Electronics.

[11]  Liquan Zhao,et al.  Object Detection Algorithm Based on Improved YOLOv3 , 2020, Electronics.

[12]  José Eugenio Naranjo,et al.  Deep Learning Framework for Vehicle and Pedestrian Detection in Rural Roads on an Embedded GPU , 2020, Electronics.

[13]  Wei Chen,et al.  High-Resolution Image Inpainting Based on Multi-Scale Neural Network , 2019, Electronics.

[14]  Dong-Hyun Lee Fully Convolutional Single-Crop Siamese Networks for Real-Time Visual Object Tracking , 2019 .

[15]  Tam V. Nguyen,et al.  Detecting Objects from Space: An Evaluation of Deep-Learning Modern Approaches , 2020, Electronics.

[16]  Danqing Xu,et al.  Improved YOLO-V3 with DenseNet for Multi-Scale Remote Sensing Target Detection , 2020, Sensors.

[17]  Li Cheng,et al.  Too Far to See? Not Really!—Pedestrian Detection With Scale-Aware Localization Policy , 2017, IEEE Transactions on Image Processing.

[18]  Kang Ryoung Park,et al.  Robust Pedestrian Detection by Combining Visible and Thermal Infrared Cameras , 2015, Sensors.

[19]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[20]  Lei Feng,et al.  An FPGA-Based CNN Accelerator Integrating Depthwise Separable Convolution , 2019, Electronics.

[21]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Feng Xiao,et al.  Multi-Object Detection in Traffic Scenes Based on Improved SSD , 2018, Electronics.

[23]  Wenguang Wang,et al.  Pedestrian Detection with Lidar Point Clouds Based on Single Template Matching , 2019, Electronics.