An Approach to Segment and Track-Based Pedestrian Detection from Four-Layer Laser Scanner Data

Pedestrian detection is a critical perception task for autonomous driving and intelligent vehicle, and it is challenging due to the potential variation of appearance and pose of human beings as well as the partial occlusion. In this paper, we present a novel pedestrian detection method via four-layer laser scanner. The proposed approach deals with the occlusion problem by fusing the segment classification results with past knowledge integration from tracking process. First, raw point cloud is segmented into the clusters of independent objects. Then, three types of features are proposed to capture the comprehensive cues, and 18 effective features are extracted with the combination of the univariate feature selection algorithm and feature correlation analysis process. Next, based on the segment classification at individual frame, the track classification is conducted further for consecutive frames using particle filter and probability data association filter. Experimental results demonstrate that both back-propagation neural network and Adaboost classifiers based on 18 selected features have their own advantages at the segment classification stage in terms of pedestrian detection performance and computation time, and the track classification procedure can improve the detection performance particularly for partially occluded pedestrians in comparison with the single segment classification procedure.

[1]  Jouko Lampinen,et al.  Object Classification and Recognition From Mobile Laser Scanning Point Clouds in a Road Environment , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Kwee-Bo Sim,et al.  Novel Intersection Type Recognition for Autonomous Vehicles Using a Multi-Layer Laser Scanner , 2016, Sensors.

[3]  Euntai Kim,et al.  Pedestrian/Vehicle Detection Using a 2.5-D Multi-Layer Laser Scanner , 2016, IEEE Sensors Journal.

[4]  Xin Li,et al.  Vehicle global 6-DoF pose estimation under traffic surveillance camera , 2020 .

[5]  A. T. C. Goh,et al.  Back-propagation neural networks for modeling complex systems , 1995, Artif. Intell. Eng..

[6]  Edward R. Dougherty,et al.  Performance of feature-selection methods in the classification of high-dimension data , 2009, Pattern Recognit..

[7]  Y. Bar-Shalom,et al.  The probabilistic data association filter , 2009, IEEE Control Systems.

[8]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[9]  Jesús García Herrero,et al.  Context aided pedestrian detection for danger estimation based on laser scanner and computer vision , 2014, Expert Syst. Appl..

[10]  Konrad Schindler,et al.  Simultaneous Detection and Tracking of Pedestrian from Panoramic Laser Scanning Data , 2016 .

[11]  Cristiano Premebida,et al.  Pedestrian detection combining RGB and dense LIDAR data , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Wolfram Burgard,et al.  Using Boosted Features for the Detection of People in 2D Range Data , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[13]  Shin'ichi Yuta,et al.  People detection using range and intensity data from multi-layered Laser Range Finders , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Jie Wu,et al.  Delving Deep into Multiscale Pedestrian Detection via Single Scale Feature Maps , 2018, Sensors.

[15]  Jean-Michel Auberlet,et al.  Tracking of multiple people in crowds using laser range scanners , 2014, 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[16]  Jing Zhang,et al.  Pedestrian Attributes Recognition in Surveillance Scenarios Using Multi-Task Lightweight Convolutional Neural Network , 2019 .

[17]  Joelle Pineau,et al.  Person tracking and following with 2D laser scanners , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Yongjun Zhang,et al.  Road Centerline Extraction in Complex Urban Scenes From LiDAR Data Based on Multiple Features , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[19]  G. Gate,et al.  Using targets appearance to improve pedestrian classification with a laser scanner , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[20]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[21]  Chang Wang,et al.  A Framework for Turning Behavior Classification at Intersections Using 3D LIDAR , 2019, IEEE Transactions on Vehicular Technology.

[22]  Wenguang Wang,et al.  Pedestrian Detection with Lidar Point Clouds Based on Single Template Matching , 2019, Electronics.

[23]  Cheng Wang,et al.  A Frustum-based probabilistic framework for 3D object detection by fusion of LiDAR and camera data , 2020 .

[24]  Thierry Chateau,et al.  Pedestrian Detection and Tracking in an Urban Environment Using a Multilayer Laser Scanner , 2010, IEEE Transactions on Intelligent Transportation Systems.

[25]  Murat Lüy,et al.  Initial Results of Testing a Multilayer Laser Scanner in a Collision Avoidance System for Light Rail Vehicles , 2018 .

[26]  Paulo Peixoto,et al.  Semantic fusion of laser and vision in pedestrian detection , 2010, Pattern Recognit..

[27]  Paul Newman,et al.  What could move? Finding cars, pedestrians and bicyclists in 3D laser data , 2012, 2012 IEEE International Conference on Robotics and Automation.

[28]  Jun Xu,et al.  3D-GIoU: 3D Generalized Intersection over Union for Object Detection in Point Cloud , 2019, Sensors.

[29]  António E. Ruano,et al.  Fast Line, Arc/Circle and Leg Detection from Laser Scan Data in a Player Driver , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[30]  Juyang Weng,et al.  Incremental Online Object Learning in a Vehicular Radar-Vision Fusion Framework , 2011, IEEE Transactions on Intelligent Transportation Systems.