Dempster-Shafer Multifeature Fusion for Pedestrian Detection

Pedestrian detection is of great importance for ensuring traffic safety. In recent years, many works employing image-based shape features to recognize pedestrians have been reported. However, previous pedestrian detectors were in many cases not sufficient to achieve satisfactory results under complex weather conditions and complex scenarios. As a solution this paper exploits two video-based motion feature descriptors and applies such motion features to the detection task in addition to four classical shape features with the aim of significantly improving the detection performance. Our motion features are defined as the trajectory smoothness degree and motion vector field, which are derived from our proposed point tracking strategy beyond tough target segmentation. And then the appealing Dempster-Shafer theory of evidence (D-S theory) is applied to fuse these features, due to the fact that D-S theory is better than the classical Bayesian approach in handling the information with lack of prior probabilities. The proposed automatic pedestrian detection algorithm is evaluated on real data and in real traffic scenes under various weather conditions. Theoretical analysis and experiment results consistently show that the proposed method outperforms SVM-based multifeature fusion approach for pedestrian detection in terms of recognition ability and robustness in various real traffic scenes.

[1]  Antonio M. López,et al.  Road Detection Based on Illuminant Invariance , 2011, IEEE Transactions on Intelligent Transportation Systems.

[2]  Catherine K. Murphy Combining belief functions when evidence conflicts , 2000, Decis. Support Syst..

[3]  Xiangjian He,et al.  Motion Based Pedestrian Recognition , 2008, 2008 Congress on Image and Signal Processing.

[4]  David Gerónimo Gómez,et al.  Survey of Pedestrian Detection for Advanced Driver Assistance Systems , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Liang Zhao,et al.  Stereo- and neural network-based pedestrian detection , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[6]  Kunio Takahashi,et al.  Features of Pedestrian Behavior in Car-to-Pedestrian Contact Situations in Near-Miss Incidents in Japan , 2013, Traffic injury prevention.

[7]  Fernando Puente León,et al.  Information fusion to detect and classify pedestrians using invariant features , 2011, Inf. Fusion.

[8]  Sergio A. Velastin,et al.  A Review of Computer Vision Techniques for the Analysis of Urban Traffic , 2011, IEEE Transactions on Intelligent Transportation Systems.

[9]  Henry Leung,et al.  Data fusion in intelligent transportation systems: Progress and challenges - A survey , 2011, Inf. Fusion.

[10]  S Milch,et al.  PEDESTRIAN DETECTION WITH RADAR AND COMPUTER VISION , 2001 .

[11]  D.M. Gavrila,et al.  Monocular pedestrian recognition using motion parallax , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[12]  Dariu Gavrila,et al.  Pedestrian Detection and Tracking Using a Mixture of View-Based Shape–Texture Models , 2008, IEEE Transactions on Intelligent Transportation Systems.

[13]  G. Gate,et al.  Using targets appearance to improve pedestrian classification with a laser scanner , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[14]  Hans P. Moravec Obstacle avoidance and navigation in the real world by a seeing robot rover , 1980 .

[15]  John Horton,et al.  Evaluation of Initial and Steady-State Gatifloxacin Pharmacokinetics and Dose in Pulmonary Tuberculosis Patients by Using Monte Carlo Simulations , 2013, Antimicrobial Agents and Chemotherapy.

[16]  Larry S. Davis,et al.  Shape-Based Human Detection and Segmentation via Hierarchical Part-Template Matching , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  James Llinas,et al.  Multisensor Data Fusion , 1990 .

[18]  Björn Johansson,et al.  Combining shadow detection and simulation for estimation of vehicle size and position , 2009, Pattern Recognit. Lett..

[19]  G. Paret,et al.  Looking into the crystal ball: can we predict prognosis in children treated with therapeutic hypothermia after cardiac arrest?. , 2012, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[20]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  J. L. Balas Looking into the online crystal ball , 2000 .

[22]  Abdesselam Bouzerdoum,et al.  A biologically inspired visual pedestrian detection system , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[23]  David Zhang,et al.  Moving Vehicle Detection for Automatic Traffic Monitoring , 2007, IEEE Transactions on Vehicular Technology.

[24]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[25]  Peng Zhang,et al.  Vehicle Behavior Analysis Using Target Motion Trajectories , 2014, IEEE Transactions on Vehicular Technology.

[26]  Mauro Barni,et al.  A Framework for Decision Fusion in Image Forensics Based on Dempster–Shafer Theory of Evidence , 2013, IEEE Transactions on Information Forensics and Security.

[27]  Alain Rakotomamonjy,et al.  A Pedestrian Detector Using Histograms of Oriented Gradients and a Support Vector Machine Classifier , 2007, 2007 IEEE Intelligent Transportation Systems Conference.