Combining static and dynamic features for real-time moving pedestrian detection

Pedestrian detecting and tracking are critical techniques in video monitoring. However, real-time pedestrian detection is still challenging in surveillance videos with complex background. In existing frameworks, feature extractions are usually time-consuming to achieve high detection accuracy. In this paper, we propose to combine sparse static and dynamic features to improve the feature extraction speed while keeping high detection accuracy. Firstly, the static sparse feature is extracted using a fast feature pyramid in each frame. Secondly, sparse optical flow is used to extract sparse dynamic feature among successive frames. Thirdly, we combine the two types of feature in the Adaboost classification. Experiments show that the average miss rate of our approach is 17%. The detection rate is up to 22 fps in a Matlab implementation. It shows that our approach achieves optimal detection accuracy compared to the state-of-the-art real-time pedestrian detection algorithms.

[1]  Xiaogang Wang,et al.  Joint Deep Learning for Pedestrian Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Yong Ding,et al.  Image Quality Assessment Based on Natural Image Statistics , 2018 .

[3]  Feiqi Deng,et al.  Research on Intelligent Visual Surveillance for Public Security , 2007, 6th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2007).

[4]  Sherin M. Youssef,et al.  Detection and tracking of multiple moving objects with occlusion in smart video surveillance systems , 2010, 2010 5th IEEE International Conference Intelligent Systems.

[5]  Paul A. Viola,et al.  Multiple-Instance Pruning For Learning Efficient Cascade Detectors , 2007, NIPS.

[6]  Bernt Schiele,et al.  Filtered channel features for pedestrian detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Mubarak Shah,et al.  Identifying Behaviors in Crowd Scenes Using Stability Analysis for Dynamical Systems , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Anton van den Hengel,et al.  Pedestrian Detection with Spatially Pooled Features and Structured Ensemble Learning , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[10]  Chia-Feng Juang,et al.  Moving Object Classification Using a Combination of Static Appearance Features and Spatial and Temporal Entropy Values of Optical Flows , 2015, IEEE Transactions on Intelligent Transportation Systems.

[11]  Ganesh Sundaramoorthi,et al.  Shape Tracking with Occlusions via Coarse-to-Fine Region-Based Sobolev Descent , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Arthur Daniel Costea,et al.  Semantic Channels for Fast Pedestrian Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Stefan Roth,et al.  People-tracking-by-detection and people-detection-by-tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Armin B. Cremers,et al.  Informed Haar-Like Features Improve Pedestrian Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Xiaofeng Zhu,et al.  Graph self-representation method for unsupervised feature selection , 2017, Neurocomputing.

[17]  B. Schiele,et al.  How Far are We from Solving Pedestrian Detection? , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[19]  Robert T. Collins,et al.  Vision-Based Analysis of Small Groups in Pedestrian Crowds , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Xuelong Li,et al.  Pedestrian Detection Inspired by Appearance Constancy and Shape Symmetry , 2016, CVPR.

[21]  Dinggang Shen,et al.  A novel relational regularization feature selection method for joint regression and classification in AD diagnosis , 2017, Medical Image Anal..

[22]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[23]  Pietro Perona,et al.  Fast Feature Pyramids for Object Detection , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  S. G. Ghurye A Characterization of the Exponential Function , 1957 .

[25]  Bernt Schiele,et al.  New features and insights for pedestrian detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.