Improved pedestrian detection using motion segmentation and silhouette orientation

Pedestrians are the most interesting as well as vulnerable entity from both safety and security perspective in the field of video surveillance. In this article, we present a framework to detect pedestrians across a stationary camera view. Our propositions thrust upon developing a motion segmentation module and a feature extraction module for human localization. In the first stage, a background subtraction method is proposed to collect the initial set of moving objects in the processed frame. A shape descriptor is then presented to encode the pattern of human body in terms of silhouette orientation histogram. Moreover, the principle of Golden ratio is employed to formulate a part-based detector to alleviate the problem with occlusion. Both the above modules are first validated separately, and then as a unified unit, using various statistical measures. The proposed background subtraction module is simulated on twenty video clips taken from three benchmark datasets. The efficacy of our shape descriptor is validated on various image-windows taken from three publicly available datasets. The unified framework including both the modules are tested on two standard surveillance datasets. All the experimental results are uploaded at: https://sites.google.com/site/PedestriansInMotion.

[1]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  W. Eric L. Grimson,et al.  Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Guillaume-Alexandre Bilodeau,et al.  A Self-Adjusting Approach to Change Detection Based on Background Word Consensus , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[4]  Guillaume-Alexandre Bilodeau,et al.  Flexible Background Subtraction with Self-Balanced Local Sensitivity , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Dan Levi,et al.  Part-Based Feature Synthesis for Human Detection , 2010, ECCV.

[9]  Lucia Maddalena,et al.  A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection , 2010, Neural Computing and Applications.

[10]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[11]  Fatih Murat Porikli,et al.  CDnet 2014: An Expanded Change Detection Benchmark Dataset , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Massimo Piccardi,et al.  Mean-shift background image modelling , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[13]  M. Hubert,et al.  An adjusted boxplot for skewed distributions , 2008, Comput. Stat. Data Anal..

[14]  Manoranjan Paul,et al.  Human detection in surveillance videos and its applications - a review , 2013, EURASIP J. Adv. Signal Process..

[15]  Chijung Hwang,et al.  The Efficient Features for Tracking , 2008, 2008 20th IEEE International Conference on Tools with Artificial Intelligence.

[16]  Mingjun Wu,et al.  Spatio-temporal context for codebook-based dynamic background subtraction , 2010 .

[17]  Larry S. Davis,et al.  A Pose-Invariant Descriptor for Human Detection and Segmentation , 2008, ECCV.

[18]  J. Crowley,et al.  CAVIAR Context Aware Vision using Image-based Active Recognition , 2005 .

[19]  Brendt Wohlberg,et al.  Fast principal component pursuit via alternating minimization , 2013, 2013 IEEE International Conference on Image Processing.

[20]  Honghai Liu,et al.  Advances in View-Invariant Human Motion Analysis: A Review , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[21]  De-Sheng Chen,et al.  A real-time moving objects detection and classification approach for static cameras , 2016, 2016 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW).

[22]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[23]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.

[24]  Weiming Shen,et al.  A new pedestrian detection method based on combined HOG and LSS features , 2015, Neurocomputing.

[25]  Paul E. Rybski,et al.  Real-time pedestrian detection with deformable part models , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[26]  Mounir Errami,et al.  Improving Pedestrian Detection Using Support Vector Regression , 2016, 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV).

[27]  Jiaolong Xu,et al.  Learning a Part-Based Pedestrian Detector in a Virtual World , 2014, IEEE Transactions on Intelligent Transportation Systems.

[28]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[29]  Meng Wang,et al.  Automatic adaptation of a generic pedestrian detector to a specific traffic scene , 2011, CVPR 2011.

[30]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Venkatesh Saligrama,et al.  Foreground-Adaptive Background Subtraction , 2009, IEEE Signal Processing Letters.

[32]  Mohan M. Trivedi,et al.  Part-Based Pedestrian Detection and Feature-Based Tracking for Driver Assistance: Real-Time, Robust Algorithms, and Evaluation , 2013, IEEE Transactions on Intelligent Transportation Systems.

[33]  Arnold W. M. Smeulders,et al.  Color Based Object Recognition , 1997, ICIAP.

[34]  Pietro Perona,et al.  Integral Channel Features , 2009, BMVC.

[35]  Sharath Pankanti,et al.  Temporal Non-maximum Suppression for Pedestrian Detection Using Self-Calibration , 2014, 2014 22nd International Conference on Pattern Recognition.

[36]  Pietro Perona,et al.  The Fastest Pedestrian Detector in the West , 2010, BMVC.

[37]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[38]  Ruixia Xu,et al.  Convex programming colour constancy with a diagonal-offset model , 2005, IEEE International Conference on Image Processing 2005.

[39]  Qing Tian,et al.  An Improved Pedestrian Detection Algorithm Integrating Haar-Like Features and HOG Descriptors , 2013 .

[40]  Qinghua Hu,et al.  Efficient Background Modeling Based on Sparse Representation and Outlier Iterative Removal , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Banshidhar Majhi,et al.  Intensity Range Based Background Subtraction for Effective Object Detection , 2013, IEEE Signal Processing Letters.

[42]  Dmitry B. Goldgof,et al.  How effective is human video surveillance performance? , 2008, 2008 19th International Conference on Pattern Recognition.

[43]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Thierry Chateau,et al.  A Benchmark Dataset for Outdoor Foreground/Background Extraction , 2012, ACCV Workshops.

[45]  Dariu Gavrila,et al.  Monocular Pedestrian Detection: Survey and Experiments , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Sheng Tang,et al.  Fast Pedestrian Detection Based on Sliding Window Filtering , 2012, PCM.

[47]  Bernt Schiele,et al.  A Performance Evaluation of Single and Multi-feature People Detection , 2008, DAGM-Symposium.

[48]  Dariu Gavrila,et al.  An Experimental Study on Pedestrian Classification , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Pierre-Marc Jodoin,et al.  Improving pedestrian detection using motion-guided filtering , 2017, Pattern Recognit. Lett..

[50]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Eduardo Ros,et al.  Background Subtraction Based on Color and Depth Using Active Sensors , 2013, Sensors.

[52]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[53]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[54]  Bernt Schiele,et al.  Ten Years of Pedestrian Detection, What Have We Learned? , 2014, ECCV Workshops.

[55]  Larry S. Davis,et al.  Human detection using partial least squares analysis , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[56]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Subhransu Maji,et al.  Classification using intersection kernel support vector machines is efficient , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[58]  Bernt Schiele,et al.  New features and insights for pedestrian detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[59]  Khalid Saeed,et al.  Moving Object Detection Using Background Subtraction , 2014, SpringerBriefs in Computer Science.

[60]  Jeremy S. Smith,et al.  Multi-view and multi-plane data fusion for effective pedestrian detection in intelligent visual surveillance , 2016, Multidimens. Syst. Signal Process..

[61]  Angel D. Sappa,et al.  Adaptive Image Sampling and Windows Classification for On-board Pedestrian Detection , 2007 .