Segmentation of Pedestrians with Confidence Level Computation

In this work, we propose a mechanism to segment groups of pedestrians with confidence level computation for intelligent surveillance systems. The goal is to specify the number of people and locate the position and size of each individual in groups of people. Human detection and clustering techniques are combined to achieve the segmentation purpose. The histogram of oriented gradients and curvelet features are extracted for full body detection using a support vector machine classifier. Modified Haar of Oriented Gradient features are constructed for upper body and lower body detectors. A clustering algorithm is then applied to the detected humans to eliminate the redundant detection responses. The proposed mechanism requires no prior assumptions of human sizes, human heights, camera distances, and other calibration parameters. Moreover, confidence level computation can provide valuable information for subsequent surveillance applications. The proposed approach is tested with pedestrian benchmark dataset and surveillance videos. The experimental results have demonstrated the effectiveness of the proposed pedestrian segmentation mechanism.

[1]  Jiaheng Cao,et al.  Scale Space Histogram of Oriented Gradients for Human Detection , 2008, 2008 International Symposium on Information Science and Engineering.

[2]  Xiaoping Chen,et al.  A robust method for detecting and counting people , 2008, 2008 International Conference on Audio, Language and Image Processing.

[3]  Peter H. Tu,et al.  Detecting and counting people in surveillance applications , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[4]  Visvanathan Ramesh,et al.  Fast Crowd Segmentation Using Shape Indexing , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[5]  S. Paisitkriangkrai,et al.  Performance evaluation of local features in human classification and detection , 2008 .

[6]  Derek R. Magee,et al.  Tracking multiple vehicles using foreground, background and motion models , 2004, Image Vis. Comput..

[7]  Serge J. Belongie,et al.  Counting Crowded Moving Objects , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Tommy W. S. Chow,et al.  A neural-based crowd estimation by hybrid global learning algorithm , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[9]  David A. Forsyth,et al.  Probabilistic Methods for Finding People , 2001, International Journal of Computer Vision.

[10]  Ramakant Nevatia,et al.  Bayesian human segmentation in crowded situations , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Osama Masoud,et al.  Estimating pedestrian counts in groups , 2008, Comput. Vis. Image Underst..

[12]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[14]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[15]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[16]  Emmanuel J. Candès,et al.  What is...a Curvelet , 2003 .

[17]  Lei Huang,et al.  Crowd Estimation Using Multi-Scale Local Texture Analysis and Confidence-Based Soft Classification , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[18]  Leonidas J. Guibas,et al.  Counting people in crowds with a real-time network of simple image sensors , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[19]  Tomaso A. Poggio,et al.  Example-Based Object Detection in Images by Components , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Dariu Gavrila,et al.  An Experimental Study on Pedestrian Classification , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  E. Candès,et al.  New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities , 2004 .

[23]  Tomaso A. Poggio,et al.  A Trainable System for Object Detection , 2000, International Journal of Computer Vision.

[24]  Fernando Boto,et al.  Real-Time People Counting Using Multiple Lines , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[25]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[26]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.

[28]  Weiwei Zhang,et al.  Cat Head Detection - How to Effectively Exploit Shape and Texture Features , 2008, ECCV.

[29]  Ramakant Nevatia,et al.  Detection and Tracking of Multiple, Partially Occluded Humans by Bayesian Combination of Edgelet based Part Detectors , 2007, International Journal of Computer Vision.

[30]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[31]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[32]  T. J. Stonham,et al.  A system for counting people in video images using neural networks to identify the background scene , 1996, Pattern Recognit..

[33]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[35]  Ramin Zabih,et al.  Counting people from multiple cameras , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[36]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[37]  Jenq-Neng Hwang,et al.  Adaptive particle sampling and adaptive appearance for multiple video object tracking , 2009, Signal Process..

[38]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.