Texture-based feature mining for crowd density estimation: A study

Texture feature is an important feature descriptor for many image analysis applications. The objectives of this research are to determine distinctive texture features for crowd density estimation and counting. In this paper, we have comprehensively reviewed different texture features and their different possible combinations to evaluate their performance on pedestrian crowds. A two-stage classification and regression based framework have been proposed for performance evaluation of all the texture features for crowd density estimation and counting. According to the framework, input images are divided into blocks and blocks into cells of different sizes, having varying crowd density levels. Due to perspective distortion, people appearing close to the camera contribute more to the feature vector than people far away. Therefore, features extracted are normalized using a perspective normalization map of the scene. At the first stage, image blocks are classified using multi-class SVM into different density level. At the second stage Gaussian Process Regression is used to re gress low-level features to count. Various texture features and their possible combinations are evaluated on publicly available dataset.

[1]  Lei Huang,et al.  Crowd density analysis using co-occurrence texture features , 2010, 5th International Conference on Computer Sciences and Convergence Information Technology.

[2]  A. Marana,et al.  On the efficacy of texture analysis for crowd monitoring , 1998, Proceedings SIBGRAPI'98. International Symposium on Computer Graphics, Image Processing, and Vision (Cat. No.98EX237).

[3]  M. Nixon,et al.  On crowd density estimation for surveillance , 2006 .

[4]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  L. Li,et al.  On pixel count based crowd density estimation for visual surveillance , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[6]  Jean-Luc Dugelay,et al.  A new multiclass SVM algorithm and its application to crowd density analysis using LBP features , 2013, 2013 IEEE International Conference on Image Processing.

[7]  Hong Liu,et al.  Crowd Density Estimation Based on Local Binary Pattern Co-Occurrence Matrix , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[8]  Luciano da Fontoura Costa,et al.  Estimating crowd density with Minkowski fractal dimension , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[9]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Xuran Zhao,et al.  Crowd density analysis using subspace learning on local binary pattern , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[11]  S. A. R. Abu-Bakar,et al.  Crowd Estimation Using Histogram Model Classification Based on Improved Uniform Local Binary Pattern , 2012 .

[12]  Li Xiaohua,et al.  Estimation of Crowd Density Based on Wavelet and Support Vector Machine , 2006 .

[13]  Simone Calderara,et al.  Detection of static groups and crowds gathered in open spaces by texture classification , 2014, Pattern Recognit. Lett..

[14]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[15]  Hua Yang,et al.  The large-scale crowd density estimation based on sparse spatiotemporal local binary pattern , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[16]  George Bebis.  Advances in Visual Computing, First International Symposium, ISVC 2005, Lake Tahoe, NV, USA, December 5-7, 2005, Proceedings , 2005, ISVC.

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Bonhwa Ku,et al.  Crowd Density Estimation Using Multi-class Adaboost , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[19]  Elham Shaabani,et al.  Crowd Density Estimation for Outdoor Environments , 2014, BICT.

[20]  Yangsheng Xu,et al.  Crowd Density Estimation Using Texture Analysis and Learning , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[21]  Lei Huang,et al.  Advanced Local Binary Pattern Descriptors for Crowd Estimation , 2008, 2008 IEEE Pacific-Asia Workshop on Computational Intelligence and Industrial Application.

[22]  Lei Huang,et al.  Crowd Estimation Using Multi-Scale Local Texture Analysis and Confidence-Based Soft Classification , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.