Crowd Density Estimation Based on a Modified Multicolumn Convolutional Neural Network

Crowd management has been a topic of concern for many years because accidents frequently occur in situations with a high crowd density. With only a finite amount of space available during shows, protests, or other special occasions, a high crowd density can present a clear danger for those in the area. Considering these challenges, we employed and modified a three-tier multicolumn convolutional neural network (MCNN) system architecture to precisely estimate crowd density. We distinguished three regions from the near to far field to produce a crowd density map. Based on the MCNN system architecture, we detected changes in the size of a crowd according to a distance measure and examined additional features that can be incorporated to demonstrate their effects on crowd density maps. Examining these features using the Shanghaitech dataset demonstrated that compared with the native MCNN, the accuracy of estimating crowd counting by using our proposed method increased by 22.97% and 18.64% in terms of mean absolute error (MAE) and mean square error (MSE), respectively. A performance comparison with other state-of-the-art methods was also made. From this, we can infer that the proposed system is compatible with the other listed methods and is worthy of further investigation.

[1]  Fang Li,et al.  Image retrieval based on deep Convolutional Neural Networks and binary hashing learning , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Xuran Zhao,et al.  Crowd density analysis using subspace learning on local binary pattern , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[3]  Joost van de Weijer,et al.  Leveraging Unlabeled Data for Crowd Counting by Learning to Rank , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Li Hou,et al.  Image Crowd Counting Using Convolutional Neural Network and Markov Random Field , 2017, J. Adv. Comput. Intell. Intell. Informatics.

[5]  Xiaochun Cao,et al.  Deep People Counting in Extremely Dense Crowds , 2015, ACM Multimedia.

[6]  Jin Tang,et al.  An effective approach to crowd counting with CNN-based statistical features , 2017, 2017 International Smart Cities Conference (ISC2).

[7]  Michael Blumenstein,et al.  Texture-based feature mining for crowd density estimation: A study , 2016, 2016 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[8]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[9]  Claudio Cusano,et al.  Single and Multiple Illuminant Estimation Using Convolutional Neural Networks , 2015, IEEE Transactions on Image Processing.

[10]  Neeta Nain,et al.  Multi-source approach for crowd density estimation in still images , 2017, 2017 IEEE International Conference on Identity, Security and Behavior Analysis (ISBA).

[11]  Larry S. Davis,et al.  Shape-Based Human Detection and Segmentation via Hierarchical Part-Template Matching , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Zhang Xingguo,et al.  Video scene invariant crowd density estimation using geographic information systems , 2014, China Communications.

[13]  Serge J. Belongie,et al.  Counting Crowded Moving Objects , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Xiangjian He,et al.  Structured Inhomogeneous Density Map Learning for Crowd Counting , 2018, ArXiv.

[15]  Teresa Iturrioz-Aguirre,et al.  Using Bivariate Gaussian Distribution Confidence Ellipses of Lightning Flashes for Efficiently Computing Reliable Large Area Density Maps , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[17]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[19]  Roberto Cipolla,et al.  Unsupervised Bayesian Detection of Independent Motion in Crowds , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[20]  Haroon Idrees,et al.  Multi-source Multi-scale Counting in Extremely Dense Crowd Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Vishal M. Patel,et al.  Generating High-Quality Crowd Density Maps Using Contextual Pyramid CNNs , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Meng Wang,et al.  Automatic adaptation of a generic pedestrian detector to a specific traffic scene , 2011, CVPR 2011.

[23]  Jean-Luc Dugelay,et al.  Crowd density map estimation based on feature tracks , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[24]  Cina Motamed,et al.  People counting via multiple views using a fast information fusion approach , 2017, Multimedia Tools and Applications.

[25]  Xiaogang Wang,et al.  DeepID-Net: Object Detection with Deformable Part Based Convolutional Neural Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Shiyong Cui,et al.  Bayesian linear regression for crowd density estimation in aerial images , 2017, 2017 Joint Urban Remote Sensing Event (JURSE).

[27]  Shenghua Gao,et al.  Single-Image Crowd Counting via Multi-Column Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Shiv Surya,et al.  Switching Convolutional Neural Network for Crowd Counting , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Yu Zhao,et al.  3-D functional brain network classification using Convolutional Neural Networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[30]  Vishal M. Patel,et al.  CNN-Based cascaded multi-task learning of high-level prior and density estimation for crowd counting , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[31]  Xiaogang Wang,et al.  Cross-scene crowd counting via deep convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Shiliang Pu,et al.  Estimation of crowd density in surveillance scenes based on deep convolutional neural network , 2017 .

[33]  Xiangmin Xu,et al.  Multi-scale convolutional neural networks for crowd counting , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[34]  Srinivas S. Kruthiventi,et al.  CrowdNet: A Deep Convolutional Network for Dense Crowd Counting , 2016, ACM Multimedia.

[35]  Yaoxuan Yuan.  Crowd Monitoring Using Mobile Phones , 2014, 2014 Sixth International Conference on Intelligent Human-Machine Systems and Cybernetics.