Flow field texture representation-based motion segmentation for crowd counting

It is evident that crowd counting is one of bottlenecks for crowd-related computer vision theory and applications such as surveillance. Since accuracy of estimating crowd size dominantly depends on the performance of motion detection of pedestrians, this paper attacks the challenging problem mainly by proposing a motion segmentation method based on flow field texture representation. Firstly, the motion crowd and background are represented as different texture images by employing line integral convolution. Then information entropy is introduced to quantify the textures as different values so that the texture images can be segmented; further an optimal threshold is obtained via Otsu method to segment the binarization entropy image. Finally, the area of motion foreground pixels is calculated for each image in a crowd motion video. The size of the crowd is estimated by least squares fitting using abundant datum of foreground pixels’ area and the number of individuals in a crowd. Experimental results demonstrate that the proposed crowd counting method outperforms background subtraction, Gaussian mixture model and optical flow-based methods in terms of mean absolute error and mean relative error.

[1]  Mario Vento,et al.  Counting moving persons in crowded scenes , 2013, Machine Vision and Applications.

[2]  Antonio Valdovinos,et al.  Efficient Feedforward Linearization Technique Using Genetic Algorithms for OFDM Systems , 2010, EURASIP J. Adv. Signal Process..

[3]  Shu-Kai S. Fan,et al.  An entropy-based image registration method using image intensity difference on overlapped region , 2011, Machine Vision and Applications.

[4]  Sang-Chul Lee,et al.  Event classification for vehicle navigation system by regional optical flow analysis , 2011, Machine Vision and Applications.

[5]  Robert T. Collins,et al.  Marked point processes for crowd counting , 2009, CVPR.

[6]  Yangsheng Xu,et al.  An energy model approach to people counting for abnormal crowd behavior detection , 2012, Neurocomputing.

[7]  Mubarak Shah,et al.  Identifying Behaviors in Crowd Scenes Using Stability Analysis for Dynamical Systems , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Mubarak Shah,et al.  A Streakline Representation of Flow in Crowded Scenes , 2010, ECCV.

[10]  Sergio A. Velastin,et al.  Crowd analysis: a survey , 2008, Machine Vision and Applications.

[11]  Honghai Liu,et al.  Target tracking for mobile robot platforms via object matching and background anti-matching , 2010, Robotics Auton. Syst..

[12]  Antonio Albiol,et al.  VIDEO ANALYSIS USING CORNER MOTION STATISTICS , 2009 .

[13]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[14]  C. Mcphail The myth of the madding crowd , 1991 .

[15]  Surendra Ranganath,et al.  Detecting people in dense crowds , 2010, Machine Vision and Applications.

[16]  Honghai Liu,et al.  Advances in View-Invariant Human Motion Analysis: A Review , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  Mohamed Cheriet,et al.  AdOtsu: An adaptive and parameterless generalization of Otsu's method for document image binarization , 2012, Pattern Recognit..

[18]  Mimoun Zelmat,et al.  Pedestrian tracking using color, thermal and location cue measurements: a DSmT-based framework , 2011, Machine Vision and Applications.

[19]  Mubarak Shah,et al.  Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Gordon Erlebacher,et al.  Overview of Flow Visualization , 2005, The Visualization Handbook.

[21]  Shigeharu Miyata,et al.  Improvement of Adaptive Cruise Control Performance , 2010, EURASIP J. Adv. Signal Process..

[22]  Hans-Christian Hege,et al.  Fast and resolution independent line integral convolution , 1995, SIGGRAPH.

[23]  Bernt Schiele,et al.  Pedestrian detection in crowded scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[24]  Sergio A. Velastin,et al.  Crowd monitoring using image processing , 1995 .

[25]  Mubarak Shah,et al.  Multiframe Many–Many Point Correspondence for Vehicle Tracking in High Density Wide Area Aerial Videos , 2013, International Journal of Computer Vision.

[26]  Qian Du,et al.  Optical Flow and Principal Component Analysis-Based Motion Detection in Outdoor Videos , 2010, EURASIP J. Adv. Signal Process..

[27]  Bo Wang,et al.  Abnormal crowd behavior detection using high-frequency and spatio-temporal features , 2011, Machine Vision and Applications.

[28]  Nuno Vasconcelos,et al.  Counting People With Low-Level Features and Bayesian Regression , 2012, IEEE Transactions on Image Processing.

[29]  Robert J. Moorhead,et al.  Accelerated unsteady flow line integral convolution , 2005, IEEE Transactions on Visualization and Computer Graphics.

[30]  Ali Abdo,et al.  Evaluation of Canny and Otsu Image Segmentation , 2012 .

[31]  Robert J. Schalkoff,et al.  A self-organization based optical flow estimator with GPU implementation , 2012, Machine Vision and Applications.

[32]  Hans-Peter Seidel,et al.  Topological methods for 2D time-dependent vector fields based on stream lines and path lines , 2005, IEEE Transactions on Visualization and Computer Graphics.

[33]  Brian Cabral,et al.  Imaging vector fields using line integral convolution , 1993, SIGGRAPH.

[34]  Mario Vento,et al.  A Method for Counting Moving People in Video Surveillance Videos , 2010, EURASIP J. Adv. Signal Process..

[35]  Sheng-Fuu Lin,et al.  Estimation of number of people in crowded scenes using perspective transformation , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[36]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[37]  Ramakant Nevatia,et al.  Segmentation and Tracking of Multiple Humans in Crowded Environments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Serge J. Belongie,et al.  Counting Crowded Moving Objects , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).