Crowd Density Analysis with Marked Point Processes [Applications Corner]

This article presents a Bayesian approach that estimates the count and location of individuals in a video frame. Crowds are modeled by a marked point process (MPP) that couples a spatial stochastic process governing number and placement of individuals with a conditional mark process for selecting body size, shape, and orientation. Given a noisy, binary mask image where pixels are labeled foreground or background, the approach seeks a configuration of cutout shapes that simultaneously "covers" as many foreground pixels and as few background pixels as possible.

[1]  Guillermo Sapiro,et al.  What Can Casual Walkers Tell Us About A 3D Scene? , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[2]  Walter R. Gilks,et al.  MCMC in image analysis , 1995 .

[3]  FuaPascal,et al.  Multicamera People Tracking with a Probabilistic Occupancy Map , 2008 .

[4]  A. Oppenheim,et al.  Nonlinear filtering of multiplied and convolved signals , 1968 .

[5]  Ramakant Nevatia,et al.  Bayesian human segmentation in crowded situations , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Robert T. Collins,et al.  Marked point processes for crowd counting , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  J. Pokorny.  Foundations of Cyclopean Perception , 1972 .

[8]  M Tur,et al.  When is speckle noise multiplicative? , 1982, Applied optics.

[9]  van Marie-Colette Lieshout,et al.  Markov Point Processes and Their Applications , 2000 .

[10]  Josiane Zerubia,et al.  A Marked Point Process of Rectangles and Segments for Automatic Analysis of Digital Elevation Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Merrilee Hurn,et al.  Bayesian object identification , 1999 .

[12]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[13]  Paulo R. S. Mendonça,et al.  Bayesian autocalibration for surveillance , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[14]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Alan C. Bovik,et al.  The SIVA Demonstration Gallery for signal, image, and video processing education , 2002, IEEE Trans. Educ..

[16]  A. Baddeley,et al.  Stochastic geometry models in high-level vision , 1993 .

[17]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[18]  Nicole C. Rust,et al.  Do We Know What the Early Visual System Does? , 2005, The Journal of Neuroscience.

[19]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[20]  Alan C. Bovik,et al.  The Essential Guide to Image Processing , 2009, J. Electronic Imaging.

[21]  Naoki Mukawa,et al.  Multiview occlusion analysis for tracking densely populated objects based on 2-D visual angles , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..