Salient motion detection in crowded scenes

To reduce cognitive overload in CCTV monitoring, it is critical to have an automated way to focus the attention of operators on interesting events taking place in crowded public scenes. We present a global motion saliency detection method based on spectral analysis, which aims to discover and localise interesting regions, of which the flows are salient in relation to the dominant crowd flows. The method is fast and does not rely on prior knowledge specific to a scene and any training videos. We demonstrate its potential on public scene videos, with applications in salient action detection, counter flow detection, and unstable crowd flow detection.

[1]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, ICCV.

[2]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[3]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[4]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Shaogang Gong,et al.  Segmenting Highly Textured Nonstationary Background , 2007, BMVC.

[6]  Antonio Torralba,et al.  Statistics of natural image categories , 2003, Network.

[7]  Liming Zhang,et al.  Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Fei Yang,et al.  Temporal Spectral Residual for fast salient motion detection , 2012, Neurocomputing.

[9]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[10]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[12]  Tao Xiang,et al.  Identifying Rare and Subtle Behaviors: A Weakly Supervised Joint Topic Model , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Shaogang Gong,et al.  Incremental Activity Modeling in Multiple Disjoint Cameras , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Hayley Shi-Wen Hung,et al.  From visual saliency to video behaviour understanding , 2007 .

[15]  Qingshan Liu,et al.  Temporal spectral residual: fast motion saliency detection , 2009, ACM Multimedia.

[16]  Shaogang Gong,et al.  Multi-layered Decomposition of Recurrent Scenes , 2008, ECCV.

[17]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[18]  Mary W. Green.  The appropriate and effective use of security technologies in U.S. schools : a guide for schools and law enforcement agencies. , 1999 .

[19]  P. Siva,et al.  Action Detection in Crowd , 2010, BMVC.

[20]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.