Slow Feature Analysis for Multi-Camera Activity Understanding

Multi-camera activity analysis is a key point in video surveillance of many wide-area scenes, such as airports, underground stations, shopping mall and road junctions. On the basis of previous work, this paper presents a new feature learning method based on Slow Feature Analysis (SFA) to understand activities observed across the network of cameras. The main contribution of this paper can be summarized as follows: (1) It is the first time that SFA-based learning method is introduced to multi-camera activity understanding, (2) It presents an evaluation to examine the effectiveness of SFA-based method to facilitate the learning of inter-camera activity pattern dependencies, and (3) It estimates the sensitivity of learning inter-camera time delayed dependency given different training size, which is a critical factor for accurate dependency learning and has not been largely studied by existing work before. Experiments are carried out on a dataset obtained in a trident roadway. The results demonstrate that the SFA-based method outperforms the sate of the art.

[1]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Tim J. Ellis,et al.  Automatic learning of an activity-based semantic scene model , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[3]  Shaogang Gong,et al.  Comparing Visual Feature Coding for Learning Disjoint Camera Dependencies , 2012, BMVC.

[4]  Dimitrios Makris,et al.  Bridging the gaps between cameras , 2004, CVPR 2004.

[5]  Shaogang Gong,et al.  International Journal of Computer Vision (The original publication is available at www.springerlink.com) Time-Delayed Correlation Analysis for Multi-Camera Activity Understanding , 2009 .

[6]  Dacheng Tao,et al.  Slow Feature Analysis for Human Action Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Shaogang Gong,et al.  Incremental Activity Modeling in Multiple Disjoint Cameras , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Chao Wang,et al.  A Framework for Surveillance Video Fast Browsing Based on Object Flags , 2013 .

[9]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[10]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..