Video summarization through change detection in a non-overlapping camera network

We present a method that is able to find the most informative video portions in a non-overlapping camera network, leading to a summarization of the multiple video sequences. This is posed as a problem of detecting changes in the interactions between the targets in the network of cameras. Examples include formation and dispersal of groups within the view of a single camera, as well as identifying changes between cameras. The latter includes prediction of events that may have occurred in the gaps between the cameras. The solution strategy is built upon a social group identification method and a track association strategy, which together are used to indicate conflicts in the interactions between the targets, leading to identification of the most informative video portions in a non-overlapping camera network. We apply our algorithm on a public dataset with multiple non-overlapping cameras on a university campus. We show examples of informative video segments, as well as perform a statistical analysis of the results.

[1]  Chong-Wah Ngo,et al.  Video summarization and scene detection by graph modeling , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Stavros J. Perantonis,et al.  Detecting abnormal human behaviour using multiple cameras , 2009, Signal Process..

[3]  Zhi-Hua Zhou,et al.  Multi-View Video Summarization , 2010, IEEE Transactions on Multimedia.

[4]  Joan Serrat,et al.  Video Alignment for Change Detection , 2011, IEEE Transactions on Image Processing.

[5]  M. Newman,et al.  Finding community structure in networks using the eigenvectors of matrices. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Ting Yu,et al.  Monitoring, recognizing and discovering social networks , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Bir Bhanu,et al.  VideoWeb Dataset for Multi-camera Activities and Non-verbal Communication , 2011 .

[8]  Jianping Fan,et al.  Exploring video content structure for hierarchical summarization , 2004, Multimedia Systems.

[9]  Yael Pritch,et al.  Clustered Synopsis of Surveillance Video , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[10]  Ashish Ghosh,et al.  A Change Information Based Fast Algorithm for Video Object Detection and Tracking , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Amit K. Roy-Chowdhury,et al.  A Camera Network Tracking (CamNeT) Dataset and Performance Baseline , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[12]  Shaogang Gong,et al.  Video Synopsis by Heterogeneous Multi-source Correlation , 2013, 2013 IEEE International Conference on Computer Vision.

[13]  Bin Zhao,et al.  Quasi Real-Time Summarization for Consumer Videos , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Jiebo Luo,et al.  Towards Scalable Summarization of Consumer Videos Via Sparse Dictionary Selection , 2012, IEEE Transactions on Multimedia.

[15]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Nebojsa Jojic,et al.  Interactive Montages of Sprites for Indexing and Summarizing Security Video , 2005, CVPR.

[17]  Bi Song,et al.  A Stochastic Graph Evolution Framework for Robust Multi-target Tracking , 2010, ECCV.

[18]  Alexander C. Loui,et al.  Automatic consumer video summarization by audio and visual analysis , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[19]  Pascal Fua,et al.  Robust Multi-View Change Detection , 2007, BMVC.

[20]  B. S. Manjunath,et al.  Multicamera Video Summarization from Optimal Reconstruction , 2010, ACCV Workshops.