Video Summarisation for Surveillance and News Domain

Video summarization approaches have various fields of application, specifically related to organizing, browsing and accessing large video databases. In this paper we propose and evaluate two novel approaches for video summarization, one based on spectral methods and the other on ant-tree clustering. The overall summary creation process is broke down in two steps: detection of similar scenes and extraction of the most representative ones. While clustering approaches are used for scene segmentation, the post-processing logic merges video scenes into a subset of user relevant scenes. In the case of the spectral approach, representative scenes are extracted following the logic that important parts of the video are related with high motion activity of segments within scenes. In the alternative approach we estimate a subset of relevant video scene using ant-tree optimization approaches and in a supervised scenario certain scenes of no interest to the user are recognized and excluded from the summary. An experimental evaluation validating the feasibility and the robustness of these approaches is presented.

[1]  J. Deneubourg,et al.  Chain Formation in Œcophylla longinoda , 2001, Journal of Insect Behavior.

[2]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Aggelos K. Katsaggelos,et al.  MINMAX optimal video summarization , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Ali N. Akansu,et al.  Low-level motion activity features for semantic characterization of video , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[5]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[6]  Patrick Bouthemy,et al.  Motion-Based Selection of Relevant Video Segments for Video Summarization , 2003, Multimedia Tools and Applications.

[7]  Regunathan Radhakrishnan,et al.  An enhanced video summarization system using audio features for a personal video recorder , 2006, IEEE Transactions on Consumer Electronics.

[8]  Xin Zheng,et al.  Automatic determination of intrinsic cluster number family in spectral clustering using random walk on graph , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[9]  Nicolas Monmarché,et al.  A new clustering algorithm based on the chemical recognition system of ants , 2002 .

[10]  Jianbo Shi,et al.  A Random Walks View of Spectral Segmentation , 2001, AISTATS.

[11]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[12]  Yong Wang,et al.  Real time motion analysis toward semantic understanding of video content , 2005, Visual Communications and Image Processing.

[13]  Pascale Kuntz,et al.  A Stochastic Heuristic for Visualising Graph Clusters in a Bi-Dimensional Space Prior to Partitioning , 1999, J. Heuristics.

[14]  Baldo Faieta,et al.  Diversity and adaptation in populations of clustering ants , 1994 .

[15]  Whoi-Yul Kim,et al.  Automatic video summarizing tool using MPEG-7 descriptors for personal video recorder , 2003, IEEE Trans. Consumer Electron..

[16]  Luca Maria Gambardella,et al.  Ant Algorithms for Discrete Optimization , 1999, Artificial Life.

[17]  Andrew B. Kahng,et al.  Spectral Partitioning with Multiple Eigenvectors , 1999, Discret. Appl. Math..

[18]  Mubarak Shah,et al.  Detection and representation of scenes in videos , 2005, IEEE Transactions on Multimedia.

[19]  Jean-Marc Odobez,et al.  Video Shot Clustering using Spectral Methods , 2003 .

[20]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[21]  Charles J. Alpert,et al.  Spectral Partitioning: The More Eigenvectors, The Better , 1995, 32nd Design Automation Conference.

[22]  Janko Calic,et al.  Towards real-time shot detection in the mpeg compressed domain , 2001 .

[23]  Gilles Venturini,et al.  AntTree: a new model for clustering with artificial ants , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..