Multi-video summarization based on OB-MMR

In this paper we propose a novel algorithm for video summarization, OB-MMR (Optimized Balanced Audio Video Maximal Marginal Relevance). This algorithm is suitable to summarize both single and multiple videos. OB-MMR is achieved by optimizing the parameters in Balanced AV-MMR (Balanced Audio Video Maximal Marginal Relevance), namely the balance factor between audio information and visual information in the video, but also the importance of face and audio transitions among audio segments with different genres. Therefore, OB-MMR achieves a better result than previous algorithms, Video-MMR and Balanced AV-MMR. Furthermore, it is possible to select the optimized parameters for each genre of videos, which leads to promising automatic algorithms for video summarization in the future large-scale experiments.

[1]  Jade Goldstein-Stewart,et al.  The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries , 1998, SIGIR Forum.

[2]  Chong-Wah Ngo,et al.  Video summarization and scene detection by graph modeling , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  V. Ghini,et al.  An audio-video summarization scheme based on audio and video analysis , 2006, CCNC 2006. 2006 3rd IEEE Consumer Communications and Networking Conference, 2006..

[4]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[6]  Bernard Mérialdo,et al.  Video Summarization Based on Balanced AV-MMR , 2012, MMM.

[7]  Bernard Mérialdo,et al.  VERT: automatic evaluation of video summaries , 2010, ACM Multimedia.

[8]  Bernard Mérialdo,et al.  Multi-document video summarization , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[9]  Ingvar Claesson,et al.  Face Detection using Local SMQT Features and Split up Snow Classifier , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[10]  Bernard Mérialdo,et al.  Multi-video summarization based on AV-MMR , 2010, 2010 International Workshop on Content Based Multimedia Indexing (CBMI).

[11]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[12]  Bernard Mérialdo,et al.  Multi-video summarization based on Video-MMR , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[13]  Benoit Huet,et al.  Automatic video summarization , 2006 .

[14]  Jhing-Fa Wang,et al.  A Novel Video Summarization Based on Mining the Story-Structure and Semantic Relations Among Concept Entities , 2009, IEEE Transactions on Multimedia.