Summarization of Videos by Image Quality Assessment

Video summarization plays a key role in manipulating large amounts of digital videos, making it faster to analyze their contents and aiding in the tasks of browsing, indexing and retrieval. A straightforward method for producing the summaries is by means of extraction of color features from the video frames. However, in order to automatically generate summaries as human beings would do, the way that humans perceive images must be considered, which can be done by image quality assessment (IQA) metrics. This work presents VSQUAL, a method for summarization of videos based on objective IQA metrics, which is also used for other purposes such as shot boundary detection and keyframe extraction. Results of the proposed method are compared against other approaches of the literature with a specific evaluation metric.

[1]  Yelena Yesha,et al.  Keyframe-based video summarization using Delaunay clustering , 2006, International Journal on Digital Libraries.

[2]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[3]  Jurandy Almeida,et al.  VISON: VIdeo Summarization for ONline applications , 2012, Pattern Recognit. Lett..

[4]  Hung-Khoon Tan,et al.  Beyond search: Event-driven summarization for web videos , 2011, TOMCCAP.

[5]  Alfredo Petrosino,et al.  Image Analysis and Processing – ICIAP 2013 , 2013, Lecture Notes in Computer Science.

[6]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[7]  Luis Alvarez,et al.  Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications , 2012, Lecture Notes in Computer Science.

[8]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Ryszard Tadeusiewicz,et al.  Computer Vision and Graphics , 2014, Lecture Notes in Computer Science.

[11]  Marco Pellegrini,et al.  STIMO: STIll and MOving video storyboard for the web scenario , 2009, Multimedia Tools and Applications.

[12]  Nagia M. Ghanem,et al.  VSCAN: An Enhanced Video Summarization Using Density-Based Spatial Clustering , 2013, ICIAP.

[13]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[14]  Gary Marchionini,et al.  Open video: A framework for a test collection , 2000, J. Netw. Comput. Appl..

[15]  Qingming Huang,et al.  Spatial-temporal attention analysis for home video , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[16]  John R. Kender,et al.  Video summaries and cross-referencing through mosaic-based representation , 2004, Comput. Vis. Image Underst..

[17]  Muhammad Shakir,et al.  Video Summarization: Techniques and Classification , 2012, ICCVG.

[18]  Arnaldo de Albuquerque Araújo,et al.  VSUMM: A mechanism designed to produce static video summaries and a novel evaluation method , 2011, Pattern Recognit. Lett..

[19]  José María Martínez Sanchez,et al.  Event Detection and Clustering for Surveillance Video Summarization , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[20]  Petros Maragos,et al.  Movie summarization based on audiovisual saliency detection , 2008, 2008 15th IEEE International Conference on Image Processing.

[21]  Hélio Pedrini,et al.  A Video Summarization Method Based on Spectral Clustering , 2013, CIARP.