Equal Partition Based Clustering Approach for Event Summarization in Videos

The rapid growth of video data demands both effective and efficient video summarization methods so that users are allowed to speedily browse and comprehend a large amount of video content. Hence, it is very challenging to store and access such audiovisual information in real time where an immense amount of recorded video content is rising within one second. In this paper we proposed an equal partition based clustering technique for summarizing the events in videos which can work better for real time applications (for e.g., surveillance video in various security systems). In clustering, the difficulty is to obtain the optimal set of clusters, which is gained by implementing Davies-Bouldin Index, a cluster validation technique which permits the users with free parameter based video summarization method for selecting the numbers of key–frames without incurring additional computational cost. The qualitative as well as quantitative evaluation is done in order to compare the performances of our proposed model and state-of-theart models. Experimental results on two benchmark datasets with various types of videos expose that the proposed method outperforms the state-of-the-art models with the best Precision and F–measure.

[1]  Arnaldo de Albuquerque Araújo,et al.  VSUMM: A mechanism designed to produce static video summaries and a novel evaluation method , 2011, Pattern Recognit. Lett..

[2]  Shiqiang Yang,et al.  Contextual browsing for highlights in sports video , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[3]  Georgios Tziritas,et al.  Equivalent Key Frames Selection Based on Iso-Content Principles , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Peter J. L. van Beek,et al.  Detection of slow-motion replay segments in sports video for highlights generation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[5]  R. K. Agrawal,et al.  A novel hybrid approach for salient object detection using local and global saliency in frequency domain , 2015, Multimedia Tools and Applications.

[6]  Mei Han,et al.  Extract highlights from baseball game video with hidden Markov models , 2002, Proceedings. International Conference on Image Processing.

[7]  Shaohui Mei,et al.  Video summarization via minimum sparse reconstruction , 2015, Pattern Recognit..

[8]  Yelena Yesha,et al.  Keyframe-based video summarization using Delaunay clustering , 2006, International Journal on Digital Libraries.

[9]  Ananda S. Chowdhury,et al.  Video storyboard design using Delaunay graphs , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[10]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[11]  Mohan S. Kankanhalli,et al.  Video Summarization Using R-Sequences , 2000, Real Time Imaging.

[12]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[13]  Shiyang Lu,et al.  Keypoint-Based Keyframe Selection , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Regunathan Radhakrishnan,et al.  Effective and efficient sports highlights extraction using the minimum description length criterion in selecting GMM structures , 2004, ICME.

[15]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[16]  Alberto Del Bimbo,et al.  Semantic annotation of soccer videos: automatic highlights identification , 2003, Comput. Vis. Image Underst..

[17]  Marco Pellegrini,et al.  STIMO: STIll and MOving video storyboard for the web scenario , 2009, Multimedia Tools and Applications.

[18]  Patrick Pérez,et al.  Rapid Summarisation and Browsing of Video Sequences , 2002, BMVC.

[19]  Jiebo Luo,et al.  Towards Scalable Summarization of Consumer Videos Via Sparse Dictionary Selection , 2012, IEEE Transactions on Multimedia.

[20]  R. K. Agrawal,et al.  Combination of Kullback–Leibler divergence and Manhattan distance measures to detect salient objects , 2015, Signal Image Video Process..

[21]  Xin Liu,et al.  Video summarization using singular value decomposition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[22]  Sang Uk Lee,et al.  Efficient video indexing scheme for content-based retrieval , 1999, IEEE Trans. Circuits Syst. Video Technol..

[23]  Jintao Li,et al.  Replay boundary detection in MPEG compressed video , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[24]  R. K. Agrawal,et al.  A novel position prior using fusion of rule of thirds and image center for salient object detection , 2016, Multimedia Tools and Applications.

[25]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[26]  R. K. Agrawal,et al.  A convex hull approach in conjunction with Gaussian mixture model for salient object detection , 2016, Digit. Signal Process..

[27]  R. K. Agrawal,et al.  A novel approach to combine features for salient object detection using constrained particle swarm optimization , 2014, Pattern Recognit..

[28]  Serhan Dagtas,et al.  Multimodal detection of highlights for multimedia content , 2004, Multimedia Systems.