Video Summarization Using Geometric Primitives

Video summarization is the process to extract informative events of a video and represent in the condensed form. The paper proposes a new method for extracting important contents of a video for summarization using geometric primitives, such as line segments, angles, and conic parts. The primitives have the capabilities to represent complex shapes and structures of objects in a video frame. Therefore, they are indeed powerful features to localize objects in complex environments. After localizing objects, a cost function is applied to measure the dissimilarity of locations of geometric primitives to detect the movement of objects between consecutive frames. After detecting the dissimilar geometric primitives, amount of object movements are calculated based on the number and length of each geometric primitives. Utilizing this information, each video frame is assigned a probability score to become a key frame. Finally, a set of key frames are selected as per user preference. The proposed approach is evaluated using BL-7F, Office, and Lobby datasets and obtained better performance than the intra-view results of the recently proposed state of the art GMM based method.

[1]  Yi-Ping Hung,et al.  Target-driven video summarization in a camera network , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Petros Maragos,et al.  Multimodal Saliency and Fusion for Movie Summarization Based on Aural, Visual, and Textual Attention , 2013, IEEE Transactions on Multimedia.

[3]  Seung-Won Jung,et al.  Order-Preserving Condensation of Moving Objects in Surveillance Videos , 2016, IEEE Transactions on Intelligent Transportation Systems.

[4]  Manoranjan Paul,et al.  An efficient method for video summarization using moving object information , 2015, 2015 18th International Conference on Computer and Information Technology (ICCIT).

[5]  B. S. Manjunath,et al.  Eye tracking assisted extraction of attentionally important objects from videos , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Sharath Pankanti,et al.  Efficient UAV video event summarization , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[7]  Chong-Wah Ngo,et al.  Summarizing Rushes Videos by Motion, Object, and Event Understanding , 2012, IEEE Transactions on Multimedia.

[8]  Huang-Chia Shih,et al.  A Novel Attention-Based Key-Frame Determination Method , 2013, IEEE Transactions on Broadcasting.

[9]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[10]  Sung Wook Baik,et al.  Saliency-directed prioritization of visual data in wireless surveillance networks , 2015, Inf. Fusion.

[11]  Chun-Rong Huang,et al.  Maximum a Posteriori Probability Estimation for Online Surveillance Video Synopsis , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Junseok Kwon,et al.  A unified framework for event summarization and rare event detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jurandy Almeida,et al.  Online video summarization on compressed domain , 2013, J. Vis. Commun. Image Represent..

[14]  Kristen Grauman,et al.  Story-Driven Summarization for Egocentric Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Naokazu Yokoya,et al.  Textual description-based video summarization for video blogs , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[16]  Junbin Gao,et al.  Conics Detection Method based on Pascal's Theorem , 2015, VISAPP.

[17]  Yong Jae Lee,et al.  Predicting Important Objects for Egocentric Video Summarization , 2015, International Journal of Computer Vision.

[18]  Yongwei Nie,et al.  Object Movements Synopsis viaPart Assembling and Stitching , 2014, IEEE Transactions on Visualization and Computer Graphics.

[19]  Shaogang Gong,et al.  Video Synopsis by Heterogeneous Multi-source Correlation , 2013, 2013 IEEE International Conference on Computer Vision.

[20]  Yihao Zhang,et al.  A new approach for extracting and summarizing abnormal activities in surveillance videos , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[21]  Xuelong Li,et al.  Surveillance Video Synopsis via Scaling Down Objects , 2016, IEEE Transactions on Image Processing.

[22]  Chih-Jen Lin,et al.  Large-Scale Video Summarization Using Web-Image Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Nuno Vasconcelos,et al.  On the plausibility of the discriminant center-surround hypothesis for visual saliency. , 2008, Journal of vision.

[24]  Manoranjan Paul,et al.  Fusion of Foreground Object, Spatial and Frequency Domain Motion Information for Video Summarization , 2015, PSIVT Workshops.

[25]  Zhe-Ming Lu,et al.  Video abstraction based on the visual attention model and online clustering , 2013, Signal Process. Image Commun..

[26]  Chia-han Lee,et al.  On-Line Multi-View Video Summarization for Wireless Video Sensor Network , 2015, IEEE Journal of Selected Topics in Signal Processing.

[27]  Shaohui Mei,et al.  Video summarization via minimum sparse reconstruction , 2015, Pattern Recognit..

[28]  Yong Jae Lee,et al.  Discovering important people and objects for egocentric video summarization , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Patrick Gros,et al.  Constraint Satisfaction Programming for Video Summarization , 2013, 2013 IEEE International Symposium on Multimedia.

[30]  Sung Wook Baik,et al.  Efficient visual attention based framework for extracting key frames from videos , 2013, Signal Process. Image Commun..

[31]  Yue Wang,et al.  Motion-State-Adaptive Video Summarization via Spatiotemporal Analysis , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Chiranjib Bhattacharyya,et al.  Bayesian Modeling of Temporal Coherence in Videos for Entity Discovery and Summarization , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Zhi-Hua Zhou,et al.  Multi-View Video Summarization , 2010, IEEE Transactions on Multimedia.

[34]  Yang Yi,et al.  Key frame extraction based on visual attention model , 2012, J. Vis. Commun. Image Represent..

[35]  Conrad Sanderson,et al.  Summarisation of short-term and long-term videos using texture and colour , 2014, IEEE Winter Conference on Applications of Computer Vision.

[36]  Fumin Shen,et al.  Spatial and temporal scoring for egocentric video summarization , 2016, Neurocomputing.

[37]  Meng Wang,et al.  Event Driven Web Video Summarization by Tag Localization and Key-Shot Identification , 2012, IEEE Transactions on Multimedia.

[38]  Jen-Hui Chuang,et al.  A novel video summarization method for multi-intensity illuminated infrared videos , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[39]  Martin K. Purvis,et al.  Wildlife video key-frame extraction based on novelty detection in semantic context , 2011, Multimedia Tools and Applications.

[40]  Susanto Rahardja,et al.  Object Recognition by Discriminative Combinations of Line Segments, Ellipses, and Appearance Features , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Ching-Tang Fan,et al.  Heterogeneous Information Fusion and Visualization for a Large-Scale Intelligent Video Surveillance System , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[42]  Weisi Lin,et al.  Scene-Based Movie Summarization Via Role-Community Networks , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Shaogang Gong,et al.  Discovery of Shared Semantic Spaces for Multiscene Video Query and Summarization , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[44]  Francesco Tisato,et al.  Attentive Monitoring of Multiple Video Streams Driven by a Bayesian Foraging Strategy , 2014, IEEE Transactions on Image Processing.

[45]  Manoranjan Paul,et al.  Summarizing Surveillance Video by Saliency Transition and Moving Object Information , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).