An optimized video synopsis algorithm and its distributed processing model

Video synopsis is one of the popular research topics in the field of digital video and has broad application prospects. Current research of it focuses on the methods of generating video synopsis or studying to utilize optimization algorithms such as fuzzy theory, minimum sparse reconstruction, and genetic algorithm to optimize its computing steps. This paper mainly studies the object-based video synopsis technology in distributed environment. We propose an effective video synopsis algorithm and a distributed processing model to accelerate the computing speed of video synopsis. The algorithm is proposed for studies of surveillance videos, which focuses on several key algorithmic steps, for instance, initialization of original video resources, background modeling, moving object detecting, and nonlinear rearrangement. These steps can be performed in parallel. In order to obtain good video synopsis effect and fast computing speed, some optimization methods are applied to these steps. With the aim of employing much more computing resources, we propose a distributed processing model, which splits the original video file into multiple segments and distributes them to different computing nodes to improve the computing performance by leveraging the multi-core and multi-thread capabilities of CPU. Experimental results show that the proposed distributed model can significantly improve the computing speed of video synopsis.

[1]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Ling Xu,et al.  Optimization method for trajectory combination in surveillance video synopsis based on genetic algorithm , 2015, J. Ambient Intell. Humaniz. Comput..

[3]  Vilas Naik,et al.  Entropy Based Fuzzy C Means Clustering and Key Frame Extraction for Sports Video Summarization , 2014, 2014 Fifth International Conference on Signal and Image Processing.

[4]  Lei Xie,et al.  Multiple pedestrian tracking based on couple-states Markov chain with semantic topic learning for video surveillance , 2015, Soft Comput..

[5]  Tao Mei,et al.  Video^M: Multi-video Synopsis , 2008, 2008 IEEE International Conference on Data Mining Workshops.

[6]  Ezequiel López-Rubio,et al.  A self-organizing map to improve vehicle detection in flow monitoring systems , 2015, Soft Comput..

[7]  Yael Pritch,et al.  Making a Long Video Short: Dynamic Video Synopsis , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Jin Li,et al.  Securely Outsourcing Attribute-Based Encryption with Checkability , 2014, IEEE Transactions on Parallel and Distributed Systems.

[9]  Cong Wang,et al.  Efficient verifiable fuzzy keyword search over encrypted data in cloud computing , 2013, Comput. Sci. Inf. Syst..

[10]  Anni Cai,et al.  A surveillance video analysis and storage scheme for scalable synopsis browsing , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[11]  Chao Wang,et al.  A Framework for Surveillance Video Fast Browsing Based on Object Flags , 2013 .

[12]  Yongwei Nie,et al.  Compact Video Synopsis via Global Spatiotemporal Optimization , 2013, IEEE Trans. Vis. Comput. Graph..

[13]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  Wang Lin,et al.  Independent Tasks Scheduling on Tree-Based Grid Computing Platforms , 2006 .

[15]  Fariborz Mahmoudi,et al.  Video Summarization Based on a Fuzzy Based Incremental Clustering , 2014 .

[16]  Yael Pritch,et al.  Clustered Synopsis of Surveillance Video , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[17]  Shyh-Kang Jeng,et al.  Augmented 3-D Keyframe Extraction for Surveillance Videos , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Wenjuan Liao,et al.  A Surveillance Video Index and Browsing System Based on Object Flags and Video Synopsis , 2015, MMM.

[20]  Yael Pritch,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008 1 Non-Chronological Video , 2022 .

[21]  Victor R. L. Shen,et al.  Automatic video shot boundary detection of news stream using a high-level fuzzy Petri net , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[22]  Rajkumar Buyya,et al.  Bandwidth‐aware divisible task scheduling for cloud computing , 2014, Softw. Pract. Exp..

[23]  Shaogang Gong,et al.  Video Synopsis by Heterogeneous Multi-source Correlation , 2013, 2013 IEEE International Conference on Computer Vision.

[24]  Hanqing Lu,et al.  Online video synopsis of structured motion , 2014, Neurocomputing.

[25]  Shaohui Mei,et al.  Video summarization via minimum sparse reconstruction , 2015, Pattern Recognit..

[26]  Christian Esposito,et al.  Smart Cloud Storage Service Selection Based on Fuzzy Logic, Theory of Evidence and Game Theory , 2016, IEEE Transactions on Computers.

[27]  Jin Li,et al.  Secure Deduplication with Efficient and Reliable Convergent Key Management , 2014, IEEE Transactions on Parallel and Distributed Systems.

[28]  Janusz Konrad,et al.  Video Condensation by Ribbon Carving , 2009, IEEE Transactions on Image Processing.

[29]  Christian Esposito,et al.  Interconnecting Federated Clouds by Using Publish-Subscribe Service , 2013, Cluster Computing.

[30]  Yael Pritch,et al.  Webcam Synopsis: Peeking Around the World , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[31]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[32]  Chih-Hsien Hsia,et al.  Low-complexity range tree for video synopsis system , 2016, Multimedia Tools and Applications.