A time-slice optimization based weak feature association algorithm for video condensation

There are a lot of complex environments in real scene, such as illumination variation, shadow variation, object occlusion, which will directly affect the performance of video synopsis. In this paper, we adopt Grid Background Model as object detection algorithm, proposing algorithm based on weak feature to solve the object occlusion problem, at last we propose to use time-slice optimization algorithm to solve the visualization problem of video condensation. Specifically, Grid Background Model is adopted to segment the foreground from the background, then we use current frame to update background frame, and then binarize the foreground frame to perform Neighborhood illumination invariant shadow elimination. A clear foreground can be obtained by doing the procedure above as well as Gaussian noise elimination and morphological operation such as inflation and corrosion to remove cavities. Meanwhile, the outline of the object is extracted by using the canny edge detector. In the object tracking section, we will introduce how to use the weak features, such as color, speed and direction on the basis of location prediction based on tracking algorithm to perform object association, and the extraction of accurate information of abstract and outline of the object at the same time. Finally, in the video condensation section, we will describe how to use optical time-slice based minimum energy model to perform video condensation according to frame sequence. The experimental result shows that, the method mentioned above can provide a new approach for solving the occlusion problems of video condensation, and have better visualization of abstract video, and achieve up to 6 times concentration to the original video.

[1]  Yong Chen,et al.  WebVR - - Web Virtual Reality Engine Based on P2P network , 2011, J. Networks.

[2]  Yiğithan Dedeoğlu,et al.  Moving object detection, tracking and classification for smart video surveillance , 2004 .

[3]  B. S. Manjunath,et al.  Multicamera video summarization and anomaly detection from activity motifs , 2014, TOSN.

[4]  Shih-Fu Chang,et al.  Segmentation, structure detection and summarization of multimedia sequences , 2002 .

[5]  Zhihan Lv,et al.  A multicast delivery approach with minimum energy consumption for wireless multi-hop networks , 2016, Telecommun. Syst..

[6]  Wei Wu,et al.  Rapid Delaunay triangulation for randomly distributed point cloud data using adaptive Hilbert curve , 2016, Comput. Graph..

[7]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[8]  Alan Hanjalic,et al.  DANCERS: Delft advanced news retrieval system , 2001, IS&T/SPIE Electronic Imaging.

[9]  Yael Pritch,et al.  Making a Long Video Short: Dynamic Video Synopsis , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Jiang Jiang,et al.  A Bayesian approach for sleep and wake classification based on dynamic time warping method , 2017, Multimedia Tools and Applications.

[11]  Atsuo Yoshitaka,et al.  Personalized Video Summarization Based on Behavior of Viewer , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[12]  Zhihan Lv,et al.  Towards a face recognition method based on uncorrelated discriminant sparse preserving projection , 2017, Multimedia Tools and Applications.

[13]  Zhihan Lv,et al.  Multimedia cloud transmission and storage system based on internet of things , 2017, Multimedia Tools and Applications.

[14]  Michael Lang,et al.  Optimizing load balancing and data-locality with data-aware scheduling , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[15]  Yael Moses,et al.  Tracking in a Dense Crowd Using Multiple Cameras , 2010, International Journal of Computer Vision.

[16]  Hyeran Byun,et al.  A unified approach to background adaptation and initialization in public scenes , 2013, Pattern Recognit..

[17]  Yael Pritch,et al.  Clustered Synopsis of Surveillance Video , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[18]  Zhihan Lv,et al.  A Self-Assessment Stereo Capture Model Applicable to the Internet of Things , 2015, Sensors.

[19]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[20]  Zhihan Lv,et al.  Multimodal Hand and Foot Gesture Interaction for Handheld Devices , 2014, TOMM.

[21]  Eun Yi Kim,et al.  Automatic video segmentation using genetic algorithms , 2006, Pattern Recognit. Lett..

[22]  Zhihan Lv,et al.  Game On, Science - How Video Game Technology May Help Biologists Tackle Visualization Challenges , 2013, PloS one.

[23]  Xu Ying,et al.  Collaborative Multi-hop Routing in Cognitive Wireless Networks , 2015, Wireless Personal Communications.

[24]  Zhihan Lv,et al.  Touch-less interactive augmented reality game on vision-based wearable device , 2015, Personal and Ubiquitous Computing.

[25]  Zhi-Hua Zhou,et al.  Multi-View Video Summarization , 2010, IEEE Transactions on Multimedia.

[26]  Zhihan Lv,et al.  Change detection method for remote sensing images based on an improved Markov random field , 2017, Multimedia Tools and Applications.

[27]  Wolfgang Effelsberg,et al.  Video abstracting , 1997, CACM.