On-Line Multi-View Video Summarization for Wireless Video Sensor Network

Battery lifetime is critical for wireless video sensors. To enable battery-powered wireless video sensors, low-power design is required. In this paper, we consider applying multi-view summarization to wireless video sensors to remove redundant contents such that the compression and transmission power can be reduced. A low-complexity online multi-view video summarization scheme is proposed. Experiments show that the proposed summarization method successfully reduces the video content while keeping important events. A power analysis of the system also shows that a significant amount of energy can be saved.

[1]  George Lawton,et al.  Machine-to-machine technology gears up for growth , 2004, Computer.

[2]  Bernard Mérialdo,et al.  VERT: automatic evaluation of video summaries , 2010, ACM Multimedia.

[3]  David S. Doermann,et al.  Video summarization by curve simplification , 1998, MULTIMEDIA '98.

[4]  Paul Over,et al.  The trecvid 2007 BBC rushes summarization evaluation pilot , 2007, TVS '07.

[5]  Akio Yamada,et al.  The MPEG-7 color layout descriptor: a compact image feature description for high-speed image/video segment retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[6]  Syed Ali Khayam,et al.  Energy efficient video compression for wireless sensor networks , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[7]  Zhihai He,et al.  Resource allocation and performance analysis of wireless video sensors , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Shao-Yi Chien,et al.  Hardware architecture design of hybrid distributed video coding with frame level coding mode selection , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[9]  Chong-Wah Ngo,et al.  Summarizing Rushes Videos by Motion, Object, and Event Understanding , 2012, IEEE Transactions on Multimedia.

[10]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[11]  Nanning Zheng,et al.  Key object-based static video summarization , 2011, ACM Multimedia.

[12]  Jurandy Almeida,et al.  Online video summarization on compressed domain , 2013, J. Vis. Commun. Image Represent..

[13]  Lie Lu,et al.  A generic framework of user attention model and its application in video summarization , 2005, IEEE Trans. Multim..

[14]  Yanwen Guo,et al.  Multi-keyframe abstraction from videos , 2011, 2011 18th IEEE International Conference on Image Processing.

[15]  Chia-han Lee,et al.  Power Consumption Analysis for Distributed Video Sensors in Machine-to-Machine Networks , 2013, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[16]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[17]  Bernard Mérialdo,et al.  Multi-video summarization based on Video-MMR , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[18]  Ruck Thawonmas,et al.  Video summarization via crowdsourcing , 2011, CHI EA '11.

[19]  Bernard Mérialdo,et al.  Generating summaries of multi-episode video , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[20]  José María Martínez Sanchez,et al.  Binary tree based on-line video summarization , 2008, TVS '08.

[21]  Junseok Kwon,et al.  A unified framework for event summarization and rare event detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Yong Jae Lee,et al.  Discovering important people and objects for egocentric video summarization , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Liang-Gee Chen,et al.  A 1.3TOPS H.264/AVC single-chip encoder for HDTV applications , 2005, ISSCC. 2005 IEEE International Digest of Technical Papers. Solid-State Circuits Conference, 2005..

[24]  Ying Zhang,et al.  Multi-video summary and skim generation of sensor-rich videos in geo-space , 2012, MMSys '12.

[25]  Paul Over,et al.  The trecvid 2008 BBC rushes summarization evaluation , 2008, TVS '08.

[26]  Yael Pritch,et al.  Webcam Synopsis: Peeking Around the World , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[27]  Shao-Yi Chien,et al.  Efficient Content Analysis Engine for Visual Surveillance Network , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[29]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[30]  B. S. Manjunath,et al.  Multicamera Video Summarization from Optimal Reconstruction , 2010, ACCV Workshops.

[31]  Bernard Mérialdo,et al.  Multi-document video summarization , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[32]  Xin Liu,et al.  Video summarization using singular value decomposition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[33]  Jiebo Luo,et al.  Towards Scalable Summarization of Consumer Videos Via Sparse Dictionary Selection , 2012, IEEE Transactions on Multimedia.

[34]  Bernard Mérialdo,et al.  Automatic evaluation method for rushes summary content , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[35]  Xiao-Ping Zhang,et al.  A content-based video fast-forward playback method using video time density function and rate distortion theory , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[36]  Ekram Hossain,et al.  QoS provisioning in wireless video sensor networks: a dynamic power management framework , 2007, IEEE Wireless Communications.

[37]  Andrea Cavallaro,et al.  Multi-camera Scheduling for Video Production , 2011, 2011 Conference for Visual Media Production.

[38]  Chih-Jen Lin,et al.  Large-Scale Video Summarization Using Web-Image Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Uma Mudenagudi,et al.  A Study on Keyframe Extraction Methods for Video Summary , 2011, 2011 International Conference on Computational Intelligence and Communication Networks.

[40]  Bernd Girod,et al.  Distributed Video Coding , 2005, Proceedings of the IEEE.

[41]  Kameswara Namuduri,et al.  Distributed video coding for wireless sensor networks , 2005 .

[42]  Zhi-Hua Zhou,et al.  Multi-View Video Summarization , 2010, IEEE Transactions on Multimedia.

[43]  Xiao Zeng,et al.  Instant video summarization during shooting with mobile phone , 2011, ICMR '11.

[44]  Jurandy Almeida,et al.  VISON: VIdeo Summarization for ONline applications , 2012, Pattern Recognit. Lett..

[45]  Yael Pritch,et al.  Making a Long Video Short: Dynamic Video Synopsis , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[46]  Shaohui Mei,et al.  Video Summarization with Global and Local Features , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[47]  José María Martínez Sanchez,et al.  Automatic evaluation of video summaries , 2012, TOMCCAP.

[48]  E. Asadi,et al.  Video summarization using fuzzy c-means clustering , 2012, 20th Iranian Conference on Electrical Engineering (ICEE2012).

[49]  Andrea Cavallaro,et al.  Distributed and Decentralized Multicamera Tracking , 2011, IEEE Signal Processing Magazine.

[50]  Chong-Wah Ngo,et al.  Video summarization and scene detection by graph modeling , 2005, IEEE Transactions on Circuits and Systems for Video Technology.