A study on various methods used for video summarization and moving object detection for video surveillance applications

With the advancement in digital video technology, video surveillance has been playing its vital role for ensuring safety and security. The surveillance systems are deployed in wide range of applications to invigilate stuffs and to analyse the activities in the environment. From the single or multi surveillance camera, a huge amount of data is generated, stored and processed for security purpose. Due to time constraints, it is a very tedious process for an analyst to go through the full content. This limitation has been overcome by the use of video summarization. The video summarization is intended to afford comprehensible analysis of video by removing duplications and extracting key frames from the video. To make an easily interpreted outline, the various available video summarization methods will try to shot the summary of the main occurrences, scenes, or objects in a frame. Depending on the applications, it is required to summarize the happenings in the scene and detect the objects (static/dynamic) which is recorded in the video. Hence this paper provides the various methods used for video summarization and a comparative study of different techniques. It also presents different object detection, object classification and object tracking algorithms available in the literature.

[1]  N. Malmurugan,et al.  OFGM-SMED: An Efficient and Robust Foreground Object Detection in Compressed Video Sequences , 2014, Eng. Appl. Artif. Intell..

[2]  Frame Difference Frame Difference And Kalman Filter Techniques For Detection Of Moving Vehicles In Video Surveillance , 2012 .

[3]  Antoni B. Chan,et al.  Joint Motion Segmentation and Background Estimation in Dynamic Scenes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Chinh T. Dang,et al.  RPCA-KFE: Key Frame Extraction for Video Using Robust Principal Component Analysis , 2014, IEEE Transactions on Image Processing.

[5]  Tsuhan Chen,et al.  Motion-focusing key frame extraction and video summarization for lane surveillance system , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[6]  Aslani Sepehr,et al.  Optical Flow Based Moving Object Detection and Tracking for Traffic Surveillance , 2014, ICEE 2014.

[7]  Yongdong Zhang,et al.  Supervised Hash Coding With Deep Neural Network for Environment Perception of Intelligent Vehicles , 2018, IEEE Transactions on Intelligent Transportation Systems.

[8]  Klaus Schöffmann,et al.  Video Interaction Tools , 2015, ACM Comput. Surv..

[9]  Yi-Nung Chung,et al.  Applying the Video Summarization Algorithm to Surveillance Systems , 2015 .

[10]  Shipra Aggarwal,et al.  Motion detection, tracking and classification for automated Video Surveillance , 2016, 2016 IEEE 1st International Conference on Power Electronics, Intelligent Control and Energy Systems (ICPEICES).

[11]  Ananda S. Chowdhury,et al.  Multi-View Video Summarization Using Bipartite Matching Constrained Optimum-Path Forest Clustering , 2015, IEEE Transactions on Multimedia.

[12]  Yasmin S. Khan,et al.  Video Summarization: Survey on Event Detection and Summarization in Soccer Videos , 2015 .

[13]  Youness Tabii,et al.  Video Summarization: Techniques and Applications , 2015 .

[14]  Yongdong Zhang,et al.  Efficient Parallel Framework for HEVC Motion Estimation on Many-Core Processors , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Amit K. Roy-Chowdhury,et al.  Context-Aware Surveillance Video Summarization , 2016, IEEE Transactions on Image Processing.

[16]  Yongdong Zhang,et al.  A Highly Parallel Framework for HEVC Coding Unit Partitioning Tree Decision on Many-core Processors , 2014, IEEE Signal Processing Letters.

[17]  Y. Singh,et al.  Moving Object Detection Using Frame Difference, Background Subtraction And SOBS For Video Surveillance Application , 2014 .

[18]  Hua Huang,et al.  VideoGraph: a non-linear video representation for efficient exploration , 2013, The Visual Computer.

[19]  Hongan Wang,et al.  An Interactive SpiralTape Video Summarization , 2016, IEEE Transactions on Multimedia.

[20]  Matthieu Cord,et al.  VSUMM: An Approach for Automatic Video Summarization and Quantitative Evaluation , 2008, 2008 XXI Brazilian Symposium on Computer Graphics and Image Processing.

[21]  Tao Mei,et al.  Near-lossless video summarization , 2009, MM '09.

[22]  Ji Xiao-pin The Detection of Moving Objects Based on Background Subtraction , 2007 .

[23]  Khalid Saeed,et al.  Moving Object Detection Using Background Subtraction , 2014, SpringerBriefs in Computer Science.

[24]  Muhammad Shakir,et al.  Video Summarization: Techniques and Classification , 2012, ICCVG.

[25]  Rubén Heras Evangelio Background subtraction for the detection of moving and static objects in video surveillance , 2014 .

[26]  Hong Liu,et al.  VideoWeb: Space-Time Aware Presentation of a Videoclip Collection , 2014, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[27]  Dalton Meitei Thounaojam,et al.  A SURVEY ON MOVING OBJECT TRACKING IN VIDEO , 2014 .

[28]  Chia-han Lee,et al.  On-Line Multi-View Video Summarization for Wireless Video Sensor Network , 2015, IEEE Journal of Selected Topics in Signal Processing.

[29]  Xi Wang,et al.  Fast Summarization of User-Generated Videos: Exploiting Semantic, Emotional, and Quality Clues , 2016, IEEE MultiMedia.

[30]  Bahadır KARASULU,et al.  REVIEW AND EVALUATION OF WELL-KNOWN METHODS FOR MOVING OBJECT DETECTION AND TRACKING IN VIDEOS , 2010 .

[31]  Daniel DeMenthon,et al.  Automatic Performance Evaluation for Video Summarization , 2004 .

[32]  Luc Van Gool,et al.  A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  J. Filipe,et al.  OBJECTIVE EVALUATION OF VIDEO SEGMENTATION QUALITY , 2009 .

[34]  Li-Qun Xu Issues in video analytics and surveillance systems: Research / prototyping vs. applications / user requirements , 2007, AVSS.

[35]  Imrankhan Pathan,et al.  A Survey on Moving Object Detection and Tracking Methods , 2015 .

[36]  Yongdong Zhang,et al.  Effective Uyghur Language Text Detection in Complex Background Images for Traffic Prompt Identification , 2018, IEEE Transactions on Intelligent Transportation Systems.

[37]  Truong Q. Nguyen,et al.  Moving Object Detection With a Freely Moving Camera via Background Motion Subtraction , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Jiby J Puthiyidam,et al.  A Survey on Video Summarization Techniques , 2015 .

[40]  Sukadev Meher,et al.  Detection of Moving Objects Using Fuzzy Color Difference Histogram Based Background Subtraction , 2016, IEEE Signal Processing Letters.

[41]  K. A. Joshi,et al.  A Survey on Moving Object Detection and Tracking in Video Surveillance System , 2012 .

[42]  Ying Zhang,et al.  Efficient Summarization From Multiple Georeferenced User-Generated Videos , 2016, IEEE Transactions on Multimedia.

[44]  Dattatray Bade,et al.  Moving Object Detection using Background Subtraction, Shadow Removal and Post Processing , 2015 .

[45]  Francesco Tisato,et al.  Attentive Monitoring of Multiple Video Streams Driven by a Bayesian Foraging Strategy , 2014, IEEE Transactions on Image Processing.

[46]  Yu-Gang Jiang,et al.  Fast Summarization of User-Generated Videos Using Semantic , Emotional and Quality Clues , 2016 .

[47]  Bruce A. MacDonald,et al.  A Real-Time Method to Detect and Track Moving Objects (DATMO) from Unmanned Aerial Vehicles (UAVs) Using a Single Camera , 2012, Remote. Sens..

[48]  Hiren Galiyawala,et al.  A Review on Moving Object Detection and Tracking , 2015 .

[49]  Shi-Min Hu,et al.  Robust background identification for dynamic video editing , 2016, ACM Trans. Graph..

[50]  RaviKansagara,et al.  A Study on Video Summarization Techniques , 2014 .

[51]  Jaya S. Kulchandani,et al.  Moving object detection: Review of recent research trends , 2015, 2015 International Conference on Pervasive Computing (ICPC).

[52]  Kalpana Sharma,et al.  Moving Object Detection and Segmentation using Frame Differencing and Summing Technique , 2014 .

[53]  Michael R. Lyu,et al.  Video summarization by video structure analysis and graph optimization , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[54]  Nabendu Chaki,et al.  Moving Object Detection Approaches, Challenges and Object Tracking , 2014 .

[55]  P. G Scholar,et al.  A Survey on Moving Object Detection and Tracking Techniques , 2016 .

[56]  Jitendra Malik,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Segmentation of Moving Objects by Long Term Video Analysis , 2022 .

[57]  Ke Zhang,et al.  Video Summarization with Long Short-Term Memory , 2016, ECCV.