Parallel Key Frame Extraction for Surveillance Video Service in a Smart City

Surveillance video service (SVS) is one of the most important services provided in a smart city. It is very important for the utilization of SVS to provide design efficient surveillance video analysis techniques. Key frame extraction is a simple yet effective technique to achieve this goal. In surveillance video applications, key frames are typically used to summarize important video content. It is very important and essential to extract key frames accurately and efficiently. A novel approach is proposed to extract key frames from traffic surveillance videos based on GPU (graphics processing units) to ensure high efficiency and accuracy. For the determination of key frames, motion is a more salient feature in presenting actions or events, especially in surveillance videos. The motion feature is extracted in GPU to reduce running time. It is also smoothed to reduce noise, and the frames with local maxima of motion information are selected as the final key frames. The experimental results show that this approach can extract key frames more accurately and efficiently compared with several other methods.

[1]  B. B. Meshram,et al.  Content based video retrieval , 2012, ArXiv.

[2]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[3]  Xuelong Li,et al.  Shot-based video retrieval with optical flow tensor and HMMs , 2009, Pattern Recognit. Lett..

[4]  Fatih Murat Porikli,et al.  Changedetection.net: A new change detection benchmark dataset , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Andrew S. Grimshaw,et al.  Revisiting sorting for GPGPU stream architectures , 2010, 2010 19th International Conference on Parallel Architectures and Compilation Techniques (PACT).

[6]  André Kaup,et al.  Real-time Moving Object Detection in Video Sequences using Spatio-temporal Adaptive Gaussian Mixture Models , 2010, VISAPP.

[7]  Alan F. Smeaton,et al.  Using Graphics Processor Units (GPUs) for Automatic Video Structuring , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[8]  Yan Yang,et al.  Summarisation of surveillance videos by key-frame selection , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[9]  Rui-Min Hu,et al.  Summarization Extraction Method for Surveillance Video Based on Color Spatial Distribution Characteristic , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[10]  Ananda S. Chowdhury,et al.  Video key frame extraction through dynamic Delaunay clustering with a structural constraint , 2013, J. Vis. Commun. Image Represent..

[11]  ZhangHongJiang,et al.  Automatic partitioning of full-motion video , 1993 .

[12]  Li Li,et al.  A Survey on Visual Content-Based Video Indexing and Retrieval , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Hsueh-Ming Hang,et al.  H.264/AVC motion estimation implmentation on Compute Unified Device Architecture (CUDA) , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[14]  Xipeng Shen,et al.  A cross-input adaptive framework for GPU program optimizations , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[15]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[16]  Himanshu S. Bhatt,et al.  On Recognizing Faces in Videos Using Clustering-Based Re-Ranking and Fusion , 2014, IEEE Transactions on Information Forensics and Security.

[17]  Stephen W. Smoliar,et al.  An integrated system for content-based video retrieval and browsing , 1997, Pattern Recognit..

[18]  S. Shirmohammadi,et al.  An event based approach to video analysis and keyframe selection , 2010, 2010 IEEE Workshop On Signal Processing Systems.

[19]  Kebin Jia,et al.  Video Key Frame Extraction Based on Spatial-Temporal Color Distribution , 2008, 2008 International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[20]  B. B. Meshram,et al.  Content based video retrieval systems , 2012, ArXiv.