A Framework for Automatic Video Surveillance Indexing and Retrieval

The manual search through the surveillance video archives for a specific object or event is very time-consuming and tedious task due to the large volume of video data captured by many installed surveillance cameras. Therefore, the solution to accelerate and facilitate this process is to design an automatic video surveillance with the efficient and effective video indexing, video data model, query formulation and language, as well as visualization interface. There are many challenges, for developing a powerful query processing module, formulating complex queries and selecting suitable similarity matching strategy to detect any abnormality based on semantic content of the video using various query types. This study presents a novel video surveillance indexing and retrieval framework to cope with the above challenges. The proposed framework consists of three main modules i.e., pre-processing, query processing and retrieval processing. Moreover, it supports an efficient search and actively refines the retrieval result by formulating various query types including: query-by-text, query-by-example and query-by-region.

[1]  Dezhen Song,et al.  Systems and algorithms for autonomous and scalable crowd surveillance using robotic PTZ cameras assisted by a wide-angle camera , 2010, Auton. Robots.

[2]  Carlo S. Regazzoni,et al.  Real-time video-shot detection for scene surveillance applications , 2000, IEEE Trans. Image Process..

[3]  A. Hampapur,et al.  Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking , 2005, IEEE Signal Processing Magazine.

[4]  Mario Vento,et al.  A Method for Counting Moving People in Video Surveillance Videos , 2010, EURASIP J. Adv. Signal Process..

[5]  W. Sabbar,et al.  Video summarization using shot segmentation and local motion estimation , 2012, Second International Conference on the Innovative Computing Technology (INTECH 2012).

[6]  Online Surveillance Video Archive System , 2007, MMM.

[7]  Chabane Djeraba,et al.  Motion Pattern Extraction and Event Detection for Automatic Visual Surveillance , 2011, EURASIP J. Image Video Process..

[8]  Özgür Ulusoy,et al.  A Database Model for Querying Visual Surveillance Videos by Integrating Semantic and Low-Level Features , 2005, Multimedia Information Systems.

[9]  Özgür Ulusoy,et al.  Scenario-based query processing for video-surveillance archives , 2010, Eng. Appl. Artif. Intell..

[10]  Alan F. Smeaton,et al.  User-interface to a CCTV video search system , 2005 .

[11]  Carlo S. Regazzoni,et al.  Content-based retrieval and real time detection from video sequences acquired by surveillance systems , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[12]  Sangjin Hong,et al.  Data modeling and query processing for distributed surveillance systems , 2013, New Rev. Hypermedia Multim..

[13]  Monique Thonnat,et al.  Surveillance video retrieval: what we have already done? , 2010, ICC 2010.

[14]  Peng Jiang,et al.  Keyframe-Based Video Summary Using Visual Attention Clues , 2010, IEEE Multim..

[15]  Zhouyu Fu,et al.  Semantic-Based Surveillance Video Retrieval , 2007, IEEE Transactions on Image Processing.

[16]  Rogério Schmidt Feris,et al.  Searching surveillance video , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[17]  R. Cucchiara,et al.  Multimedia surveillance: content-based retrieval with multicamera people tracking , 2006, VSSN '06.

[18]  Lilly Suriani Affendey,et al.  Systematic Review and Classification on Video Surveillance Systems , 2013 .

[19]  Young Hoon Joo,et al.  Fast and robust algorithm of tracking multiple moving objects for intelligent video surveillance systems , 2011, IEEE Transactions on Consumer Electronics.

[20]  Huei-Fang Yang,et al.  Quick browsing and retrieval for surveillance videos , 2013, Multimedia Tools and Applications.

[21]  François Brémond,et al.  A Query Language Combining Object Features and Semantic Events for Surveillance Video Retrieval , 2008, MMM.

[22]  François Brémond,et al.  Surveillance Video Indexing and Retrieval Using Object Features and Semantic Events , 2009, Int. J. Pattern Recognit. Artif. Intell..

[23]  Jiang Peng,et al.  Keyframe-Based Video Summary Using Visual Attention Clues , 2010 .

[24]  Yo-Sung Ho,et al.  Content-based event retrieval using semantic scene interpretation for automated traffic surveillance , 2001, IEEE Trans. Intell. Transp. Syst..