Real-time moving object detection algorithm on high-resolution videos using GPUs

Modern imaging sensors with higher megapixel resolution and frame rates are being increasingly used for wide-area video surveillance (VS). This has produced an accelerated demand for high-performance implementation of VS algorithms for real-time processing of high-resolution videos. The emergence of multi-core architectures and graphics processing units (GPUs) provides energy and cost-efficient platform to meet the real-time processing needs by extracting data level parallelism in such algorithms. However, the potential benefits of these architectures can only be realized by developing fine-grained parallelization strategies and algorithm innovation. This paper describes parallel implementation of video object detection algorithms like Gaussians mixture model (GMM) for background modelling, morphological operations for post-processing and connected component labelling (CCL) for blob labelling. Novel parallelization strategies and fine-grained optimization techniques are described for fully exploiting the computational capacity of CUDA cores on GPUs. Experimental results show parallel GPU implementation achieves significant speedups of ~250× for binary morphology, ~15× for GMM and ~2× for CCL when compared to sequential implementation running on Intel Xeon processor, resulting in processing of 22.3 frames per second for HD videos.

[1]  M. MANOHAR,et al.  Connected component labeling of binary images on a mesh connected massively parallel processor , 1989, Comput. Vis. Graph. Image Process..

[2]  Christophe Fiorio,et al.  Two Linear Time Union-Find Strategies for Image Processing , 1996, Theor. Comput. Sci..

[3]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[5]  Takeo Kanade,et al.  A System for Video Surveillance and Monitoring , 2000 .

[6]  Carl G. Looney,et al.  Fast connected component labeling algorithm using a divide and conquer technique , 2000, CATA.

[7]  Ioannis Pavlidis,et al.  Urban surveillance systems: from the laboratory to the commercial world , 2001, Proc. IEEE.

[8]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[9]  Chun-Jen Chen,et al.  A linear-time component-labeling algorithm using contour tracing technique , 2004, Comput. Vis. Image Underst..

[10]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  Arie Shoshani,et al.  Optimizing connected component labeling algorithms , 2005, SPIE Medical Imaging.

[12]  James W. Davis,et al.  Fusion-Based Background-Subtraction using Contour Saliency , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[13]  Trista Pei-chun Chen,et al.  Computer Vision Workload Analysis: Case Study of Video Surveillance Systems , 2005 .

[14]  Lurng-Kuo Liu,et al.  Video Analysis and Compression on the STI Cell Broadband Engine Processor , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[15]  Kannappan Palaniappan,et al.  Quantitative cell motility for in vitro wound healing using level set-based active contour tracking , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[16]  Chi-Ren Shyu,et al.  GeoIRIS: Geospatial Information Retrieval and Indexing System—Content Mining, Semantics Modeling, and Complex Queries , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Hidemasa Muta,et al.  Multilevel parallelization on the cell/B.E. for a motion JPEG 2000 encoding server , 2007, ACM Multimedia.

[18]  Leonel Sousa,et al.  A Parallel Algorithm for Advanced Video Motion Estimation on Multicore Architectures , 2008, 2008 International Conference on Complex, Intelligent and Software Intensive Systems.

[19]  R. Miyamoto,et al.  Parallel implementation of morphological processing on Cell/BE with OpenCV interface , 2008, 2008 3rd International Symposium on Communications, Control and Signal Processing.

[20]  Ian D. Reid,et al.  Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors , 2008, ECCV.

[21]  Rama Chellappa,et al.  Object Detection, Tracking and Recognition for Multiple Smart Cameras , 2008, Proceedings of the IEEE.

[22]  Kevin Skadron,et al.  Accelerating leukocyte tracking using CUDA: A case study in leveraging manycore coprocessors , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[23]  Guna Seetharaman,et al.  Semantic Concept Mining Based on Hierarchical Event Detection for Soccer Video Indexing , 2009, J. Multim..

[24]  Guna Seetharaman,et al.  Parallel Blob Extraction Using the Multi-core Cell Processor , 2009, ACIVS.

[25]  Ankush Mittal,et al.  OS-Guard: on-site signature based framework for multimedia surveillance data management , 2010, Multimedia Tools and Applications.