ASIC and FPGA Implementation of the Gaussian Mixture Model Algorithm for Real-Time Segmentation of High Definition Video

Background identification is a common feature in many video processing systems. This paper proposes two hardware implementations of the OpenCV version of the Gaussian mixture model (GMM), a background identification algorithm. The implemented version of the algorithm allows a fast initialization of the background model while an innovative, hardware-oriented, formulation of the GMM equations makes the proposed circuits able to perform real-time background identification on high definition (HD) video sequences with frame size 1920 × 1080. The first of the two circuits is designed with commercial field-programmable gate-array (FPGA) devices as target. When implemented on Virtex6 vlx75t, the proposed circuit process 91 HD fps (frames per second) and uses 3% of FPGA logic resources. The second circuit is oriented to the implementation in UMC-90 nm CMOS standard cell technology, and is proposed in two versions. Both versions can process at a frame rate higher than 60 HD fps. The first version uses the constant voltage scaling technique to provide a low power implementation. It provides silicon area occupation of 28847 μm2 and energy dissipation per pixel of 15.3 pJ/pixel. The second version is designed to reduce silicon area utilization and occupies 21847 μm2 with an energy dissipation of 49.4 pJ/pixel.

[1]  K. P. Karmann,et al.  Moving object recognition using an adaptive background memory , 1990 .

[2]  Hoai Bac Le,et al.  GPU Implementation of Extended Gaussian Mixture Model for Background Subtraction , 2010, 2010 IEEE RIVF International Conference on Computing & Communication Technologies, Research, Innovation, and Vision for the Future (RIVF).

[3]  Larry S. Davis,et al.  A fast background scene modeling and maintenance for outdoor surveillance , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Olaf Munkelt,et al.  Adaptive Background Estimation and Foreground Detection using Kalman-Filtering , 1995 .

[5]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[6]  Eduardo Ros,et al.  FPGA Implementation for Real-Time Background Subtraction Based on Horprasert Model , 2012, Sensors.

[7]  Ettore Napoli,et al.  FPGA-based architecture for real time segmentation and denoising of HD video , 2013, Journal of Real-Time Image Processing.

[8]  Richard Bowden,et al.  A real time adaptive visual surveillance system for tracking low-resolution colour targets in dynamically changing scenes , 2003, Image Vis. Comput..

[9]  Viktor Öwall,et al.  A Hardware Architecture for Real-Time Video Segmentation Utilizing Memory Reduction Techniques , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Peter Carr,et al.  GPU Accelerated Multimodal Background Subtraction , 2008, 2008 Digital Image Computing: Techniques and Applications.

[11]  Lu Cheng,et al.  Moving object detection and recognition based on the frame difference algorithm and moment invariant features , 2008, 2008 27th Chinese Control Conference.

[12]  Shireen Elhabian,et al.  Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art , 2008 .

[13]  Viktor Öwall,et al.  An Embedded Real-Time Surveillance System: Implementation and Evaluation , 2008, J. Signal Process. Syst..

[14]  Soraia Raupp Musse,et al.  Background Subtraction and Shadow Detection in Grayscale Video Sequences , 2005, XVIII Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI'05).

[15]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[16]  Viktor Öwall,et al.  Hardware accelerator design for video segmentation with multi-modal background modelling , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[17]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[19]  Thierry Bouwmans,et al.  Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey , 2008 .

[20]  Hamid Aghajan,et al.  Video-based freeway-monitoring system using recursive vehicle tracking , 1995, Electronic Imaging.

[21]  Abbes Amira,et al.  An Efficient FPGA Implementation of Gaussian Mixture Models-Based Classifier Using Distributed Arithmetic , 2006, 2006 13th IEEE International Conference on Electronics, Circuits and Systems.

[22]  Tomasz Kryjak,et al.  Real-time moving object detection for video surveillance system in FPGA , 2011, Proceedings of the 2011 Conference on Design & Architectures for Signal & Image Processing (DASIP).

[23]  Song Zheng,et al.  An Improved Moving Object Detection Algorithm Based on Frame Difference and Edge Detection , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[24]  E. Napoli,et al.  OpenCV compatible real time processor for background foreground identification , 2010, 2010 International Conference on Microelectronics.

[25]  Sun Han,et al.  A Practical Method for Moving Target Detection Under Complex Background , 2005 .

[26]  Hugo Jiménez-Hernández,et al.  Temporal Templates for Detecting the Trajectories of Moving Vehicles , 2009, ACIVS.

[27]  Chung-Cheng Chiu,et al.  A Robust Object Segmentation System Using a Probability-Based Background Extraction Algorithm , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[29]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[30]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..