FPGA Implementation for Real-Time Background Subtraction Based on Horprasert Model

Background subtraction is considered the first processing stage in video surveillance systems, and consists of determining objects in movement in a scene captured by a static camera. It is an intensive task with a high computational cost. This work proposes an embedded novel architecture on FPGA which is able to extract the background on resource-limited environments and offers low degradation (produced because of the hardware-friendly model modification). In addition, the original model is extended in order to detect shadows and improve the quality of the segmentation of the moving objects. We have analyzed the resource consumption and performance in Spartan3 Xilinx FPGAs and compared to others works available on the literature, showing that the current architecture is a good trade-off in terms of accuracy, performance and resources utilization. With less than a 65% of the resources utilization of a XC3SD3400 Spartan-3A low-cost family FPGA, the system achieves a frequency of 66.5 MHz reaching 32.8 fps with resolution 1,024 × 1,024 pixels, and an estimated power consumption of 5.76 W.

[1]  Guillaume-Alexandre Bilodeau,et al.  A Multiscale Region-Based Motion Detection and Background Subtraction Algorithm , 2010, Sensors.

[2]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.

[4]  Jwu-Sheng Hu,et al.  Robust Background Subtraction with Shadow and Highlight Removal for Indoor Surveillance , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[6]  Peter Carr,et al.  GPU Accelerated Multimodal Background Subtraction , 2008, 2008 Digital Image Computing: Techniques and Applications.

[7]  Mancia Anguita,et al.  Optimization Strategies for High-Performance Computing of Optical-Flow in General-Purpose Processors , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[9]  Andrew Hunter,et al.  A single-chip FPGA implementation of real-time adaptive background model , 2005, Proceedings. 2005 IEEE International Conference on Field-Programmable Technology, 2005..

[10]  Jörn Ostermann,et al.  Detection of Moving Cast Shadows for Object Segmentation , 1999, IEEE Trans. Multim..

[11]  Raimundo Carlos Silvério Freire,et al.  FPGA architecture for static background subtraction in real time , 2006, SBCCI '06.

[12]  K. Shadan,et al.  Available online: , 2012 .

[13]  Rita Cucchiara,et al.  Detecting objects, shadows and ghosts in video streams by exploiting color and motion information , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[14]  Viktor Öwall,et al.  Hardware accelerator design for video segmentation with multi-modal background modelling , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[15]  Naim Dahnoun,et al.  Implementation and Optimisation of a Video Object Segmentation Algorithm on an Embedded DSP Platform , 2006 .

[16]  José Luis Lázaro,et al.  An Intelligent Architecture Based on Field Programmable Gate Arrays Designed to Detect Moving Objects by Using Principal Component Analysis , 2010, Sensors.

[17]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  Andrew Hunter,et al.  A run-length based connected component algorithm for FPGA implementation , 2008, 2008 International Conference on Field-Programmable Technology.

[19]  KimKyungnam,et al.  Real-time foreground-background segmentation using codebook model , 2005 .

[20]  Hugo Jiménez-Hernández,et al.  Background Subtraction Approach based on Independent Component Analysis , 2010, Sensors.

[21]  Viktor Öwall,et al.  A low complexity architecture for binary image erosion and dilation using structuring element decomposition , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[22]  Mohan M. Trivedi,et al.  Moving shadow and object detection in traffic scenes , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[23]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[24]  Hoai Bac Le,et al.  GPU Implementation of Extended Gaussian Mixture Model for Background Subtraction , 2010, 2010 IEEE RIVF International Conference on Computing & Communication Technologies, Research, Innovation, and Vision for the Future (RIVF).

[25]  Jonathan H. Connell,et al.  A Statistical Approach for Real-time Robust Background Subtrac tion and Shadow Detection , 2014 .

[26]  Thomas Sikora,et al.  Comparison of static background segmentation methods , 2005, Visual Communications and Image Processing.

[27]  Bo Wang,et al.  Design of airport video aided surveillance system based on DSP+FPGA , 2011, Proceedings of the 30th Chinese Control Conference.