Real-time moving object detection for video surveillance system in FPGA

FPGA devices are a perfect platform for implementing image processing algorithms. In the article, an advanced video system is presented, which is able to detect moving objects in video sequences. The detection method is using two algorithms. First of all, a multimodal background generation method allows reliable scene modelling in case of rapid changes in lighting conditions and small background movement. Finally a segmentation based on three parameters lightness, colour and texture is applied. This approach allows to remove shadows from the processed image. Authors proposed some improvements and modifications to existing algorithms in order to make them suitable for reconfigurable platforms. In the final system only one, low cost, FPGA device is able to receive data from high speed digital camera, perform a Bayer transform, RGB to CIE Lab colour space conversion, generate a moving object mask and present results to the operator in real-time.

[1]  E.M. Saad,et al.  FPGA-based object-extraction based on multimodal Σ-Δ background estimation , 2009, 2009 2nd International Conference on Computer, Control and Communication.

[2]  Shengcai Liao,et al.  Moving Cast Shadow Removal Based on Local Descriptors , 2010, 2010 20th International Conference on Pattern Recognition.

[3]  Raimundo Carlos Silvério Freire,et al.  FPGA architecture for static background subtraction in real time , 2006, SBCCI '06.

[4]  Csaba Benedek,et al.  Study on color space selection for detecting cast shadows in video surveillance , 2007, Int. J. Imaging Syst. Technol..

[5]  Michal Musial,et al.  Hardware realization of shadow detection algorithm in FPGA , 2010, 2010 2nd International Conference on Information Technology, (2010 ICIT).

[6]  Sridha Sridharan,et al.  Real-time adaptive background segmentation , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[7]  Marek Gorgon,et al.  PixelStreams-based implementation of videodetector , 2007, 15th Annual IEEE Symposium on Field-Programmable Custom Computing Machines (FCCM 2007).

[8]  Andrew Hunter,et al.  A single-chip FPGA implementation of real-time adaptive background model , 2005, Proceedings. 2005 IEEE International Conference on Field-Programmable Technology, 2005..

[9]  Sridha Sridharan,et al.  Real-time adaptive background segmentation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[10]  Tamás Szirányi,et al.  Study on color space selection for detecting cast shadows in video surveillance: Articles , 2007 .

[11]  Shireen Elhabian,et al.  Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art , 2008 .

[12]  Viktor Öwall,et al.  Hardware accelerator design for video segmentation with multi-modal background modelling , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[13]  Jesús M. Pérez,et al.  Low-cost Bayer to RGB bilinear interpolation with hardware-aware median filter , 2009, 2009 16th IEEE International Conference on Electronics, Circuits and Systems - (ICECS 2009).

[14]  Liyuan Li,et al.  Integrating intensity and texture differences for robust change detection , 2002, IEEE Trans. Image Process..