FPGA-Based Real-Time Motion Detection for Automated Video Surveillance Systems

Design of automated video surveillance systems is one of the exigent missions in computer vision community because of their ability to automatically select frames of interest in incoming video streams based on motion detection. This research paper focuses on the real-time hardware implementation of a motion detection algorithm for such vision based automated surveillance systems. A dedicated VLSI architecture has been proposed and designed for clustering-based motion detection scheme. The working prototype of a complete standalone automated video surveillance system, including input camera interface, designed motion detection VLSI architecture, and output display interface, with real-time relevant motion detection capabilities, has been implemented on Xilinx ML510 (Virtex-5 FX130T) FPGA platform. The prototyped system robustly detects the relevant motion in real-time in live PAL (720 × 576) resolution video streams directly coming from the camera.

[1]  Ettore Napoli,et al.  FPGA-based architecture for real time segmentation and denoising of HD video , 2013, Journal of Real-Time Image Processing.

[2]  Shyang Chang,et al.  Statistical change detection with moments under time-varying illumination , 1998, IEEE Trans. Image Process..

[3]  Paul C. Smits,et al.  Toward specification-driven change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[4]  H. Niemann,et al.  Adaptive change detection for real-time surveillance applications , 2000, Proceedings Third IEEE International Workshop on Visual Surveillance.

[5]  Luigi di Stefano,et al.  A change-detection algorithm based on structure and colour , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[6]  Hans-Hellmut Nagel,et al.  New likelihood test methods for change detection in image sequences , 1984, Comput. Vis. Graph. Image Process..

[7]  Takashi Morie,et al.  A Motion Detection Model Inspired by Hippocampal Function and Its FPGA Implementation , 2011, ICONIP.

[8]  Christophe Desmouliers,et al.  FPGA-based design of a high-performance and modular video processing platform , 2009, 2009 IEEE International Conference on Electro/Information Technology.

[9]  A. S. Elfishawy,et al.  Adaptive algorithms for change detection in image sequence , 1991, Signal Process..

[10]  Paul L. Rosin.  Thresholding for change detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Takeo Kanade,et al.  Advances in Cooperative Multi-Sensor Video Surveillance , 1999 .

[12]  Paul L. Rosin,et al.  Evaluation of global image thresholding for change detection , 2003, Pattern Recognit. Lett..

[13]  Liyuan Li,et al.  Integrating intensity and texture differences for robust change detection , 2002, IEEE Trans. Image Process..

[14]  Eduardo Ros,et al.  FPGA Implementation for Real-Time Background Subtraction Based on Horprasert Model , 2012, Sensors.

[15]  Martin Buss,et al.  An FPGA implementation of insect-inspired motion detector for high-speed vision systems , 2008, 2008 IEEE International Conference on Robotics and Automation.

[16]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Daniela Dragomirescu,et al.  A cellular analog network for MRF-based video motion detection , 1999 .

[18]  Viktor Öwall,et al.  An Embedded Real-Time Surveillance System: Implementation and Evaluation , 2008, J. Signal Process. Syst..

[19]  Ettore Napoli,et al.  ASIC and FPGA Implementation of the Gaussian Mixture Model Algorithm for Real-Time Segmentation of High Definition Video , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[20]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[21]  Yawgeng A. Chau,et al.  Optimum multisensor data fusion for image change detection , 1995, IEEE Trans. Syst. Man Cybern..

[22]  M. M. Abutaleb,et al.  Reconfigurable hardware implementation of a fast and efficient motion detection algorithm , 2008 .

[23]  Tadashi Shibata,et al.  A Vlsi-Implementation-Friendly EGO-Motion Detection Algorithm Based on Edge-Histogram Matching , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[24]  Touradj Ebrahimi,et al.  Video object extraction based on adaptive background and statistical change detection , 2000, IS&T/SPIE Electronic Imaging.

[25]  Habibulla Khan,et al.  FPGA implementation of moving object detection in frames by using background subtraction algorithm , 2013, 2013 International Conference on Communication and Signal Processing.

[26]  S. Chaudhury,et al.  Video Trans-coding in Smart Camera for Ubiquitous Multimedia Environment , 2008, 2008 International Symposium on Ubiquitous Multimedia Computing.

[27]  Ashbindu Singh,et al.  Review Article Digital change detection techniques using remotely-sensed data , 1989 .

[28]  Anil Vohra,et al.  Real-Time Implementation of Change Detection for Automated Video Surveillance System , 2013 .

[29]  M. Tech,et al.  The Hardware Implementation of Motion Object Detection Based on Background Subtraction , 2013 .

[30]  Chris Clifton.  Change Detection in Overhead Imagery Using Neural Networks , 2004, Applied Intelligence.

[31]  Ramesh C. Jain,et al.  Illumination independent change detection for real world image sequences , 1989, Comput. Vis. Graph. Image Process..

[32]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[33]  Petr Honzík,et al.  Video surveillance application based on application specific vector processors , 2012, Proceedings of the 2012 Conference on Design and Architectures for Signal and Image Processing.

[34]  Santanu Chaudhury,et al.  Hardware accelerator design for change detection in smart camera , 2011, International Conference on Graphic and Image Processing.

[35]  Carlos H. Llanos,et al.  Background subtraction algorithm for moving object detection in FPGA , 2012, 2012 VIII Southern Conference on Programmable Logic.

[36]  M. McErlean.  Hierarchical Motion Estimation for Embedded Object Tracking , 2006, 2006 IEEE International Symposium on Signal Processing and Information Technology.

[37]  Kichul Kim,et al.  A new motion estimation algorithm for mobile real-time video and its FPGA implementation , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[38]  Franck Luthon,et al.  Real time implementation of an MRF-based motion detection algorithm on a DSP board , 1996, 1996 IEEE Digital Signal Processing Workshop Proceedings.

[39]  Stanley S. Ipson,et al.  A novel CPLD based implementation of a motion detection algorithm for surveillance applications , 1998, Proceedings of the IEEE 1998 Custom Integrated Circuits Conference (Cat. No.98CH36143).

[40]  Charoensak Charayaphan,et al.  Rapid FPGA prototyping of Gabor-wavelet transform for applications in motion detection , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[41]  Zhenyu Liu,et al.  A Novel Motion-Detection and Edge-Detection Algorithm Based on Motion Estimation , 2012 .

[42]  W. Malila.  Change Vector Analysis: An Approach for Detecting Forest Changes with Landsat , 1980 .

[43]  Santanu Chaudhury,et al.  FPGA Based Embedded Implementation of Video Summary Generation Scheme in Smart Camera , 2011 .

[44]  Sridha Sridharan,et al.  Real-Time Adaptive Foreground/Background Segmentation , 2005, EURASIP J. Adv. Signal Process..

[45]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[46]  E.M. Saad,et al.  FPGA-based implementation of a low cost and area real-time motion detection , 2008, 2008 15th International Conference on Mixed Design of Integrated Circuits and Systems.

[47]  A. Haslett.  Electronics , 1948 .

[48]  E. Napoli,et al.  OpenCV compatible real time processor for background foreground identification , 2010, 2010 International Conference on Microelectronics.

[49]  T. Ebrahimi,et al.  Change detection and background extraction by linear algebra , 2001, Proc. IEEE.

[50]  Viktor Öwall,et al.  A Hardware Architecture for Real-Time Video Segmentation Utilizing Memory Reduction Techniques , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[51]  M. Martina,et al.  DSP implmentation of a low complexity motion detection algorithm , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..

[52]  Franck Luthon,et al.  Real-time DSP implementation for MRF-based video motion detection , 1999, IEEE Trans. Image Process..

[53]  Anil Vohra,et al.  Performance Evaluation of Different Memory Components for FPGA based Embedded System Design for Video Processing Application , 2013 .