Performance Evaluation of SoC-FPGA Based Floating-Point Implementation of GMM for Real-Time Background Subtraction

The embedded systems continue to display as solutions of smart surveillance systems. Background subtraction using Gaussian Mixture Model (GMM) is often portrayed as a common step for video processing. This work discusses the implementation of an embedded vision system on system-on-a-chip (SoC) device that integrates both a processor and an FPGA (Field Programmable Gate Array) architecture. The conventional Register Transfer Level (RTL) design, typically used for FPGA programming is slow, and the use of floating-point arithmetic is complex. However, the use of High-Level Synthesis (HLS) tools allows describing algorithms using high-level programming languages. Three background subtraction algorithms with floating-point arithmetic were developed using a hardware-software co-design methodology. The paper presents the details of the implementation on a ZedBoard Zynq Evaluation and Development Kit, considering requirements as hardware resources and power consumption used. Also, performance comparisons among a PC-based, ARM, FPGA and SOC-FPGA implementations are presented. The results showed that frame rates needed for real-time video processing were reached.

[1]  Thierry Chateau,et al.  A Benchmark Dataset for Outdoor Foreground/Background Extraction , 2012, ACCV Workshops.

[2]  S. Arivazhagan,et al.  FPGA Implementation of GMM Algorithm for Background Subtractions in Video Sequences , 2016, CVIP.

[3]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Ettore Napoli,et al.  FPGA-based architecture for real time segmentation and denoising of HD video , 2013, Journal of Real-Time Image Processing.

[5]  Tomasz Kryjak,et al.  Implementation of Advanced Foreground Segmentation Algorithms GMM, ViBE and PBAS in FPGA and GPU - A Comparison , 2014, ICCVG.

[6]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[7]  Yimin Yang,et al.  System-on-a-chip (SoC)-based hardware acceleration for foreground and background identification , 2017, J. Frankl. Inst..

[8]  Ettore Napoli,et al.  ASIC and FPGA Implementation of the Gaussian Mixture Model Algorithm for Real-Time Segmentation of High Definition Video , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[9]  Kalpana Goyal,et al.  Review of background subtraction methods using Gaussian mixture model for video surveillance systems , 2017, Artificial Intelligence Review.

[10]  Tomasz Kryjak,et al.  Real-Time Implementation of Background Modelling Algorithms in FPGA Devices , 2015, ICIAP Workshops.

[11]  Stefania Perri,et al.  Multimodal background subtraction for high-performance embedded systems , 2019, Journal of Real-Time Image Processing.

[12]  Eduardo Ros Vidal,et al.  Codebook hardware implementation on FPGA for background subtraction , 2012, Journal of Real-Time Image Processing.

[13]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[14]  J. Ferryman,et al.  PETS2009: Dataset and challenge , 2009, 2009 Twelfth IEEE International Workshop on Performance Evaluation of Tracking and Surveillance.