Multispectral Dynamic Codebook and Fusion Strategy for Moving Objects Detection

The Codebook model is one of the popular real-time models for background subtraction to detect moving objects. In this paper, we propose two techniques to adapt the original Codebook algorithm to multispectral images: dynamic mechanism and fusion strategy. For each channel, only absolute spectral value is used to calculate the spectral similarity between the current frame pixel and reference average value in the matching process, which can simplify the matching equations. Besides, the deciding boundaries are obtained based on statistical information extracted from the data and always adjusting themselves to the scene changes. Results demonstrate that with the proposed techniques, we can acquire a comparable accuracy with other methods using the same multispectral dataset for background subtraction.

[1]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[2]  Cina Motamed,et al.  Foreground-Background Segmentation Based on Codebook and Edge Detector , 2014, 2014 Tenth International Conference on Signal-Image Technology and Internet-Based Systems.

[3]  Worapan Kusakunniran,et al.  Dynamic Codebook for Foreground Segmentation in a Video , 2017, IEEE CIT 2017.

[4]  Thierry Bouwmans,et al.  Background Modeling using Mixture of Gaussians for Foreground Detection - A Survey , 2008 .

[5]  Manli Zhou,et al.  Box-based codebook model for real-time objects detection , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[6]  Cindy Cappelle,et al.  Multi-object tracking with discriminant correlation filter based deep learning tracker , 2019, Integr. Comput. Aided Eng..

[7]  Long Ang Lim,et al.  Learning multi-scale features for foreground segmentation , 2018, Pattern Analysis and Applications.

[8]  Brendon J. Woodford,et al.  A Self-adaptive CodeBook (SACB) model for real-time background subtraction , 2015, Image Vis. Comput..

[9]  Yassine Ruichek,et al.  Extended Codebook with Multispectral Sequences for Background Subtraction † , 2019, Sensors.

[10]  Andrei Zaharescu,et al.  Multi-scale multi-feature codebook-based background subtraction , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[11]  Gao Ruidong.  Moving Object Detection Based on Improved Codebook Model , 2015 .

[12]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[13]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[14]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  Miao Yu,et al.  Online codebook modeling based background subtraction with a moving camera , 2017, 2017 3rd International Conference on Frontiers of Signal Processing (ICFSP).

[16]  Aqsa Khan,et al.  Review on Moving Object Detection in Video Surveillance , 2017 .

[17]  Cindy Cappelle,et al.  Online multi-object tracking combining optical flow and compressive tracking in Markov decision process , 2019, J. Vis. Commun. Image Represent..

[18]  Mohan M. Trivedi,et al.  "Hybrid Cone-Cylinder" Codebook Model for Foreground Detection with Shadow and Highlight Suppression , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[19]  I. I Ntroduction,et al.  Intelligent Parking Space Detection System Based on Image Processing , 2012 .

[20]  R. Yusnita,et al.  Intelligent Parking Space Detection System Based on Image Processing , 2022 .

[21]  Jean-Baptiste Thomas,et al.  Background subtraction with multispectral video sequences , 2014 .