Cost-sensitive background subtraction

Foreground and background are treated without distinction at classification stage in most background subtraction algorithms. However, correct classification of foreground is the primary requirement, and thus misclassification costs of the two classes should be different. Based on this fact, we present a new method to introduce cost sensitivity into background subtraction, where a cost matrix is created to represent the costs of misclassification. Some items in the cost matrix are not constants, but functions of foreground occurence at each pixel location. By the use of such non-constant costs, detection rate of foreground is improved while increase of false alarms is prevented at the same time. Experiments demonstrate the effectiveness of the proposed algorithm.

[1]  Monica N. Nicolescu,et al.  Non-parametric statistical background modeling for efficient foreground region detection , 2008, Machine Vision and Applications.

[2]  Narciso García,et al.  Efficient Moving Object Detection for Lightweight Applications on Smart Cameras , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  L. Davis,et al.  Background and foreground modeling using nonparametric kernel density estimation for visual surveillance , 2002, Proc. IEEE.

[4]  Yaser Sheikh,et al.  Bayesian modeling of dynamic scenes for object detection , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Robert T. Collins,et al.  Belief Propagation in a 3D Spatio-temporal MRF for Moving Object Detection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Zhi-Hua Zhou,et al.  Ieee Transactions on Knowledge and Data Engineering 1 Training Cost-sensitive Neural Networks with Methods Addressing the Class Imbalance Problem , 2022 .

[7]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Ezequiel López-Rubio,et al.  Stochastic approximation for background modelling , 2011, Comput. Vis. Image Underst..

[9]  L. Davis,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Density-based Multi-feature Background Subtraction with Support Vector Machine , 2022 .

[10]  Yang Wang,et al.  Cost-sensitive boosting for classification of imbalanced data , 2007, Pattern Recognit..

[11]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[12]  Montse Pardàs,et al.  Bayesian foreground segmentation and tracking using pixel-wise background model and region based foreground model , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[13]  Bohyung Han,et al.  Density-Based Multifeature Background Subtraction with Support Vector Machine , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  Tieniu Tan,et al.  Foreground Object Detection Using Top-Down Information Based on EM Framework , 2012, IEEE Transactions on Image Processing.