Foreground segmentation in a video by using a novel dynamic codebook

Foreground segmentation in a video is a key process in many applications such as object detection, an object tracking, and a behavior analysis. Since the extracted foreground objects are often used in the analytical process, the quality of the foreground is a significant factor to the success of these applications. However, there are many key challenges in the foreground segmentation, including dynamic backgrounds, gradual illumination changes, sudden illumination changes, shadows, and long-term scene changes. This paper proposes a novel dynamic codebook method to address such challenges. The dynamic codebook aims to significantly improve the conventional well-known codebook technique by introducing a technique to make a dynamic boundary of each codeword. In this technique, the lab color space is used in order to make the model more resilient to the illumination change. The experimental results and comprehensive comparisons demonstrate that the proposed method can achieve very promising performance.

[1]  Larry S. Davis,et al.  A Robust Background Subtraction and Shadow Detection , 1999 .

[2]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[3]  Fatih Murat Porikli,et al.  CDnet 2014: An Expanded Change Detection Benchmark Dataset , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Olivier Bernier,et al.  Local kernel color histograms for background subtraction , 2006, VISAPP.

[5]  Serge Miguet,et al.  Real Time Foreground-Background Segmentation Using a Modified Codebook Model , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[6]  Hasan Sajid,et al.  Background subtraction for static & moving camera , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[7]  Chung-Lin Huang,et al.  Hybrid Codebook Model for Foreground Object Segmentation and Shadow/Highlight Removal , 2014, J. Inf. Sci. Eng..

[8]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[9]  Massimo De Gregorio,et al.  Change Detection with Weightless Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[12]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[13]  S. Bianco,et al.  How Far Can You Get By Combining Change Detection Algorithms? , 2015, ICIAP.

[14]  Atta Badii,et al.  Change detection based on graph cuts , 2015, 2015 International Conference on Systems, Signals and Image Processing (IWSSIP).

[15]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Cina Motamed,et al.  Foreground-Background Segmentation Based on Codebook and Edge Detector , 2014, 2014 Tenth International Conference on Signal-Image Technology and Internet-Based Systems.

[17]  Lucia Maddalena,et al.  A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection , 2010, Neural Computing and Applications.

[18]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[19]  P. Kalaivani,et al.  HUMAN ACTION RECOGNITION USING BACKGROUND SUBTRACTION METHOD , 2015 .

[20]  Ghazali Sulong,et al.  Vehicle Detection and Tracking Techniques: A Concise Review , 2014, ArXiv.

[21]  Anurag Singh,et al.  Object Tracking Using Frame Differencing and Template Matching , 2012 .

[22]  Wilfried Philips,et al.  EFIC: Edge Based Foreground Background Segmentation and Interior Classification for Dynamic Camera Viewpoints , 2015, ACIVS.

[23]  Hélène Laurent,et al.  Comparative study of background subtraction algorithms , 2010, J. Electronic Imaging.

[24]  Bin Wang,et al.  A Fast Self-Tuning Background Subtraction Algorithm , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[25]  James J. Little,et al.  Biometric Gait Recognition , 2003, Advanced Studies in Biometrics.

[26]  Xiqun Lu,et al.  A multiscale spatio-temporal background model for motion detection , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[27]  Mario Ignacio Chacon Murguia,et al.  Auto-Adaptive Parallel SOM Architecture with a modular analysis for dynamic object segmentation in videos , 2016, Neurocomputing.

[28]  Dong Liang,et al.  Improvements and Experiments of a Compact Statistical Background Model , 2014, ArXiv.

[29]  Rui Wang,et al.  Static and Moving Object Detection Using Flux Tensor with Split Gaussian Models , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[30]  Huiyu Zhou,et al.  Spatial mixture of Gaussians for dynamic background modelling , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[31]  Wilfried Philips,et al.  C-EFIC: Color and Edge Based Foreground Background Segmentation with Interior Classification , 2015, VISIGRAPP.

[32]  Mansour Moniri,et al.  Spectral-360: A Physics-Based Technique for Change Detection , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[33]  Benjamin Höferlin,et al.  Evaluation of background subtraction techniques for video surveillance , 2011, CVPR 2011.

[34]  Massimo De Gregorio,et al.  WiSARDrp for Change Detection in Video Sequences , 2017, ESANN.

[35]  Youtian Du,et al.  Gaussian-Based Codebook Model for Video Background Subtraction , 2006, ICNC.

[36]  Ezequiel López-Rubio,et al.  Color space selection for self-organizing map based foreground detection in video sequences , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[37]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[38]  William J. Christmas,et al.  A Tennis Ball Tracking Algorithm for Automatic Annotation of Tennis Match , 2005, BMVC.

[39]  D. Koller,et al.  Towards robust automatic traffic scene analysis in real-time , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[40]  Hasan Sajid,et al.  Universal Multimode Background Subtraction , 2017, IEEE Transactions on Image Processing.