Framework for dynamic background modeling and shadow suppression for moving object segmentation in complex wavelet domain

Abstract. Moving object segmentation using change detection in wavelet domain under continuous variations of lighting condition is a challenging problem in video surveillance systems. There are several methods proposed in the literature for change detection in wavelet domain for moving object segmentation having static backgrounds, but it has not been addressed effectively for dynamic background changes. The methods proposed in the literature suffer from various problems, such as ghostlike appearance, object shadows, and noise. To deal with these issues, a framework for dynamic background modeling and shadow suppression under rapidly changing illumination conditions for moving object segmentation in complex wavelet domain is proposed. The proposed method consists of eight steps applied on given video frames, which include wavelet decomposition of frame using complex wavelet transform; use of change detection on detail coefficients (LH, HL, and HH), use of improved Gaussian mixture-based dynamic background modeling on approximate coefficient (LL subband); cast shadow suppression; use of soft thresholding for noise removal; strong edge detection; inverse wavelet transformation for reconstruction; and finally using closing morphology operator. A comparative analysis of the proposed method is presented both qualitatively and quantitatively with other standard methods available in the literature for six datasets in terms of various performance measures. Experimental results demonstrate the efficacy of the proposed method.

[1]  Rajeev Srivastava,et al.  Restoration and enhancement of astronomical images using hybrid adaptive nonlinear complex diffusion-based filter , 2012 .

[2]  Mubarak Shah,et al.  A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Chingchun Huang,et al.  Motion-based Background Modeling for Moving Object Detection on Moving Platforms , 2007, 2007 16th International Conference on Computer Communications and Networks.

[4]  James Ferryman,et al.  Proceedings of the thirteenth IEEE International Workshop on Performance Evaluation of Tracking and Surveillance , 2009 .

[5]  Tieniu Tan,et al.  An Integrated Traffic and Pedestrian Model-Based Vision System , 1997, BMVC.

[6]  Y.-P. Guan,et al.  Spatio-temporal motion-based foreground segmentation and shadow suppression , 2010 .

[7]  Manish Khare,et al.  Single change detection-based moving object segmentation by using Daubechies complex wavelet transform , 2014, IET Image Process..

[8]  Thierry Bouwmans,et al.  Traditional and recent approaches in background modeling for foreground detection: An overview , 2014, Comput. Sci. Rev..

[9]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.

[10]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..

[11]  Stephen B. Gray,et al.  Local Properties of Binary Images in Two Dimensions , 1971, IEEE Transactions on Computers.

[12]  Jenq-Neng Hwang,et al.  Fast and automatic video object segmentation and tracking for content-based applications , 2002, IEEE Trans. Circuits Syst. Video Technol..

[13]  J. Crowley,et al.  CAVIAR Context Aware Vision using Image-based Active Recognition , 2005 .

[14]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[15]  Om Prakash,et al.  Adaptive real-time motion segmentation technique based on statistical background model , 2014 .

[16]  Rita Cucchiara,et al.  Visor: Video Surveillance Online Repository , 2007 .

[17]  W.-S. Hsieh,et al.  Wavelet-based moving object segmentation , 2003 .

[18]  Shireen Elhabian,et al.  Moving Object Detection in Spatial Domain using Background Removal Techniques - State-of-Art , 2008 .

[19]  Gian Luca Foresti,et al.  Real-time thresholding with Euler numbers , 2003, Pattern Recognit. Lett..

[20]  J.-C. Huang,et al.  Double-change-detection method for wavelet-based moving-object segmentation , 2004 .

[21]  Yang Gaobo,et al.  Objective performance evaluation of video segmentation algorithms with ground-truth , 2004 .

[22]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Changsheng Xie,et al.  Double change detection method for moving-object segmentation based on clustering , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[24]  Reecha Sharma,et al.  The Performance Of Fractal Image Compression On Different Imaging Modalities Using Objective Quality Measures , 2014 .

[25]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[27]  Aryaz Baradarani Moving object segmentation using the 9/7–10/8 dual-tree complex filter bank , 2008, 2008 19th International Conference on Pattern Recognition.

[28]  Manish Khare,et al.  Moving object segmentation in Daubechies complex wavelet domain , 2015, Signal Image Video Process..

[29]  Moongu Jeon,et al.  Multilevel adaptive thresholding and shrinkage technique for denoising using Daubechies complex wavelet transform , 2010 .

[30]  A. K. S. Kushwaha,et al.  Automatic multiple human detection and tracking for visual surveillance system , 2012, 2012 International Conference on Informatics, Electronics & Vision (ICIEV).

[31]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[32]  Chandrika Kamath,et al.  Robust techniques for background subtraction in urban traffic video , 2004, IS&T/SPIE Electronic Imaging.

[33]  Aryaz Baradarani,et al.  Wavelet-based Moving Object Segmentation: From Scalar Wavelets to Dual-tree Complex Filter Banks , 2010 .

[34]  Tae-Hyung Kim,et al.  Wavelet-based moving object segmentation using background registration technique , 2007, SIP.

[35]  Vittorio Murino,et al.  Background Subtraction for Automated Multisensor Surveillance: A Comprehensive Review , 2010, EURASIP J. Adv. Signal Process..

[36]  Manish Khare,et al.  Dual tree complex wavelet transform based shadow detection and removal from moving objects , 2014, Electronic Imaging.

[37]  Bülent Sankur,et al.  Statistical evaluation of image quality measures , 2002, J. Electronic Imaging.

[38]  Chih-Hsien Hsia,et al.  Efficient modified directional lifting-based discrete wavelet transform for moving object detection , 2014, Signal Process..