Improved moving object segmentation by multiresolution and variable thresholding

Segmentation of moving objects in image sequences by change detection has been a very important topic in multimedia and surveillance applications. One popular approach is to model the background of the scene and then threshold the differences between the background and the input images to detect the change caused by the moving object. Although this idea is simple and effective, the selection of a proper threshold value faces a trade-off between false alarms and misdetection. In this paper, a new method of thresholding for moving object segmentation in scenes without dynamic background and rapid variation of illumination is proposed to avoid misdetection while reducing false alarms. This new approach adopts the concept of thresholding-with-hysteresis , which utilizes a multiresolution and variable thresholding (MRVT) scheme to achieve improvements on the segmentation performance. Combined with a module of shadow removal, MRVT can generate accurate moving object masks. Segmentation results are evaluated qualitatively and quantitatively for indoor scenes, and the effectiveness of MRVT is encouraging. Compared with two other state-of-the-art approaches, our proposed method can achieve more accurate object boundary, fewer false alarms, and reduced fragmentation of objects.

[1]  Mohan M. Trivedi,et al.  Detecting Moving Shadows: Algorithms and Evaluation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Liang-Gee Chen,et al.  Fast video segmentation algorithm with shadow cancellation, global motion compensation, and adaptive threshold techniques , 2004, IEEE Transactions on Multimedia.

[3]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Jenq-Neng Hwang,et al.  Object-based video abstraction for video surveillance systems , 2002, IEEE Trans. Circuits Syst. Video Technol..

[5]  Katsushi Ikeuchi,et al.  Illumination normalization with time-dependent intrinsic images for video surveillance , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Takeo Kanade,et al.  Introduction to the Special Section on Video Surveillance , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Kentaro Toyama,et al.  Wallflower: principles and practice of background maintenance , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Quming Zhou,et al.  Tracking and Classifying Moving Objects from Video , 2001 .

[10]  T. Ebrahimi,et al.  Change detection and background extraction by linear algebra , 2001, Proc. IEEE.

[11]  Kazuhiko Sumi,et al.  A robust background subtraction method for changing background , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[12]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[13]  Jörn Ostermann,et al.  Detection of Moving Cast Shadows for Object Segmentation , 1999, IEEE Trans. Multim..

[14]  K. P. Karmann,et al.  Moving object recognition using an adaptive background memory , 1990 .

[15]  Alessandro Neri,et al.  Automatic moving object and background separation , 1998, Signal Process..

[16]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Touradj Ebrahimi,et al.  Video object extraction based on adaptive background and statistical change detection , 2000, IS&T/SPIE Electronic Imaging.

[19]  Til Aach,et al.  Illumination-invariant change detection , 2000, 4th IEEE Southwest Symposium on Image Analysis and Interpretation.

[20]  Wesley E. Snyder,et al.  Optimal thresholding - A new approach , 1990, Pattern Recognit. Lett..

[21]  Til Aach,et al.  Statistical model-based change detection in moving video , 1993, Signal Process..

[22]  Touradj Ebrahimi,et al.  Detecting shadows in image sequences , 2004 .

[23]  Robert THOMA,et al.  Motion compensating interpolation considering covered and uncovered background , 1989, Signal Process. Image Commun..

[24]  Neil Burgess,et al.  Automatic thresholding for change detection in digital video , 2000, Visual Communications and Image Processing.