Joint Segmentation of Moving Object and Estimation of Background in Low-Light Video using Relaxation

When the scene background is known and the intensity of moving objects contrasts with the intensity of the background, the objects are easily captured by exploiting occlusion, e.g., background-subtraction. However, when processing general scenes, the background is not known and researchers have mostly attempted to segment moving objects by using motion cues rather than occlusion. Since motion can only be accurately computed at highly textured regions, current motion segmentation methods either fail to segment low textured objects, or require expensive regularization techniques. We present a computationally simple algorithm and test it with segmentation of moving objects in low texture / low contrast videos that are obtained in low-light scenes. The images in the sequence are modeled taking into account the rigidity of the moving object and the occlusion of the background. We formulate the problem as the minimization of a penalized likelihood cost. Relaxation of the weight of the penalty term leads to a simple solution to the nonlinear minimization. We describe experiments that illustrate the good performance of our method.

[1]  Brendan J. Frey,et al.  Learning flexible sprites in video layers , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Michal Irani,et al.  Computing occluding and transparent motions , 1994, International Journal of Computer Vision.

[3]  Baoxin Li,et al.  Adaptive video background replacement , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[4]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[5]  José M. F. Moura,et al.  Detecting and solving template ambiguities in motion segmentation , 1997, Proceedings of International Conference on Image Processing.

[6]  José M. F. Moura,et al.  Ieee Transactions on Image Processing 1 Figure–ground Segmentation from Occlusion Ieee Transactions on Image Processing , 2004 .

[7]  José M. F. Moura,et al.  Content-based Image Sequence Representation ? , 2004 .

[8]  L. Ambrosio,et al.  Approximation of functional depending on jumps by elliptic functional via t-convergence , 1990 .

[9]  Ming-Ting Sun,et al.  A robust video object segmentation scheme with prestored background information , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).