Fusion of Texture Variation and On-Line Color Sampling for Moving Object Detection Under Varying Chromatic Illumination

In this paper, a novel approach to non-rigid moving object detection under varying chromatic illumination is proposed. Different from most algorithms that utilize color information, the assumption of smooth or global change of illumination is no longer needed. Our method is based on the observation that the color appearance of objects may alter as the change of light intensity and color, but their texture structures remain almost the same. Therefore, texture based invariant characteristic to varying illumination is extracted and modeled, which can be used to guide for obtaining color appearance model at each frame. By this philosophy, firstly texture variation, which is not sensitive to illumination, is extracted by comparing the current image with background image. Secondly, the instantaneous color model is created by a special sampling algorithm according to the texture variation and previous consecutive detection results. By fusing texture variation and on-line color sampling, an energy function is founded and minimized to obtain the target contour. Experiments show that this approach has a great capability in detecting non-rigid objects under global or local varying illumination even when the hue and saturation of the lighting change abruptly or locally.

[1]  Janne Heikkilä,et al.  Intensity independent color models and visual tracking , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  Marco La Cascia,et al.  Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Roman Goldenberg,et al.  Fast Geodesic Active Contours , 1999, Scale-Space.

[5]  Azriel Rosenfeld,et al.  Detection and location of people in video images using adaptive fusion of color and edge information , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[6]  Katsushi Ikeuchi,et al.  Illumination normalization with time-dependent intrinsic images for video surveillance , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  Bum-Jae You,et al.  A real-time color-based object tracking robust to irregular illumination variations , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[8]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[9]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[10]  Carlo Tomasi,et al.  Alpha estimation in natural images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Mubarak Shah,et al.  Object based segmentation of video using color, motion and spatial information , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Francesc Moreno-Noguer,et al.  Fusion of a Multiple Hypotheses Color Model and Deformable Contours for Figure Ground Segmentation in Dynamic Environments , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[14]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..