Identifying Color in Motion in Video Sensors

Identifying or matching the surface color of a moving object in surveillance video is critical for achieving reliable object-tracking and searching. Traditional color models provide little help, since the surface of an object is usually not flat, the object’s motion can alter the surface’s orientation, and the lighting conditions can vary when the object moves. To tackle this research problem, we conduct extensive data mining on video clips collected under various lighting conditions and distances from several video-cameras. We observe how each of the eleven culture colors can drift in the color space when an object’s surface is in motion. In the color space, we then learn the drift pattern of each culture color for classifying unseen surface colors. Finally, we devise a distance function taking color drift into consideration to perform color identification and matching. Empirical studies show our approach to be very promising: achieving over 95% color-prediction accuracy.

[1]  D H Brainard,et al.  Analysis of the retinex theory of color vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[2]  Brian V. Funt,et al.  Color Constant Color Indexing , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Rainer Mausfeld,et al.  Colour PerceptionMind and the physical world , 2003 .

[4]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[5]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[6]  Brian V. Funt,et al.  A comparison of computational color constancy Algorithms. II. Experiments with image data , 2002, IEEE Trans. Image Process..

[7]  Kobus Barnard.  Modeling Scene Illumination Colour for Computer Vision and Image Reproduction: A survey of computational approaches , 1998 .

[8]  Brian V. Funt,et al.  A Comparison of Computational Colour Constancy Algorithms. Part Two: Experiments on Image Data , 2002 .

[9]  Gudrun Klinker,et al.  A physical approach to color image understanding , 1989, International Journal of Computer Vision.

[10]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[11]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[12]  Glenn Healey,et al.  Use of invariants for recognition of three-dimensional color textures , 1994 .

[13]  Takeo Kanade,et al.  Surface Reflection: Physical and Geometrical Perspectives , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Fatih Murat Porikli,et al.  Inter-camera color calibration by correlation model function , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[15]  E. Land.  Recent advances in retinex theory , 1986, Vision Research.

[16]  G. Healey,et al.  Using physics-based invariant representations for the recognition of regions in multispectral satellite images , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Glenn Healey,et al.  Using a spectral reflectance model for the illumination-invariant recognition of local image structure , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Graham D. Finlayson,et al.  A theory of selection for gamut mapping colour constancy , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[19]  G D Finlayson,et al.  Spectral sharpening: sensor transformations for improved color constancy. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  T. Kanade,et al.  USING A COLOR REFLECTION MODEL TO SEPARATE HIGHLIGHTS FROM OBJECT COLOR , 1987 .

[21]  Steven K. Feiner,et al.  Computer graphics: principles and practice (2nd ed.) , 1990 .

[22]  B A Wandell,et al.  Linear models of surface and illuminant spectra. , 1992, Journal of the Optical Society of America. A, Optics and image science.

[23]  M. Lévesque.  Perception , 1986, The Yale Journal of Biology and Medicine.

[24]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[25]  Brian V. Funt,et al.  A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data , 2002, IEEE Trans. Image Process..

[26]  Fatih Porikli.  INTER-CAMERA COLOR CALIBRATION USING CROSS-CORRELATION MODEL FUNCTION , 2003 .

[27]  M D'Zmura,et al.  Mechanisms of color constancy. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[28]  Yuichi Ohta,et al.  An approach to color constancy using multiple images , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[29]  E. R. Dixon.  Spectral distribution of Australian daylight , 1978 .

[30]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[31]  Nikos Karampatziakis,et al.  Probabilistic Outputs for SVMs and Comparisons to Regularized Likelihood Methods , 2007 .

[32]  Mubarak Shah,et al.  Appearance modeling for tracking in multiple non-overlapping cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[33]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.