Removing Shadows from Images

Illumination conditions cause problems for many computer vision algorithms. In particular, shadows in an image can cause segmentation, tracking, or recognition algorithms to fail. In this paper we propose a method to process a 3-band colour image to locate, and subsequently remove shadows. The result is a 3-band colour image which contains all the original salient information in the image, except that the shadows are gone.We use the method set out in [1] to derive a 1-d illumination invariant shadow-free image. We then use this invariant image together with the original image to locate shadow edges. By setting these shadow edges to zero in an edge representation of the original image, and by subsequently re-integrating this edge representation by a method paralleling lightness recovery, we are able to arrive at our sought after full colour, shadow free image. Preliminary results reported in the paper show that the method is effective.A caveat for the application of the method is that we must have a calibrated camera. We show in this paper that a good calibration can be achieved simply by recording a sequence of images of a fixed outdoor scene over the course of a day. After calibration, only a single image is required for shadow removal. It is shown that the resulting calibration is close to that achievable using measurements of the camera's sensitivity functions.

[1]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[2]  Cheng Lu,et al.  Intrinsic Images by Entropy Minimization , 2004, ECCV.

[3]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[4]  Andrew Blake,et al.  Boundary conditions for lightness computation in Mondrian World , 1985, Comput. Vis. Graph. Image Process..

[5]  Tim J. Ellis,et al.  ShadowFlash: an approach for shadow removal in an active illumination environment , 2002, BMVC.

[6]  John K. Tsotsos,et al.  Ambient illumination and the determination of material changes. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[7]  G D Finlayson,et al.  Color constancy at a pixel. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[8]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[9]  John J. McCann,et al.  Lessons Learned from Mondrians Applied to Real Images and Color Gamuts , 1999, CIC.

[10]  E. Oja,et al.  Independent Component Analysis , 2013 .

[11]  Brian V. Funt,et al.  Color Constant Color Indexing , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Shaogang Gong,et al.  Colour Model Selection and Adaption in Dynamic Scenes , 1998, ECCV.

[13]  H. Barrow,et al.  RECOVERING INTRINSIC SCENE CHARACTERISTICS FROM IMAGES , 1978 .

[14]  Paul M. Hubel,et al.  The Perception of Color at Dawn and Dusk , 2000, CIC.

[15]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Mark S. Drew,et al.  4-sensor camera calibration for image representation invariant to shading, shadows, lighting, and specularities , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[17]  Theo Gevers,et al.  Classifying color transitions into shadow-geometry, illumination, highlight or material edges , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[18]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  David L. Waltz,et al.  Understanding Line drawings of Scenes with Shadows , 1975 .

[20]  Jie Wei,et al.  Illumination-invariant image retrieval and video segmentation , 1999, Pattern Recognit..

[21]  G D Finlayson,et al.  Spectral sharpening: sensor transformations for improved color constancy. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.