Variational Retinex Algorithm with its Application to a High - Quality Chroma Key

The Retinex theory deals with separation of irradiance and reflectance from an image. Recently, Kimmel and others proposed a variational framework that unifies the previous Poisson-equation-type Retinex algorithms developed by Horn and others, and presented a separation algorithm with the time-evolution of a linear diffusion process. However, this separation algorithm cannot achieve physically rational separation, if true irradiance varies among color channels. To cope with this problem, we introduce a nonlinear diffusion process into the time-evolution. Moreover, we introduce an approach to treat all color channels collectively. Furthermore, we apply our separation algorithm to a high quality chroma key where a color of each pixel in the foreground frame are adaptively corrected through transformation of the separated irradiance.

[1]  Jr. Thomas G. Stockham,et al.  Image processing in the context of a visual model , 1972 .

[2]  Zia-ur Rahman,et al.  Properties and performance of a center/surround retinex , 1997, IEEE Trans. Image Process..

[3]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[4]  E. Land,et al.  Lightness and retinex theory. , 1971, Journal of the Optical Society of America.

[5]  John J. McCann,et al.  Lessons Learned from Mondrians Applied to Real Images and Color Gamuts , 1999, CIC.

[6]  Mark S. Drew,et al.  Recovering Shading from Color Images , 1992, ECCV.

[7]  Michael Elad,et al.  A Variational Framework for Retinex , 2002, IS&T/SPIE Electronic Imaging.

[8]  K. Hohn,et al.  Determining Lightness from an Image , 2004 .

[9]  Demetri Terzopoulos,et al.  Image Analysis Using Multigrid Relaxation Methods , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  A. Ben Hamza,et al.  Unifying probabilistic and variational estimation , 2002, IEEE Signal Process. Mag..

[12]  John J. McCann,et al.  Retinex in Matlab , 2000, CIC.

[13]  O. Faugeras.  Digital color image processing within the framework of a human visual model , 1979 .

[14]  Rachid Deriche,et al.  Diffusion PDEs on vector-valued images , 2002, IEEE Signal Process. Mag..

[15]  E H Land,et al.  Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.