Removing achromatic reflections from color images with application to artwork imaging

We propose a general approach to remove reflections from a color image acquired through a semi-transparent medium, and show its application to the restoration of images of paintings framed behind glass and manuscripts laminated for conservation purposes, affected by the reflection of a light source. The problem is modeled by assuming that the unwanted reflection is an achromatic or monochromatic image that combines additively with the real transmitted image of the object of interest. In the absence of information about the mixing coefficients, we adopted a blind source separation technique that exploits the dependence of the three color channels of the original image, and the independence of the reflected image. In particular, these constraints are forced on the image gradients rather than on the intensity images. The algorithm is constituted of a step for the estimation, via independent component analysis of the model parameters, followed by a regularization technique to estimate the component images. The algorithm is very fast and provides promising results.

[1]  Xiaokang Yang,et al.  Separating Reflections from a Single Image Using Spatial Smoothness and Structure Information , 2010, LVA/ICA.

[2]  Yoav Y. Schechner,et al.  Polarization-based decorrelation of transparent layers: The inclination angle of an invisible surface , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Bülent Sankur,et al.  Image Source Separation Using Color Channel Dependencies , 2009, ICA.

[4]  Changshui Zhang,et al.  Blind separation of superimposed images with unknown motions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Lawrence B. Wolff,et al.  Portable imaging polarimeters , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[6]  Anat Levin,et al.  User Assisted Separation of Reflections from a Single Image Using a Sparsity Prior , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Arie Yeredor,et al.  Blind Separation of Reflections With Relative Spatial Shifts , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[8]  D. Malacara-Hernández,et al.  PRINCIPLES OF OPTICS , 2011 .

[9]  Assaf Zomet,et al.  Separating reflections from a single image using local features , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Shree K. Nayar,et al.  Separation of Reflection Components Using Color and Polarization , 1997, International Journal of Computer Vision.

[11]  Yehoshua Y. Zeevi,et al.  Sparse ICA for blind separation of transmitted and reflected images , 2005, Int. J. Imaging Syst. Technol..

[12]  Michal Irani,et al.  Separating Transparent Layers through Layer Information Exchange , 2004, ECCV.

[13]  Changshui Zhang,et al.  Blind separation of superimposed images with unknown motions , 2009, CVPR.

[14]  Changshui Zhang,et al.  Blindly separating mixtures of multiple layers with spatial shifts , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  T. Aida,et al.  Electrically-Controllable Liquid Crystal Polarizing Filter for Eliminating Reflected Light , 1998 .

[16]  Edward H. Adelson,et al.  Separating reflections and lighting using independent components analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  J Shamir,et al.  Polarization and statistical analysis of scenes containing a semireflector. , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.