Automated separation of reflections from a single image based on edge classification

Looking through a window, the object behind the window is often disturbed by a reflection of another object. In the paper, we present a new method for separating reflections from a single image. Most existing techniques require the programmer to create an image database or require the user to manually provide the position and layer information of feature points in the input image, and thus suffer from being extremely laborious. Our method is realized by classifying edges in the input image based on the belonging layer and formalizing the problem of decomposing the single image into two layer images as an optimization problem easier to solve based on this classification, and then solving this optimization with a pyramid structure and deterministic annealing. As a result, we are able to accomplish almost fully automated separation of reflections from a single image.

[1]  Naonori Ueda,et al.  Deterministic annealing EM algorithm , 1998, Neural Networks.

[2]  Y. Weiss,et al.  Separating reflections from a single image using local features , 2004, CVPR 2004.

[3]  Yoav Y. Schechner,et al.  Blind recovery of transparent and semireflected scenes , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Federico Girosi,et al.  Parallel and Deterministic Algorithms from MRFs: Surface Reconstruction , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Richard Szeliski,et al.  Layer extraction from multiple images containing reflections and transparency , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  H Farid,et al.  Separating reflections from images by use of independent component analysis. , 1999, Journal of the Optical Society of America. A, Optics, image science, and vision.

[7]  K. Urahama,et al.  Direct analog rank filtering , 1995 .

[8]  Assaf Zomet,et al.  Learning to Perceive Transparency from the Statistics of Natural Scenes , 2002, NIPS.

[9]  Anat Levin,et al.  User Assisted Separation of Reflections from a Single Image Using a Sparsity Prior , 2004, ECCV.

[10]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[11]  Richard Szeliski,et al.  Stereo matching with reflections and translucency , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[12]  Michal Irani,et al.  Image sequence enhancement using multiple motions analysis , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Michal Irani,et al.  Separating transparent layers of repetitive dynamic behaviors , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[14]  Michal Irani,et al.  Separating Transparent Layers through Layer Information Exchange , 2004, ECCV.