Removal of Partial Occlusion from Single Images

This paper examines large partial occlusions in an image which occur near depth discontinuities when the foreground object is severely out of focus. We model these partial occlusions using matting, with the alpha value determined by the convolution of the blur kernel with a pinhole projection of the occluder. The main contribution is a method for removing the image contribution of the foreground occluder in regions of partial occlusion, which improves the visibility of the background scene. The method consists of three steps. First, the region of complete occlusion is estimated using a curve evolution method. Second, the alpha value at each pixel in the partly occluded region is estimated. Third, the intensity contribution of the foreground occluder is removed in regions of partial occlusion. Experiments demonstrate the method's ability to remove the effects of partial occlusion in single images with minimal user input.

[1]  Guillermo Sapiro,et al.  Implementing continuous-scale morphology via curve evolution , 1993, Pattern Recognit..

[2]  Benjamin B. Kimia,et al.  On the evolution of curves via a function of curvature , 1992 .

[3]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[4]  Kaleem Siddiqi,et al.  Flux Maximizing Geometric Flows , 2001, ICCV.

[5]  Shree K. Nayar,et al.  Removing image artifacts due to dirty camera lenses and thin occluders , 2009, ACM Trans. Graph..

[6]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  H. Piaggio Differential Geometry of Curves and Surfaces , 1952, Nature.

[8]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Stefano Soatto,et al.  Seeing beyond occlusions (and other marvels of a finite lens aperture) , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Kiriakos N. Kutulakos,et al.  A Layer-Based Restoration Framework for Variable-Aperture Photography , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  James F. Blinn,et al.  Blue screen matting , 1996, SIGGRAPH.

[12]  Erik Reinhard,et al.  Depth-of-field-based alpha-matte extraction , 2005, APGV '05.

[13]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Frédo Durand,et al.  Defocus video matting , 2005, ACM Trans. Graph..

[15]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[16]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Jian Sun,et al.  Poisson matting , 2004, ACM Trans. Graph..

[18]  Subhasis Chaudhuri,et al.  Depth From Defocus: A Real Aperture Imaging Approach , 1999, Springer New York.

[19]  Stephen Lin,et al.  Single-image vignetting correction using radial gradient symmetry , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Naoki Asada,et al.  Seeing Behind the Scene: Analysis of Photometric Properties of Occluding Edges by the Reversed Projection Blurring Model , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Kaleem Siddiqi,et al.  Automated Removal of Partial Occlusion Blur , 2007, ACCV.

[22]  Subhasis Chaudhuri,et al.  Depth From Defocus in Presence of Partial Self Occlusion , 2001, ICCV.

[23]  Yoav Y. Schechner,et al.  Depth from Defocus vs. Stereo: How Different Really Are They? , 2004, International Journal of Computer Vision.

[24]  M. Grayson The heat equation shrinks embedded plane curves to round points , 1987 .