Automatic removal of foreground occluder from multi-focus images

View occluders influence the image quality of a subject when occluders exist between a camera and a subject. For example, a blurred fence image interrupts a subject when an image of a scene is captured by a camera through a fence. In this paper, we propose an automatic removal method of foreground occluders from images using multiple focusing. Our method automatically detects foreground occluder regions by using two images with and without flashlight. The influence of foreground occluders is estimated and overlapping effects of foreground occluders are removed by using multiple focus images. Experimental results show the effectiveness of the proposed method.

[1]  Shree K. Nayar,et al.  Removing image artifacts due to dirty camera lenses and thin occluders , 2009, ACM Trans. Graph..

[2]  Yanxi Liu,et al.  Deformed Lattice Detection in Real-World Images Using Mean-Shift Belief Propagation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jean-Michel Morel,et al.  Level lines based disocclusion , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[4]  Naoki Asada,et al.  Seeing Behind the Scene: Analysis of Photometric Properties of Occluding Edges by the Reversed Projection Blurring Model , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Takashi Matsuyama,et al.  Depth measurement by the multi-focus camera , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[6]  Yanxi Liu,et al.  Image de-fencing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Kaleem Siddiqi,et al.  Removing Partial Occlusion from Blurred Thin Occluders , 2010, 2010 20th International Conference on Pattern Recognition.

[8]  Yanxi Liu,et al.  Image De-fencing Revisited , 2010, ACCV.

[9]  Atsushi Yamashita,et al.  Removal of adherent waterdrops from images acquired with stereo camera , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Journal of the Optical Society of America , 1950, Nature.

[11]  Marc Levoy,et al.  Reconstructing Occluded Surfaces Using Synthetic Apertures: Stereo, Focus and Robust Measures , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Harry Shum,et al.  Full-frame video stabilization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Atsushi Yamashita,et al.  Fence Removal from Multi-focus Images , 2010, 2010 20th International Conference on Pattern Recognition.

[15]  Eli Shechtman,et al.  Space-Time Completion of Video , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Atsushi Yamashita,et al.  Removal of adherent noises from images of dynamic scenes by using a pan-tilt camera , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[17]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[18]  Atsushi Yamashita,et al.  A virtual wiper-restoration of deteriorated images by using a pan-tilt camera , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[19]  Masaaki Yoneda,et al.  Real-time snowfall noise elimination , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[20]  Olivier Buisson,et al.  Detection and removal of line scratches in motion picture films , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[21]  Stefano Soatto,et al.  Seeing beyond occlusions (and other marvels of a finite lens aperture) , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[22]  Shree K. Nayar,et al.  Detection and removal of rain from videos , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[23]  Steven A. Shafer,et al.  What is the center of the image? , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Anil C. Kokaram,et al.  Interpolation of missing data in image sequences , 1995, IEEE Trans. Image Process..

[25]  Xiaochun Cao,et al.  Video Completion for Perspective Camera Under Constrained Motion , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[26]  Atsushi Yamashita,et al.  Noises removal from image sequences acquired with moving camera by estimating camera motion from spatio-temporal information , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Hiroshi Suzuki,et al.  String-Like Occluding Region Extraction for Background Restoration , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[28]  Atsushi Yamashita,et al.  A virtual wiper - restoration of deteriorated images by using multiple cameras , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[29]  Atsushi Yamashita,et al.  Removal of adherent noises from image sequences by spatio-temporal image processing , 2008, 2008 IEEE International Conference on Robotics and Automation.