Depth-based refocusing for reducing directional aliasing artifacts.

We investigate a depth-based refocusing method using four-dimensional (4D) light field data, which can reduce directional aliasing artifacts in a refocused image. Unlike conventional filtering-based methods, the proposed method estimates the amount of aliasing artifacts using the disparity information between two neighboring views. It then applies an exact smoothing operation to the refocused image in order to remove the aliasing artifacts. By doing that, the proposed method is able to generate a smoothly blurred image in the out-of-focus region and a sharp image in the focused region. In addition, as the proposed method performs a smoothing operation on the refocused image, it does not create virtual views, which often requires an extremely large amount of computational resources. In both simulation and experiment, the proposed method shows outstanding performance compared to conventional methods.

[1]  Tom E. Bishop,et al.  The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[4]  Keita Takahashi,et al.  Theoretical Analysis of View Interpolation With Inaccurate Depth Information , 2012, IEEE Transactions on Image Processing.

[5]  Karl-Heinz Brenner,et al.  Scalar wave-optical reconstruction of plenoptic camera images. , 2014, Applied optics.

[6]  Aaron S. Andalman,et al.  Enhancing the performance of the light field microscope using wavefront coding. , 2014, Optics express.

[7]  Aaron S. Andalman,et al.  Wave optics theory and 3-D deconvolution for the light field microscope. , 2013, Optics express.

[8]  Edmund Y Lam,et al.  Computational photography with plenoptic camera and light field capture: tutorial. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Kathrin Berkner,et al.  Image formation analysis and high resolution image reconstruction for plenoptic imaging systems. , 2013, Applied optics.

[10]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.