Depth estimation algorithm for light field data by epipolar image analysis and region interpolation.

In this paper, we propose an optimized algorithm to estimate the depth information in the 4D light field data. Our scheme has the advantage of conciseness compared to the traditional epipolar-plane image analysis method. First, we have analyzed the depth resolution properties of light field data not mentioned by the previous researchers. In the depth estimation process, epipolar analysis is confined in a small range to reduce the running time, combining with a regression test to reduce estimation error. Occlusion condition is especially dealt with by recognizing object margin. To test the accuracy of our algorithm, we use a benchmark dataset to evaluate the output depth result. We get a competitive result in the estimation error evaluation and prevailing runtime result compared to that of baseline algorithms. Owing to the high performance, this algorithm can be used in real-time depth recognition with the aid of parallel computing.

[1]  Qian Huang,et al.  Light-Field Depth Estimation via Epipolar Plane Image Analysis and Locally Linear Embedding , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Jesse Berent.  Plenoptic Manifolds : Exploiting Structure and Coherence in Multiview Images , 2007 .

[3]  J. P. Luke,et al.  Depth From Light Fields Analyzing 4D Local Structure , 2015, Journal of Display Technology.

[4]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[5]  Takeo Kanade,et al.  When Is the Shape of a Scene Unique Given Its Light-Field: A Fundamental Theorem of 3D Vision? , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Alan L. Yuille,et al.  Occlusions and binocular stereo , 1992, International Journal of Computer Vision.

[7]  Ramesh Raskar,et al.  Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing , 2007, SIGGRAPH 2007.

[8]  Andrew Lumsdaine,et al.  Focused plenoptic camera and rendering , 2010, J. Electronic Imaging.

[9]  Lei Yan,et al.  Close-range photogrammetry with light field camera: from disparity map to absolute distance. , 2016, Applied optics.

[10]  Ren Ng.  Fourier slice photography , 2005, ACM Trans. Graph..

[11]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[13]  Peter N. Belhumeur,et al.  A Bayesian approach to binocular steropsis , 1996, International Journal of Computer Vision.

[14]  Tom E. Bishop,et al.  The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Byoungho Lee,et al.  Depth extraction by use of a rectangular lens array and one-dimensional elemental image modification. , 2004, Applied optics.