Reduction of Aliasing Artifacts by Sign Function Approximation in Light Field Depth Estimation Based on Foreground–Background Separation

A sign function approximation method for depth from light field (DFLF) based on the foreground–background separation (FBS) is proposed. From a signal processing viewpoint, the FBS-based method can be considered as a bridge between the cost-based DFLF methods and depth model-based ones. The proposed sign function approximation corresponds to the winner-takes-all (WTA) approaches as the cost-based methods do. Experimental results on the synthetic images show that the proposed method reasonably performs in terms of the mean squared error as the state-of-the-art methods do. Especially, by using a suitable WTA method in the framework of our previous FBS-based DFLF work, the proposed method effectively reduces the angular aliasing artifacts in the resulting disparity maps of both the synthetic and real images.

[1]  Qing Wang,et al.  Occlusion-Model Guided Antiocclusion Depth Estimation in Light Field , 2016, IEEE Journal of Selected Topics in Signal Processing.

[2]  Wei Yu,et al.  Neural EPI-Volume Networks for Shape from Light Field , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Sven Wanner,et al.  Globally consistent depth labeling of 4D light fields , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  In-So Kweon,et al.  Light-Field Image Super-Resolution Using Convolutional Neural Network , 2017, IEEE Signal Processing Letters.

[5]  Bastian Goldlücke,et al.  Accurate Depth and Normal Maps from Occlusion-Aware Focal Stack Symmetry , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Haibin Ling,et al.  Saliency Detection on Light Field , 2014, CVPR.

[7]  Chao Li,et al.  Robust depth estimation for light field via spinning parallelogram operator , 2016, Comput. Vis. Image Underst..

[8]  Alexei A. Efros,et al.  Depth Estimation with Occlusion Modeling Using Light-Field Cameras , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jae Young Lee,et al.  Depth Estimation From Light Field by Accumulating Binary Maps Based on Foreground–Background Separation , 2017, IEEE Journal of Selected Topics in Signal Processing.

[10]  Bastian Goldlücke,et al.  A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields , 2016, ACCV.

[11]  In-So Kweon,et al.  A Taxonomy and Evaluation of Dense Light Field Depth Estimation Algorithms , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Tom E. Bishop,et al.  The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Bernd Jähne,et al.  Trust your Model: Light Field Depth Estimation with Inline Occlusion Handling , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Leonard T. Bruton,et al.  Gradient-based depth estimation from 4D light fields , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[15]  Williem,et al.  Robust Light Field Depth Estimation for Noisy Scene with Occlusion , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Chao-Tsung Huang.  Robust Pseudo Random Fields for Light-Field Stereo Matching , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[17]  Haibin Ling,et al.  Saliency Detection on Light Field , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Henrik I. Christensen,et al.  RGB-D object pose estimation in unstructured environments , 2016, Robotics Auton. Syst..

[19]  Abhilash Sunder Raj.  Light-Field Database Creation and Depth Estimation , 2016 .

[20]  Qionghai Dai,et al.  Light Field Image Processing: An Overview , 2017, IEEE Journal of Selected Topics in Signal Processing.

[21]  Yu-Wing Tai,et al.  Automatic Trimap Generation and Consistent Matting for Light-Field Images. , 2017, IEEE transactions on pattern analysis and machine intelligence.

[22]  Jae Young Lee,et al.  Separation of foreground and background from light field using gradient information. , 2017, Applied optics.

[23]  In-So Kweon,et al.  EPINET: A Fully-Convolutional Neural Network Using Epipolar Geometry for Depth from Light Field Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Jiandong Tian,et al.  RGBD Salient Object Detection via Deep Fusion , 2016, IEEE Transactions on Image Processing.

[25]  D. Yang,et al.  Occlusion-aware depth estimation for light field using multi-orientation EPIs , 2018, Pattern Recognit..

[26]  Ivan Laptev,et al.  Pose Estimation and Segmentation of Multiple People in Stereoscopic Movies , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Can Chen,et al.  Depth Recovery from Light Field Using Focal Stack Symmetry , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  In-So Kweon,et al.  Accurate depth map estimation from a lenslet light field camera , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Dieter Fox,et al.  Object recognition with hierarchical kernel descriptors , 2011, CVPR 2011.

[30]  Edward H. Adelson,et al.  Single Lens Stereo with a Plenoptic Camera , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Lipeng Si,et al.  Dense Depth-Map Estimation and Geometry Inference from Light Fields via Global Optimization , 2016, ACCV.