A Compact Light Field Camera for Real-Time Depth Estimation

Depth cameras are utilized in many applications. Recently light field approaches are increasingly being used for depth computation. While these approaches demonstrate the technical feasibility, they can not be brought into real-world application, since they have both a high computation time as well as a large design. Exactly these two drawbacks are overcome in this paper. For the first time, we present a depth camera based on the light field principle, which provides real-time depth information as well as a compact design.

[1]  Yael Pritch,et al.  Scene reconstruction from high spatio-angular resolution light fields , 2013, ACM Trans. Graph..

[2]  Sven Wanner,et al.  Globally consistent depth labeling of 4D light fields , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Didier Stricker,et al.  FlowFields++: Accurate Optical Flow Correspondences Meet Robust Interpolation , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[4]  Marc Levoy,et al.  High performance imaging using large camera arrays , 2005, SIGGRAPH 2005.

[5]  Neus Sabater,et al.  Dataset and Pipeline for Multi-view Light-Field Video , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Chao Li,et al.  Robust depth estimation for light field via spinning parallelogram operator , 2016, Comput. Vis. Image Underst..

[7]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[8]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[10]  H. Hirschmüller.  Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[11]  Didier Stricker,et al.  Augmented Reality 3D Discrepancy Check in Industrial Applications , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[12]  Qionghai Dai,et al.  GPU-based depth estimation for light field images , 2017, 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[13]  Didier Stricker,et al.  Fast and Efficient Depth Map Estimation from Light Fields , 2017, 2017 International Conference on 3D Vision (3DV).

[14]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[15]  In-So Kweon,et al.  EPINET: A Fully-Convolutional Neural Network Using Epipolar Geometry for Depth from Light Field Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Didier Stricker,et al.  Time-of-flight sensor depth enhancement for automotive exhaust gas , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[17]  Dong Liu,et al.  Unsupervised Depth Estimation from Light Field Using a Convolutional Neural Network , 2018, 2018 International Conference on 3D Vision (3DV).