Light field planar homography and its application

Light field planar homography is essential for light field camera calibration and light field raw data rectification. However, most previous researches assume light field camera as pinhole camera array and deduce the planar homography matrix of sub-aperture image, which is analogous to traditional method. In this paper, we regard light field as a whole and present a novel light field planar homography matrix based on multi-projection-center (MPC) model. The projections of point, line and conic are exploited based on light field planar homography. In addition, a camera calibration method and a homography estimation are proposed to verify the light field planar homography. Experimental results on light field datasets have verified the performance of the proposed methods.

[1]  In So Kweon,et al.  Geometric Calibration of Micro-Lens-Based Light-Field Cameras Using Line Features , 2014, ECCV.

[2]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[3]  Ren Ng.  Fourier Slice Photography , 2005 .

[4]  Hui Zhang,et al.  The common self-polar triangle of concentric circles and its application to camera calibration , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Kaj Madsen,et al.  Methods for Non-Linear Least Squares Problems (2nd ed.) , 2004 .

[6]  Qing Wang,et al.  Common Self-polar Triangle of Concentric Conics for Light Field Camera Calibration , 2018, ACCV.

[7]  Qi Zhang,et al.  Extending the FOV from disparity and color consistencies in multiview light fields , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[8]  Yiu-Ming Cheung,et al.  Homography Estimation from the Common Self-Polar Triangle of Separate Ellipses , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[10]  Clemens Birklbauer,et al.  Panorama light-field imaging , 2012, SIGGRAPH '12.

[11]  Qi Zhang,et al.  Ray-Space Projection Model for Light Field Camera , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Bastian Goldlücke,et al.  On Linear Structure from Motion for Light Field Cameras , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[13]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Zhan Yu,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Enhancing Light Fields through Ray-space Stitching , 2022 .

[15]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Richard I. Hartley,et al.  Self-Calibration of Stationary Cameras , 1997, International Journal of Computer Vision.

[17]  Qing Wang,et al.  A Generic Multi-Projection-Center Model and Calibration Method for Light Field Cameras , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Manolis I. A. Lourakis,et al.  Large-Scale, Metric Structure From Motion for Unordered Light Fields , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Wei Yang,et al.  Ray Space Features for Plenoptic Structure-from-Motion , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).