Reliable Planar Object Pose Estimation in Light Fields From Best Subaperture Camera Pairs

A light-field camera can obtain richer information about a scene than a usual camera. This property offers a lot of potential for robot vision. In this letter, we present a method for pose estimation of a planar object with a light-field camera. The light-field camera can be regarded as a set of subaperture cameras. Although any combination of them can theoretically be used for the pose estimation, the accuracy depends on the combination. We show that the estimated pose error can be reduced by selecting the best pair of subaperture cameras. We have evaluated the accuracy of our approach with real experiments using a light-field camera in front of planar targets held by an industrial manipulator for ground truth comparison.

[1]  Ryad Benosman,et al.  Plenoptic cameras in real-time robotics , 2013, Int. J. Robotics Res..

[2]  Éric Marchand,et al.  Pose Estimation for Augmented Reality: A Hands-On Survey , 2016, IEEE Transactions on Visualization and Computer Graphics.

[3]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  José António Gaspar,et al.  Depth range accuracy for plenoptic cameras , 2018, Comput. Vis. Image Underst..

[5]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision: Scene planes and homographies , 2004 .

[6]  Seth Hutchinson,et al.  Visual Servo Control Part I: Basic Approaches , 2006 .

[7]  Bastian Goldlücke,et al.  On Linear Structure from Motion for Light Field Cameras , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[9]  Volker Willert,et al.  Robustness of control point configurations for homography and planar pose estimation , 2018, ArXiv.

[10]  Vladan Velisavljevic,et al.  Baseline and Triangulation Geometry in a Standard Plenoptic Camera , 2017, International Journal of Computer Vision.

[11]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Peter I. Corke,et al.  Image-Based Visual Servoing With Light Field Cameras , 2017, IEEE Robotics and Automation Letters.

[13]  In-So Kweon,et al.  Accurate depth map estimation from a lenslet light field camera , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Wei Yang,et al.  Ray Space Features for Plenoptic Structure-from-Motion , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[15]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[16]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[17]  Mark A. Horowitz,et al.  Light field video camera , 2000, IS&T/SPIE Electronic Imaging.

[18]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..