Stepwise calibration of focused plenoptic cameras

A novel method for the calibration of focused plenoptic monocular cameras is proposed.In this way, the camera will deliver metric depth information instead of disparities.We detach the intrinsic camera parameters related to either brightness or depth data.We present novel initialization methods for all parameters.The accuracy is demonstrated on independent ground-truth validation data. Display Omitted Monocular plenoptic cameras are slightly modified, off-the-shelf cameras that have novel capabilities as they allow for truly passive, high-resolution range sensing through a single camera lens. Commercial plenoptic cameras, however, are presently delivering range data in non-metric units, which is a barrier to novel applications e.g. in the realm of robotics. In this work we revisit the calibration of focused plenoptic cameras and bring forward a novel approach that leverages traditional methods for camera calibration in order to deskill the calibration procedure and to increase accuracy. First, we detach the estimation of parameters related to either brightness images or depth data. Second, we present novel initialization methods for the parameters of the thin lens camera model-the only information required for calibration is now the size of the pixel element and the geometry of the calibration plate. The accuracy of the calibration results corroborates our belief that monocular plenoptic imaging is a disruptive technology that is capable of conquering new markets as well as traditional imaging domains.

[1]  Gerd Hirzinger,et al.  On the issue of camera calibration with narrow angular field of view , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[3]  Bastian Goldlücke,et al.  On the Calibration of Focused Plenoptic Cameras , 2013, Time-of-Flight and Depth Imaging.

[4]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[5]  Simon Foster,et al.  Optics , 1981, Arch. Formal Proofs.

[6]  Andrew Lumsdaine,et al.  Spatial analysis of discrete plenoptic sampling , 2011, Electronic Imaging.

[7]  Klaus H. Strobl.  A Flexible Approach to Close-Range 3-D Modeling , 2014 .

[8]  Lennart Wietzke,et al.  Single lens 3D-camera with extended depth-of-field , 2012, Electronic Imaging.

[9]  Gideon P. Stein.  Internal Camera Calibration using Rotation and Geometric Shapes , 1993 .

[10]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[11]  Gerd Hirzinger,et al.  More accurate camera and hand-eye calibrations with unknown grid pattern dimensions , 2008, 2008 IEEE International Conference on Robotics and Automation.

[12]  Gerd Hirzinger,et al.  Optimal Hand-Eye Calibration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Uwe Stilla,et al.  Calibration and accuracy analysis of a focused plenoptic camera , 2014 .

[15]  Gerd Hirzinger,et al.  More accurate pinhole camera calibration with imperfect planar target , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[16]  Jorge A. Sánchez,et al.  PLANE-BASED CAMERA CALIBRATION WITHOUT DIRECT OPTIMIZATION ALGORITHMS , 2006 .

[17]  Andrew Lumsdaine,et al.  The focused plenoptic camera , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[18]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[20]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Kathryn Graziano.  The innovator's dilemma: When new technologies cause great firms to fail , 1998 .

[22]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[23]  Stefan B. Williams,et al.  Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Paul F. Whelan,et al.  Which pattern? Biasing aspects of planar calibration patterns and detection methods , 2007, Pattern Recognit. Lett..