A closed-form single-pose calibration method for the camera–projector system

AbstractTo improve the calibration efficiency of the structured light stereo vision system, a closed-form single-pose calibration method is proposed. Previous works calibrate the structured light stereo vision system via the planar-based method since the world coordinates of the projected pixels are easy to find. But the disadvantage of these methods is that multiple poses are required, so that the mechanical movement is necessary in these calibration methods. In this paper, the inherent geometry between the spheres and their image is exploited deeply. Thus, a sphere-based calibration method is proposed. The proposed method first calibrates the camera from the image of the absolute conic through an improved algorithm. Then, the three-dimensional coordinates of the projected pixels are found via the inherent geometrical relation. Next, the projector is calibrated using the direct linear method. Finally, the distortion of the projector is found through the nonlinear optimization method with an improved updating direction. Experiments demonstrate that not only the calibration efficiency is improved, but also the calibration accuracy is improved.

[1]  Yan Lu,et al.  On the sensitivity analysis of camera calibration from images of spheres , 2010, Comput. Vis. Image Underst..

[2]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[3]  Andrew W. Fitzgibbon,et al.  Direct least squares fitting of ellipses , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[4]  Christoph Resch,et al.  On-Site Semi-Automatic Calibration and Registration of a Projector-Camera System Using Arbitrary Objects with Known Geometry , 2015, IEEE Transactions on Visualization and Computer Graphics.

[5]  Hongbin Zha,et al.  A Novel Linear Approach to Camera Calibration from Sphere Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  Beiwen Li,et al.  Structured light system calibration method with optimal fringe angle. , 2014, Applied optics.

[7]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[8]  Ken Chen,et al.  Sphere-Based Geometrical Calibration Method for Structured Light Surface Measurement Systems , 2012 .

[9]  Ken Chen,et al.  A simple calibration method for structured light-based 3D profile measurement , 2013 .

[10]  Xiang Xie,et al.  Flexible method to calibrate projector–camera systems with high accuracy , 2014 .

[11]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Thomas F. Coleman,et al.  An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds , 1993, SIAM J. Optim..

[13]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[14]  Ken Chen,et al.  Accurate calibration method for camera and projector in fringe patterns measurement system. , 2016, Applied optics.

[15]  W. Faig.  CALIBRATION OF CLOSE-RANGE PHOTOGRAMMETRIC SYSTEMS: MATHEMATICAL FORMULATION , 1975 .

[16]  Glenn Healey,et al.  Modeling and calibrating CCD cameras for illumination-insensitive machine vision , 1992, Other Conferences.

[17]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  S. Inokuchi,et al.  Range-imaging system for 3-D object recognition , 1984 .

[20]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[21]  Jeffrey L. Posdamer,et al.  Surface measurement by space-encoded projected beam systems , 1982, Comput. Graph. Image Process..

[22]  T. T. Li,et al.  Geometric calibration of a camera-projector 3D imaging system , 2010, IVCNZ 2010.

[23]  Masatoshi Okutomi,et al.  A user-friendly method to geometrically calibrate projector-camera systems , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[24]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision: Camera Geometry and Single View Geometry , 2004 .

[25]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[26]  Hui Zhang,et al.  Camera Calibration from Images of Spheres , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Alan M. McIvor,et al.  Accurate 3D measurement using a structured light system , 1998, Image Vis. Comput..

[28]  Xianghua Ying,et al.  Catadioptric camera calibration using geometric invariants , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.