Projector calibration algorithm in omnidirectional structured light

This paper aims to study the projector calibration algorithm in omnidirectional structured light (OSL). The traditional projector calibration method can not directly be used in omnidirectional system, because the projector is perpendicular to the omnidirectional camera in our experiment. Therefor, we design a complete algorithm for the calibration of omnidirectional structured light. Firstly, a calibration plane is applied. And a checkerboard calibration board are placed on that and the checkerboard pattern projected from the projector onto that. Secondly, the equation of the calibration plane are computed based on the extrinsic parameters of the calibration board. Thirdly, the corners of the projected pattern are detected in the image captured by omnidirectional camera. Lastly, 3D projected points for each projected corner are obtained based on the ray-plane intersection. We designed a complete set of OSL calibration toolbox based on the proposed methods in Matlab. The proposed method and toolbox in Matlab have been shown to be accurate and easyto-use in projector calibration.

[1]  B. Nazari,et al.  A robust camera-projector calibration method to be used in vein contrast enhancement systems , 2012, 20th Iranian Conference on Electrical Engineering (ICEE2012).

[2]  Tong Jia,et al.  Scene Depth Perception Based on Omnidirectional Structured Light , 2016, IEEE Transactions on Image Processing.

[3]  Stefan Hinz,et al.  Improved wide-angle, fisheye and omnidirectional camera calibration , 2015 .

[4]  Shinji Kotani,et al.  Easy calibration of camera-projector system using geometrical invariants , 2014, 2014 10th France-Japan/ 8th Europe-Asia Congress on Mecatronics (MECATRONICS2014- Tokyo).

[5]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Soo-Yeong Yi,et al.  Real-time omni-directional distance measurement with active panoramic vision , 2007 .

[7]  Soo-Yeong Yi,et al.  Development of Omnidirectional Ranging System Based on Structured Light Image , 2012 .

[8]  Jiebo Luo,et al.  Self-Supervised Online Metric Learning With Low Rank Constraint for Scene Categorization , 2013, IEEE Transactions on Image Processing.

[9]  Yan Shi,et al.  3D depth information extraction with omni-directional camera , 2015, Inf. Process. Lett..

[10]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[11]  Cewu Lu,et al.  Learning Important Spatial Pooling Regions for Scene Classification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Guangming Shi,et al.  Single Shot Dual-Frequency Structured Light Based Depth Sensing , 2015, IEEE Journal of Selected Topics in Signal Processing.

[13]  Takeshi Oishi,et al.  Outdoor omnidirectional video completion via depth estimation by motion analysis , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[14]  Tirthankar Bandyopadhyay,et al.  Differential jumping: A novel mode for micro-robot navigation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[15]  I. Garcia-Dorado,et al.  Fully automatic multi-projector calibration with an uncalibrated camera , 2011, CVPR 2011 WORKSHOPS.

[16]  Joaquim Salvi,et al.  Planar-based camera-projector calibration , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[17]  Ruigang Yang,et al.  Color calibration of multi-projector displays through automatic optimization of hardware settings , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[18]  Jing Xu,et al.  An omnidirectional 3D sensor with line laser scanning , 2016 .