A High Precision Approach to Calibrate a Structured Light Vision Sensor in a Robot-Based Three-Dimensional Measurement System

A robot-based three-dimensional (3D) measurement system is presented. In the presented system, a structured light vision sensor is mounted on the arm of an industrial robot. Measurement accuracy is one of the most important aspects of any 3D measurement system. To improve the measuring accuracy of the structured light vision sensor, a novel sensor calibration approach is proposed to improve the calibration accuracy. The approach is based on a number of fixed concentric circles manufactured in a calibration target. The concentric circle is employed to determine the real projected centres of the circles. Then, a calibration point generation procedure is used with the help of the calibrated robot. When enough calibration points are ready, the radial alignment constraint (RAC) method is adopted to calibrate the camera model. A multilayer perceptron neural network (MLPNN) is then employed to identify the calibration residuals after the application of the RAC method. Therefore, the hybrid pinhole model and the MLPNN are used to represent the real camera model. Using a standard ball to validate the effectiveness of the presented technique, the experimental results demonstrate that the proposed novel calibration approach can achieve a highly accurate model of the structured light vision sensor.

[1]  H. S. Wolff,et al.  iRun: Horizontal and Vertical Shape of a Region-Based Graph Compression , 2022, Sensors.

[2]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[3]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[5]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[6]  Janne Heikkilä,et al.  Geometric Camera Calibration Using Circular Control Points , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Jun-Sik Kim,et al.  A Camera Calibration Method using Concentric Circles for Vision Applications , 2001 .

[9]  Howon Kim,et al.  A New Camera Caibration Method using Concentric Circles for Vision Applications , 2002 .

[10]  Guangjun Zhang,et al.  A novel calibration approach to structured light 3D vision inspection , 2002 .

[11]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[12]  Carlo Tomasi Camera Calibration , 2002 .

[13]  L. Grammatikopoulos,et al.  CAMERA CALIBRATION APPROACHES USING SINGLE IMAGES OF MAN-MADE OBJECTS , 2003 .

[14]  Olivier D. Faugeras,et al.  A theory of self-calibration of a moving camera , 1992, International Journal of Computer Vision.

[15]  Zhengyou Zhang,et al.  Camera calibration with one-dimensional objects , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Sören Larsson,et al.  Motion control and data capturing for laser scanning with an industrial robot , 2006, Robotics Auton. Syst..

[17]  Ji,et al.  Novel adaptive laser scanning sensor for reverse engineering measurement , 2007 .

[18]  Quanmin Zhu,et al.  A novel robot surface measurement system enhanced with 3D surface reconstruction , 2008, Int. J. Model. Identif. Control..

[19]  Jianfeng Li,et al.  Calibration of a portable laser 3-D scanner used by a robot and its use in measurement , 2008 .

[20]  Aiguo Li,et al.  Hand-to-eye calibration for 3D surface digitalisation system , 2009, Int. J. Model. Identif. Control..

[21]  Aiqi Wang,et al.  A Simple Method of Radial Distortion Correction with Centre of Distortion Estimation , 2009, Journal of Mathematical Imaging and Vision.

[22]  Feipeng Da,et al.  Sub-pixel edge detection based on an improved moment , 2010, Image Vis. Comput..

[23]  Xie Ze-xiao,et al.  A novel approach for the field calibration of line structured-light sensors , 2010 .

[24]  Ling Li,et al.  Camera calibration using one-dimensional information and its applications in both controlled and uncontrolled environments , 2010, Pattern Recognit..

[25]  De Xu,et al.  Measurement and Defect Detection of the Weld Bead Based on Online Vision Inspection , 2010, IEEE Transactions on Instrumentation and Measurement.

[26]  Junqing Yu,et al.  Real-Time Camera Pose Estimation for Wide-Area Augmented Reality Applications , 2011, IEEE Computer Graphics and Applications.

[27]  Wei Liu,et al.  Calibration of central catadioptric camera with one-dimensional object undertaking general motions , 2011, 2011 18th IEEE International Conference on Image Processing.

[28]  A Nonlinear Camera Self-calibration Approach based on Active Vision , 2011 .

[29]  Wang Yi Calibration for 3D Profile Measurement Robot with Laser Line-Scan Sensor , 2012 .

[30]  Quan Quan,et al.  Calibration method and experiments of multi-camera's parameters based on freely moving one-dimensional calibration object , 2014 .

[31]  Guangjun Zhang,et al.  Parallel-based calibration method for line-structured light vision sensor , 2014 .

[32]  K. Fan,et al.  An analogue contact probe using a compact 3D optical sensor for micro/nano coordinate measuring machines , 2014 .

[33]  Zhen Liu,et al.  On-site calibration of line-structured light vision sensor in complex light environments. , 2015, Optics express.

[34]  Zhen Liu,et al.  Calibration method for line-structured light vision sensor based on a single ball target , 2015 .

[35]  陈天飞 Chen Tian-fei,et al.  New Calibration Method for Line Structured Light Sensor Based on Planar Target , 2015 .

[36]  Bin Zhao,et al.  Camera self-calibration from translation by referring to a known camera. , 2015, Applied optics.

[37]  António E. Ruano,et al.  An Intelligent Weather Station , 2015, Sensors.

[38]  Li Wang,et al.  Camera self-calibration with lens distortion , 2016 .