High-Accuracy Calibration of On-Site Multi-Vision Sensors Based on Flexible and Optimal 3D Field

Global calibration of multi-vision sensors in the railway fields is easily affected by on-site complex environments, such as lighting and self-occlusion, which makes it difficult for existing methods to achieve high-accuracy calibration. In this paper, a high-accuracy and flexible calibration method of multi-vision sensors in the outdoor railway fields based on flexible and optimal 3D data field through the combination of articular arm and metal target embedded with luminescent LEDs is proposed. Firstly, a high-accuracy and flexible 3D data field with multiple angles and views is constructed by the articular arm and the metal target rapidly; Secondly, the high-frequency multi-exposure imaging mode and multi-scale image feature points extraction are adopted, and the high-accuracy reposition is achieved through Kalman filter, which can reduce the impact of image noise efficiently; Finally, the RANSAC method is utilized to optimize the 3D data field, forming the optimal 3D data field, and the optimal target chains corresponding to each group of cameras are established. The maximum likelihood solution of global parameters is solved by nonlinear optimization. Simulation experiments verify the feasibility of the proposed method. Meanwhile, physical experiment results show this method can reduce the outdoor environment impact and improve the calibration and measurement precision effectively. In addition, the computational efficiency of the proposed method is about 11.2 times than multi-images averaging method, the calibration and measurement accuracy improve about 20 and 2.9 times respectively, which is suitable for the high-accuracy and flexible global calibration in the complex railway environment.

[1]  Youfu Li,et al.  On-line measurement of the straightness of seamless steel pipes using machine vision technique , 2001 .

[2]  Yang Yin,et al.  Extrinsic parameter calibration of stereo vision sensors using spot laser projector. , 2016, Applied optics.

[3]  Yiu-Tong Chan,et al.  A simple approach for the estimation of circular arc center and its radius , 1989, Comput. Vis. Graph. Image Process..

[4]  Stanley T. Birchfield,et al.  An Energy Minimization Approach to Automatic Traffic Camera Calibration , 2013, IEEE Transactions on Intelligent Transportation Systems.

[5]  Xin Kang,et al.  Extrinsic calibration of a non-overlapping camera network based on close-range photogrammetry. , 2016, Applied optics.

[6]  Wilfried Philips,et al.  Extrinsic Calibration of Camera Networks Using a Sphere , 2015, Sensors.

[7]  Takashi Matsuyama,et al.  A new mirror-based extrinsic camera calibration using an orthogonality constraint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Liu Zhen,et al.  Sub-pixel Extraction Method for the Center of Light-spot Image , 2009 .

[9]  Yun Wang,et al.  Multi-camera global calibration for large-scale measurement based on plane mirror , 2015 .

[10]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Guangjun Zhang,et al.  Dynamic structured-light measurement for wheel diameter based on the cycloid constraint. , 2016, Applied optics.

[12]  Qin Yi Multi-circle fitting algorithms for laser spot location , 2006 .

[13]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[14]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[15]  Guangjun Zhang,et al.  Dynamic tread wear measurement method for train wheels against vibrations. , 2015, Applied optics.

[16]  Wenfu Xu,et al.  An Efficient Pose Measurement Method of a Space Non-Cooperative Target Based on Stereo Vision , 2017, IEEE Access.

[17]  Guangjun Zhang,et al.  On-Site Reliable Wheel Size Measurement Based on Multisensor Data Fusion , 2019, IEEE Transactions on Instrumentation and Measurement.

[18]  Gang Chen,et al.  Stereo vision sensor calibration based on random spatial points given by CMM , 2012 .

[19]  Xian Wang,et al.  Accurate calibration approach for non-overlapping multi-camera system , 2019, Optics & Laser Technology.

[20]  Tan Yu Algorithm of laser spot detection based on circle fitting , 2002 .

[21]  O. Chum,et al.  ENHANCING RANSAC BY GENERALIZED MODEL OPTIMIZATION Onďrej Chum, Jǐ , 2003 .

[22]  Guangyong Chen,et al.  An Efficient Statistical Method for Image Noise Level Estimation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Youfu Li,et al.  A global calibration method for large-scale multi-sensor visual measurement systems , 2004 .

[24]  Qiang Wu,et al.  Robust Inter-Vehicle Distance Estimation Method Based on Monocular Vision , 2019, IEEE Access.

[25]  Guangjun Zhang,et al.  On-site calibration method for outdoor binocular stereo vision sensors , 2016 .

[26]  Janne Heikkilä,et al.  Geometric Camera Calibration Using Circular Control Points , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Jan-Michael Frahm,et al.  Simple calibration of non-overlapping cameras with a mirror , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Zhen Liu,et al.  An external parameter calibration method for multiple cameras based on laser rangefinder , 2014 .

[29]  Guangjun Zhang,et al.  Simple and fast rail wear measurement method based on structured light , 2011 .

[30]  Xiaofeng Li,et al.  Binocular vision system calibration based on a one-dimensional target. , 2012, Applied optics.

[31]  Guangjun Zhang,et al.  Flexible global calibration of multiple cameras with nonoverlapping fields of view using circular targets. , 2017, Applied optics.

[32]  Guangjun Zhang,et al.  A global calibration method for multiple vision sensors based on multiple targets , 2011 .

[33]  梁晋 Liang Jin,et al.  Global calibration for muti-camera videogrammetric system with large-scale field-of-view , 2012 .

[34]  Urbano Nunes,et al.  Extrinsic calibration of multi-modal sensor arrangements with non-overlapping field-of-view , 2016, Machine Vision and Applications.

[35]  Bo Li,et al.  High-Precision Measurement of Binocular Telecentric Vision System With Novel Calibration and Matching Methods , 2019, IEEE Access.

[36]  Guangjun Zhang,et al.  Novel calibration method for non-overlapping multiple vision sensors based on 1D target , 2011 .

[37]  Peng Zhou,et al.  Rail Profile Measurement Based on Line-structured Light Vision , 2018, IEEE Access.