Online Re-calibration for Robust 3D Measurement Using Single Camera- PantoInspect Train Monitoring System

Vision-based inspection systems measures defects accurately with the help of a checkerboard calibration CBC method. However, the 3D measurements of such systems are prone to errors, caused by physical misalignment of the object-of-interest and noisy image data. The PantoInspect Train Monitoring System PTMS, is one such system that inspects defects on pantographs mounted on top of the electric trains. In PTMS, the measurement errors can compromise railway safety. Although this problem can be solved by re-calibrating the cameras, the process involves manual intervention leading to large servicing times. Therefore, in this paper, we propose Feature Based Calibration FBC in place of CBC, to cater an obvious need for online re-calibration that enhances the usability of the system. FBC involves feature extraction, pose estimation, back-projection of defect points and estimation of 3D measurements. We explore four state-of-the-art pose estimation algorithms in FBC using very few feature points. This paper evaluates and discusses the performance of FBC and its robustness against practical problems, in comparison to CBC. As a result, we identify the best FBC algorithm type and operational scheme for PTMS. In conclusion, we show that, by adopting FBC in PTMS and other related 3D systems, better performance and robustness can be achieved compared to CBC.

[1]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[2]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[3]  P. Perona,et al.  Visual methods for three-dimensional modeling , 1999 .

[4]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[5]  Yaser Sheikh,et al.  Point-less calibration: Camera parameters from gradient-based alignment to edge images , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[6]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[9]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[10]  Carsten Griwodz,et al.  Faster and more accurate feature-based calibration for widely spaced camera pairs , 2012, 2012 Second International Conference on Digital Information and Communication Technology and it's Applications (DICTAP).

[11]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[12]  Xiang Chen,et al.  Feature-based calibration of distributed smart stereo camera networks , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[13]  Ping Lu,et al.  A camera on-line recalibration framework using SIFT , 2010, The Visual Computer.