Calibration and Absolute Pose Estimation of Trinocular Linear Camera Array for Smart City Applications

A method for calibrating a Trinocular Linear Camera Array (TLCA) for traffic surveillance applications, such as towards smart cities, is presented. A TLCA-specific parametrization guarantees that the calibration finds a model where all the cameras are on a straight line. The method uses both a chequerboard close to the camera, as well as measured 3D points far from the camera: points measured in world coordinates, as well as their corresponding 2D points found manually in the images. Superior calibration accuracy can be obtained compared to standard methods using only a single data source, largely due to the use of chequerboards, while the line constraint in the parametrization allows for joint rectification. The improved triangulation accuracy, from 8-12 cm to around 6 cm when calibrating with 30-50 points in our experiment, allowing better road user analysis. The method is demonstrated by a proof-of-concept application where a point cloud is generated from multiple disparity maps, visualizing road user detections in 3D.

[1]  Robert Pless,et al.  Using many cameras as one , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[2]  J. J. Moré,et al.  Levenberg--Marquardt algorithm: implementation and theory , 1977 .

[3]  Yinlong Liu,et al.  A Novel Method for the Absolute Pose Problem with Pairwise Constraints , 2019, Remote. Sens..

[4]  Long Quan,et al.  Distributed Very Large Scale Bundle Adjustment by Global Camera Consensus , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Catherine Deegan,et al.  Assessment of stereo camera calibration techniques for a portable mobile mapping system , 2013, IET Comput. Vis..

[6]  Hadi Aliakbarpour,et al.  An efficient algorithm for extrinsic calibration between a 3D laser range finder and a stereo camera for surveillance , 2009, 2009 International Conference on Advanced Robotics.

[7]  Adam Herout,et al.  Fully Automatic Roadside Camera Calibration for Traffic Surveillance , 2015, IEEE Transactions on Intelligent Transportation Systems.

[8]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[9]  Peter Sturm,et al.  Calibration Wizard: A Guidance System for Camera Calibration Based on Modelling Geometric and Corner Uncertainty , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[10]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Frederik Schaffalitzky,et al.  Four Points in Two or Three Calibrated Views: Theory and Practice , 2006, International Journal of Computer Vision.

[12]  Jenq-Neng Hwang,et al.  CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  S. B. Kang,et al.  An Active Multibaseline Stereo System with Real-Time Image Acquisition , 1994 .

[14]  Patrik Persson,et al.  Global Trifocal Adjustment , 2019, SCIA.

[15]  Arjan Kuijper,et al.  Efficient Pose Selection for Interactive Camera Calibration , 2017, 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[16]  Lixing Han,et al.  Implementing the Nelder-Mead simplex algorithm with adaptive parameters , 2010, Computational Optimization and Applications.

[17]  Carlos Ricolfe-Viala,et al.  Robust metric calibration of non-linear camera lens distortion , 2010, Pattern Recognit..

[18]  H. Hirschmüller.  Accurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information , 2005, CVPR.

[19]  C. Jaynes.  Multi-view calibration from planar motion for video surveillance , 1999, Proceedings Second IEEE Workshop on Visual Surveillance (VS'99) (Cat. No.98-89223).

[20]  Chao Zheng,et al.  Analysis and simplification of lens distortion model for the scheimpflug imaging system calibration , 2019 .

[21]  Raja Giryes,et al.  MonSter: Awakening the Mono in Stereo , 2019, ArXiv.

[22]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[23]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[24]  Stefan Hinz,et al.  MLPnP - A Real-Time Maximum Likelihood Solution to the Perspective-n-Point Problem , 2016, ArXiv.

[25]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[26]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[27]  Yong-Sheng Chen,et al.  Pyramid Stereo Matching Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[29]  Hujun Bao,et al.  ICE-BA: Incremental, Consistent and Efficient Bundle Adjustment for Visual-Inertial SLAM , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Vincent Nozick,et al.  Camera array image rectification and calibration for stereoscopic and autostereoscopic displays , 2013, Ann. des Télécommunications.