Single Image Automatic Radial Distortion Compensation Using Deep Convolutional Network

In many computer vision domains, the input images must conform with the pinhole camera model, where straight lines in the real world are projected as straight lines in the image. Performing computer vision tasks on live sports broadcast footage imposes challenging requirements where the algorithms cannot rely on a specific calibration pattern, must be able to cope with unknown and uncalibrated cameras, radial distortion originating from complex television lenses, few visual clues to compensate distortion by, and the necessity for realtime performance. We present a novel method for single-image automatic lens distortion compensation based on deep convolutional neural networks, capable of real-time performance and accuracy using two highest-order coefficients of the polynomial distortion model operating in the application domain of sports broadcast.

[1]  Aiqi Wang,et al.  A Simple Method of Radial Distortion Correction with Centre of Distortion Estimation , 2009, Journal of Mathematical Imaging and Vision.

[2]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[4]  Julien Lefèvre,et al.  An Exact Formula for Calculating Inverse Radial Lens Distortions , 2016, Sensors.

[5]  Christian Bräuer-Burchardt A Simple New Method for Precise Lens Distortion Correction of Low Cost Camera Systems , 2004, DAGM-Symposium.

[6]  P. Alam ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[7]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[8]  Krista A. Ehinger,et al.  Recognizing scene viewpoint using panoramic place representation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Yubin Kuang,et al.  Deep Single Image Camera Calibration With Radial Distortion , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Chunyu Lin,et al.  A Deep Ordinal Distortion Estimation Approach for Distortion Rectification , 2020, IEEE Transactions on Image Processing.

[11]  ZhangZhengyou A Flexible New Technique for Camera Calibration , 2000 .

[12]  J. Rafael Sendra,et al.  An Algebraic Approach to Lens Distortion by Line Rectification , 2009, Journal of Mathematical Imaging and Vision.

[13]  이화영 X , 1960, Chinese Plants Names Index 2000-2009.

[14]  P. Alam ‘N’ , 2021, Composites Engineering: An A–Z Guide.

[15]  P. Alam ‘K’ , 2021, Composites Engineering.

[16]  Daniel Santana-Cedrés,et al.  An Iterative Optimization Algorithm for Lens Distortion Correction Using Two-Parameter Models , 2016, Image Process. Line.

[17]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Hong Wei,et al.  Correction of image radial distortion based on division model , 2017 .

[19]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[20]  Sing Bing Kang,et al.  Parameter-Free Radial Distortion Correction with Center of Distortion Estimation , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Daniel Santana-Cedrés,et al.  Wide-Angle Lens Distortion Correction Using Division Models , 2013, CIARP.

[22]  Matthew N. Dailey,et al.  Automatic Radial Distortion Estimation from a Single Image , 2012, Journal of Mathematical Imaging and Vision.

[23]  Xianghua Ying,et al.  Radial Lens Distortion Correction Using Convolutional Neural Networks Trained with Synthesized Images , 2016, ACCV.