Proposed New AV-Type Test-Bed for Accurate and Reliable Fish-Eye Lens Camera Self-Calibration

The fish-eye lens camera has a wide field of view that makes it effective for various applications and sensor systems. However, it incurs strong geometric distortion in the image due to compressive recording of the outer part of the image. Such distortion must be interpreted accurately through a self-calibration procedure. This paper proposes a new type of test-bed (the AV-type test-bed) that can effect a balanced distribution of image points and a low level of correlation between orientation parameters. The effectiveness of the proposed test-bed in the process of camera self-calibration was verified through the analysis of experimental results from both a simulation and real datasets. In the simulation experiments, the self-calibration procedures were performed using the proposed test-bed, four different projection models, and five different datasets. For all of the cases, the Root Mean Square residuals (RMS-residuals) of the experiments were lower than one-half pixel. The real experiments, meanwhile, were carried out using two different cameras and five different datasets. These results showed high levels of calibration accuracy (i.e., lower than the minimum value of RMS-residuals: 0.39 pixels). Based on the above analyses, we were able to verify the effectiveness of the proposed AV-type test-bed in the process of camera self-calibration.

[1]  GEOMETRIC MODELLING AND CALIBRATION OF FISHEYE LENS CAMERA SYSTEMS , 2005 .

[2]  Torsten Sattler,et al.  3D Modeling on the Go: Interactive 3D Reconstruction of Large-Scale Scenes on Mobile Devices , 2015, 2015 International Conference on 3D Vision.

[3]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  C. Fraser,et al.  Digital camera calibration methods: Considerations and comparisons , 2006 .

[5]  Xin Lu,et al.  Researches on hazard avoidance cameras calibration of Lunar Rover , 2017, International Conference on Space Optics.

[6]  He Xu,et al.  Development of Hemi-Cylinder Plane for Panorama View in Around View Monitor Applications , 2016, 2016 International Conference on Computational Intelligence and Applications (ICCIA).

[7]  Clive S. Fraser,et al.  Digital camera self-calibration , 1997 .

[8]  Anup Basu,et al.  Alternative models for fish-eye lenses , 1995, Pattern Recognit. Lett..

[9]  Gábor Kátai-Urbán,et al.  Reconstructing atmospheric cloud particles from multiple fisheye cameras , 2018, Solar Energy.

[10]  Changjae Kim,et al.  Analysis of Fish-Eye Lens Camera Self-Calibration , 2019, Sensors.

[11]  Eija Honkavaara,et al.  Photogrammetric measurement of tree stems from vertical fisheye images , 2017 .

[12]  H.A. Beyer,et al.  Accurate calibration of CCD-cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Wolfgang Förstner,et al.  Fish-Eye-Stereo Calibration and Epipolar Rectification , 2005 .

[14]  R. Koch,et al.  CALIBRATION OF A PMD-CAMERA USING A PLANAR CALIBRATION PATTERN TOGETHER WITH A MULTI-CAMERA SETUP , 2008 .

[15]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[16]  Edward Jones,et al.  Equidistant Fish-Eye Calibration and Rectification by Vanishing Point Extraction , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Shigang Li,et al.  Full-View Spherical Image Camera , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Yi Yin,et al.  A flexible vehicle surround view camera system by central-around coordinate mapping model , 2018, Multimedia Tools and Applications.

[20]  Gianluca Percoco,et al.  Photogrammetric measurement of 3D freeform millimetre-sized objects with micro features: an experimental validation of the close-range camera calibration model for narrow angles of view , 2015 .

[21]  Antonio Maria Garcia Tommaselli,et al.  EXPERIMENTAL ASSESSMENT OF TECHNIQUES FOR FISHEYE CAMERA CALIBRATION , 2015 .

[22]  Sidney F. Ray Applied Photographic Optics: Imaging Systems for Photography, Film, and Video , 1988 .

[23]  D. Pagliari,et al.  DTM generation through UAV survey with a Fisheye camera on a vineyard , 2018 .

[24]  Cumhur Sahin Comparison and Calibration of Mobile Phone Fisheye Lens and Regular Fisheye Lens via Equidistant Model , 2016, J. Sensors.

[25]  Eija Honkavaara,et al.  A Backpack-Mounted Omnidirectional Camera with Off-the-Shelf Navigation Sensors for Mobile Terrestrial Mapping: Development and Forest Application , 2018, Sensors.

[26]  Josechu J. Guerrero,et al.  A novel hybrid camera system with depth and fisheye cameras , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[27]  Francesco Fassi,et al.  FISHEYE PHOTOGRAMMETRY:TESTS AND METHODOLOGIES FOR THE SURVEY OF NARROW SPACES , 2017 .

[28]  Osama Zia,et al.  360° Panorama Generation using Drone Mounted Fisheye Cameras , 2019, 2019 IEEE International Conference on Consumer Electronics (ICCE).

[29]  Daniel Cremers,et al.  Large-scale direct SLAM for omnidirectional cameras , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  Ivan Markovic,et al.  Moving object detection, tracking and following using an omnidirectional camera on a mobile robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[31]  H. Maas,et al.  Validation of geometric models for fisheye lenses , 2009 .

[32]  Kwanghoon Sohn,et al.  Rear obstacle detection system with fisheye stereo camera using HCT , 2015, Expert Syst. Appl..

[33]  Kenro Miyamoto,et al.  Fish Eye Lens , 1964 .

[34]  Olivier Julien,et al.  Use of a FishEye Camera for GNSS NLOS Exclusion and Characterization in Urban Environments , 2016 .

[35]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[36]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[37]  Yongil Kim,et al.  Comprehensive Analysis of System Calibration between Optical Camera and Range Finder , 2018, ISPRS Int. J. Geo Inf..

[38]  Pascal Fua,et al.  Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera , 2018, IEEE Transactions on Visualization and Computer Graphics.

[39]  Sek M. Chai,et al.  Real-Time Fisheye Lens Distortion Correction Using Automatically Generated Streaming Accelerators , 2009, 2009 17th IEEE Symposium on Field Programmable Custom Computing Machines.

[40]  Nahum Kiryati,et al.  People detection in top-view fisheye imaging , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[41]  D. Schneider,et al.  INTEGRATED PROCESSING OF TERRESTRIAL LASER SCANNER DATA AND FISHEYE-CAMERA IMAGE DATA , 2008 .

[42]  Qi Huang,et al.  3-D Surround View for Advanced Driver Assistance Systems , 2018, IEEE Transactions on Intelligent Transportation Systems.

[43]  Yassine Ruichek,et al.  Fisheye-Based Method for GPS Localization Improvement in Unknown Semi-Obstructed Areas , 2017, Sensors.

[44]  Edward Jones,et al.  Equidistant (ftheta) fish-eye perspective with application in distortion centre estimation , 2010, Image Vis. Comput..

[45]  GlavinMartin,et al.  Equidistant (fθ) fish-eye perspective with application in distortion centre estimation , 2010 .

[46]  H. Bakstein,et al.  Panoramic mosaicing with a 180/spl deg/ field of view lens , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[47]  Roland Siegwart,et al.  A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[48]  Miska M. Hannuksela,et al.  Standard-Compliant Multiview Video Coding and Streaming for Virtual Reality Applications , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[49]  Duan-Yu Chen,et al.  Fish-Eye Lenses-Based Camera Calibration and Panoramic Image Stitching , 2018, 2018 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW).

[50]  Edward Jones,et al.  Accuracy of fish-eye lens models. , 2010, Applied optics.