Automatic Line Extraction in Uncalibrated Omnidirectional Cameras with Revolution Symmetry

Revolution symmetry is a realistic assumption for modelling the majority of catadioptric and dioptric cameras. In central systems it can be described by a projection model based on radially symmetric distortion. In these systems straight lines are projected on curves called line-images. These curves have in general more than two degrees of freedom and their shape strongly depends on the particular camera configuration. Therefore, the existing line-extraction methods for this kind of omnidirectional cameras require the camera calibration by contrast with the perspective case where the calibration is not involved in the shape of the projected line-image. However, this drawback can be considered as an advantage because the shape of the line-images can be used for self-calibration. In this paper, we present a novel method to extract line-images in uncalibrated omnidirectional images which is valid for radially symmetric central systems. In this method we propose using the plumb-line constraint to find closed form solutions for different types of camera systems, dioptric or catadioptric. The inputs of the proposed method are points belonging to the line-images and their intensity gradient. The gradient information allows to reduce the number of points needed in the minimal solution improving the result and the robustness of the estimation. The scheme is used in a line-image extraction algorithm to obtain lines from uncalibrated omnidirectional images without any assumption about the scene. The algorithm is evaluated with synthetic and real images showing good performance. The results of this work have been implemented in an open source Matlab toolbox for evaluation and research purposes.

[1]  Eric Hayman,et al.  Correcting Radial Distortion by Circle Fitting , 2005, BMVC.

[2]  Edward Rosten,et al.  Camera distortion self-calibration using the plumb-line constraint and minimal Hough entropy , 2008, Machine Vision and Applications.

[3]  Daniel Santana-Cedrés,et al.  Line detection in images showing significant lens distortion and application to distortion correction , 2014, Pattern Recognit. Lett..

[4]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.

[5]  Zhanyi Hu,et al.  Geometric invariants and applications under catadioptric camera model , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[7]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[8]  Vincenzo Caglioti,et al.  Line Localization from Single Catadioptric Images , 2011, International Journal of Computer Vision.

[9]  Xianghua Ying,et al.  Catadioptric line features detection using Hough transform , 2004, ICPR 2004.

[10]  Rita Cucchiara,et al.  A Hough transform-based method for radial lens distortion correction , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Luis Puig,et al.  Calibration of Central Catadioptric Cameras Using a DLT-Like Approach , 2011, International Journal of Computer Vision.

[13]  Josechu J. Guerrero,et al.  Line extraction in uncalibrated central images with revolution symmetry , 2013, BMVC.

[14]  Xianghua Ying,et al.  Can We Consider Central Catadioptric Cameras and Fisheye Cameras within a Unified Imaging Model , 2004, ECCV.

[15]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[16]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Rudolf Kingslake A history of the photographic lens , 1989 .

[18]  Aiqi Wang,et al.  A Simple Method of Radial Distortion Correction with Centre of Distortion Estimation , 2009, Journal of Mathematical Imaging and Vision.

[19]  Jan M. Rabaey,et al.  Comparison of Methods , 2004 .

[20]  Pascal Vasseur,et al.  Motion estimation by decoupling rotation and translation in catadioptric vision , 2010, Comput. Vis. Image Underst..

[21]  Juho Kannala,et al.  Self-Calibration of Central Cameras by Minimizing Angular Error , 2008, VISAPP.

[22]  Luis Puig,et al.  Calibration of omnidirectional cameras in practice: A comparison of methods , 2012, Comput. Vis. Image Underst..

[23]  Benjamin W. Wah,et al.  Wiley Encyclopedia of Computer Science and Engineering , 2009, Wiley Encyclopedia of Computer Science and Engineering.

[24]  Sidney F. Ray,et al.  Applied Photographic Optics: Lenses and optical systems for photography, film, video, electronic and digital imaging , 2002 .

[25]  Olivier D. Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[26]  Daniel E. Stevenson,et al.  Nonparametric correction of distortion , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[27]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Simone Gasparini,et al.  Camera Models and Fundamental Concepts Used in Geometric Computer Vision , 2011, Found. Trends Comput. Graph. Vis..

[29]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Hellward Broszio,et al.  Robust line-based calibration of lens distortion from a single view , 2003 .

[31]  Juho Kannala,et al.  Geometric Camera Calibration , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[32]  Peter F. Sturm,et al.  Self-calibration of a General Radially Symmetric Distortion Model , 2006, ECCV.

[33]  J. Rafael Sendra,et al.  An Algebraic Approach to Lens Distortion by Line Rectification , 2009, Journal of Mathematical Imaging and Vision.

[34]  H. Maas,et al.  Validation of geometric models for fisheye lenses , 2009 .

[35]  Jesus Bermudez-Cameo,et al.  Hypercatadioptric Line Images for 3D Orientation and Image Rectification , 1970 .

[36]  Helder Araújo,et al.  Geometric properties of central catadioptric line images and their application in calibration , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Matthew N. Dailey,et al.  Automatic Radial Distortion Estimation from a Single Image , 2012, Journal of Mathematical Imaging and Vision.

[38]  Josechu J. Guerrero,et al.  A Unified Framework for Line Extraction in Dioptric and Catadioptric Cameras , 2012, ACCV.

[39]  Philippe Martinet,et al.  A generic fisheye camera model for robotic applications , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Peter F. Sturm,et al.  Plane-based calibration of central catadioptric cameras , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[41]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[42]  Helder Araújo,et al.  Fitting conics to paracatadioptric projections of lines , 2006, Comput. Vis. Image Underst..

[43]  Hongbin Zha,et al.  Simultaneously calibrating catadioptric camera and detecting line features using Hough transform , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Michel Antunes,et al.  Unsupervised Intrinsic Calibration from a Single Frame Using a "Plumb-Line" Approach , 2013, 2013 IEEE International Conference on Computer Vision.