CAMERA CALIBRATION FOR FISH-EYE LENSES IN ENDOSCOPYWITH AN APPLICATION TO 3D RECONSTRUCTION

Image analysis tasks such as 3D reconstruction from endoscopic images require compensation of geometric distortions introduced by the lens system. Appropriate camera calibration is thus necessary. Commonly used calibration algorithms rely on the well-known pinhole camera model, extended by parametric terms for radial distortions. In this paper, we demonstrate that these models are not appropriate if very strong distortions occur as is the case for endoscopic fish-eye lenses. As an alternative, we analyze a generic calibration algorithm published recently by Kannala and Brandt, which is based on more general projection equations. We show qualitatively and quantitatively that this algorithm is well suited to deal with significant distortions especially in the image's rim regions. Furthermore, we demonstrate how images of a colon phantom that were corrected in such a manner can be used to obtain a 3D reconstruction

[1]  Philippe C. Cattin,et al.  Fully Automatic Endoscope Calibration for Intraoperative Use , 2006, Bildverarbeitung für die Medizin.

[2]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Alan D. Jones.  Manual of Photogrammetry, eds C.C. Slama, C. Theurer and S.W. Hendrikson, American Society of Photogrammetry, Falls Church, Va., 1980, Fourth Edition, 180 × 260mm, xvi and 1056 pages (with index), 72 tables, 866 figures. ISBN 0 937294 01 2. , 1982 .

[4]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[5]  P. Perona,et al.  Visual methods for three-dimensional modeling , 1999 .

[6]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[7]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[8]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[9]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[11]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[12]  Shinji Tanaka,et al.  PIT PATTERN DIAGNOSIS FOR COLORECTAL NEOPLASIA USING NARROW BAND IMAGING MAGNIFICATION , 2006 .

[13]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[14]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[16]  Stephan Rupp,et al.  Camera Calibration from Fiberscopic Views with Accuracy Evaluation , 2006, Bildverarbeitung für die Medizin.

[17]  Chenyu Wu.  3D reconstruction of anatomical structures from endoscopic images , 2009 .

[18]  S. Kudo,et al.  Colorectal tumours and pit pattern. , 1994, Journal of clinical pathology.