Real-time lens distortion correction: speed, accuracy and efficiency

Abstract. Optical lens systems suffer from nonlinear geometrical distortion. Optical imaging applications such as image-enhanced endoscopy and image-based bronchoscope tracking require correction of this distortion for accurate localization, tracking, registration, and measurement of image features. Real-time capability is desirable for interactive systems and live video. The use of a texture-mapping graphics accelerator, which is standard hardware on current motherboard chipsets and add-in video graphics cards, to perform distortion correction is proposed. Mesh generation for image tessellation, an error analysis, and performance results are presented. It is shown that distortion correction using commodity graphics hardware is substantially faster than using the main processor and can be performed at video frame rates (faster than 30 frames per second), and that the polar-based method of mesh generation proposed here is more accurate than a conventional grid-based approach. Using graphics hardware to perform distortion correction is not only fast and accurate but also efficient as it frees the main processor for other tasks, which is an important issue in some real-time applications.

[1]  Donald G. Bailey,et al.  A novel approach to real-time bilinear interpolation , 2004, Proceedings. DELTA 2004. Second IEEE International Workshop on Electronic Design, Test and Applications.

[2]  Frederick M. Waltz.  Implementation Of Real-Time Perspective Correction , 1988, Other Conferences.

[3]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[4]  Carlos Couto,et al.  Fast correction of lens distortion for image applications , 1997 .

[5]  Jay B. West,et al.  Implementation, calibration and accuracy testing of an image-enhanced endoscopy system , 2002, IEEE Transactions on Medical Imaging.

[6]  Torsten Rohlfing,et al.  Augmented-reality visualization of brain structures with stereo and kinetic depth cues: system description and initial evaluation with head phantom , 2001, SPIE Medical Imaging.

[7]  Warren E. Smith,et al.  Correction of distortion in endoscope images , 1992, IEEE Trans. Medical Imaging.

[8]  Hideaki Haneishi,et al.  A new method for distortion correction of electronic endoscope images , 1995, IEEE Trans. Medical Imaging.

[9]  Junhee Park,et al.  Lens distortion correction using ideal image coordinates , 2009, IEEE Transactions on Consumer Electronics.

[10]  Randima Fernando,et al.  GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics , 2004 .

[11]  Paul R. Cohen,et al.  Camera Calibration with Distortion Models and Accuracy Evaluation , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Rasool Khadem,et al.  Image-enhanced endoscopy calibration and image registration accuracy testing , 2002, SPIE Medical Imaging.

[13]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 1999, IEEE Transactions on Medical Imaging.

[14]  David A. Butler,et al.  A distortion-correction scheme for industrial machine-vision applications , 1991, IEEE Trans. Robotics Autom..

[15]  Soren W. Henriksen,et al.  Manual of photogrammetry , 1980 .

[16]  Matt Pharr,et al.  Gpu gems 2: programming techniques for high-performance graphics and general-purpose computation , 2005 .

[17]  David J. Hawkes,et al.  Design and evaluation of a system for microscope-assisted guided interventions (MAGI) , 2000 .

[18]  Ronelle Geldenhuys,et al.  Centi-pixel accurate real-time inverse distortion correction , 2008, International Symposium on Optomechatronic Technologies.

[19]  Cornelis H. Slump,et al.  Correction of lens-distortion for real-time image processing systems , 1993, Proceedings of IEEE Workshop on VLSI Signal Processing.

[20]  Jun Sugiyama,et al.  Tracking of a bronchoscope using epipolar geometry analysis and intensity-based image registration of real and virtual endoscopic images , 2002, Medical Image Anal..