Visibility Map: A New Method in Evaluation Quality of Optical Colonoscopy

Optical colonoscopy is performed by insertion of a long flexible endoscope into the colon. Inspecting the whole colonic surface for abnormalities has been a main concern in estimating quality of a colonoscopy procedure. In this paper we aim to estimate areas that have not been inspected thoroughly as a quality metric by generating a visibility map of the colon surface. The colon was modeled as a cylinder. By estimating the camera motion parameters between each consecutive frame, circumferential bands from the cylinder of the colon surface were extracted. Registering these extracted band images from adjacent video frames provide a visibility map, which could reveal uncovered areas by clinicians from colonoscopy videos. The method was validated using a set of realistic videos generated using a colonoscopy simulator for which the ground truth was known, and by analyzing results from processing actual colonoscopy videos by a clinical expert. Our method was able to identify 100% of uncovered areas on simulated data and achieved with sensitivity of 96% and precision of 74% on real videos. The results suggest that visibility map can increase clinicians' awareness of uncovered areas, and would reduce the chance of missed polyps.

[1]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[2]  Gerard Lacey,et al.  Indistinct Frame Detection in Colonoscopy Videos , 2009, 2009 13th International Machine Vision and Image Processing Conference.

[3]  Perry Pickhardt,et al.  Location of Adenomas Missed by Optical Colonoscopy , 2004, Annals of Internal Medicine.

[4]  Jorge J. Moré,et al.  The Levenberg-Marquardt algo-rithm: Implementation and theory , 1977 .

[5]  Jung-Hwan Oh,et al.  Real-Time Phase Boundary Detection for Colonoscopy Videos Using Motion Vector Templates , 2012, Abdominal Imaging.

[6]  Pietro Valdastri,et al.  A Comparative Study of Ego-Motion Estimation Algorithms for Teleoperated Robotic Endoscopes , 2014, CARE@MICCAI.

[7]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Daniel Mirota,et al.  Robust motion estimation and structure recovery from endoscopic image sequences with an Adaptive Scale Kernel Consensus estimator , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Shen Linyong,et al.  An Intelligent Endoscopic Navigation System , 2006, 2006 International Conference on Mechatronics and Automation.

[10]  Roland Siegwart,et al.  A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[11]  Sébastien Ourselin,et al.  Developing a Next Generation Colonoscopy Simulator , 2010, Int. J. Image Graph..

[12]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[13]  Daisuke Deguchi,et al.  Fast and Accurate Bronchoscope Tracking Using Image Registration and Motion Prediction , 2004, MICCAI.

[14]  Douglas K Rex,et al.  Who is the best colonoscopist? , 2007, Gastrointestinal endoscopy.

[15]  Jung-Hwan Oh,et al.  3D Reconstruction of virtual colon structures from colonoscopy images , 2014, Comput. Medical Imaging Graph..

[16]  A. Ardeshir Goshtasby,et al.  Image registration by local approximation methods , 1988, Image Vis. Comput..

[17]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[18]  Jianfei Liu,et al.  A robust method to track colonoscopy videos with non-informative images , 2013, International Journal of Computer Assisted Radiology and Surgery.

[19]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[20]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.