Measuring the size of neoplasia in colonoscopy using depth-from-defocus

Colonoscopy is the reference medical examination for the diagnosis and treatment of neoplasia in gastroenterology. During the examination, the expert explores the colon cavity with a gastroscope in order to detect neoplasias - abnormal growths of tissue - and to diagnose which ones could be malignant. The Paris classification of superficial neoplastic lesions is the gold standard set of criteria for this type of diagnosis. One of the major criteria is the size. However, this is tremendously difficult to accurately estimate from images. This is because the absolute scale of the observed tissues is not directly conveyed in the 2D endoscopic image. We propose an image-based method to estimate the size of neoplasias. The core idea is to combine Depth-From-Focus (DFF) and Depth-From-Defocus (DFD). This allows us to recover the absolute scale by automatically detecting the blur/unblur breakpoint while the expert pulls the gastroscope away from a neoplasia. Our method is passive: it uses the image data only and thus does not require hardware modification of the gastroscope. We report promising experimental results on phantom and patient datasets.

[1]  Yangjie Wei,et al.  Global depth from defocus with fixed camera parameters , 2009, 2009 International Conference on Mechatronics and Automation.

[2]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Christian Bräuer-Burchardt,et al.  Distance Dependent Lens Distortion Variation in 3D Measuring Systems Using Fringe Projection , 2006, BMVC.

[4]  Stefano Soatto,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE IEEE TRANSACTION OF PATTERN RECO , 2022 .

[5]  Christopher D Claxton,et al.  Measurement of the point-spread function of a noisy imaging system. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Murali Subbarao,et al.  Depth from defocus: A spatial domain approach , 1994, International Journal of Computer Vision.

[7]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Charles J. Lightdale,et al.  Update on the Paris Classification of Superficial Neoplastic Lesions in the Digestive Tract , 2005, Endoscopy.

[9]  J. Barkin,et al.  CT Colonography versus Colonoscopy for the Detection of Advanced Neoplasia , 2008 .

[10]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[11]  Q. M. Jonathan Wu,et al.  Shape from focus using fast discrete curvelet transform , 2011, Pattern Recognit..

[12]  Subhasis Chaudhuri,et al.  Optimal recovery of depth from defocused images using an MRF model , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  Tien Tsin,et al.  Image Partial Blur Detection and Classification , 2013 .

[14]  Terence Sim,et al.  On the Recovery of Depth from a Single Defocused Image , 2009, CAIP.

[15]  Steven A. Shafer,et al.  Depth from focusing and defocusing , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.