Towards Intelligent Systems for Colonoscopy

Colorectal cancer is one of the leading causes of cancer related deaths. Colorectal cancer’s survival rate depends on the stage in which it is detected, decreasing from rates higher than 95% in the first stages to rates lower than 35% in stages IV and V (Tresca, A. (2010)); hence the importance of detecting it on its early stages by using screening techniques, such as colonoscopy (Hassinger, J.P., Holubar, S.D. et al. (2010)), which is still considered the gold standard for the screening of patients for colon cancers and lesions. Classical focal colonoscopy has been proved to be a successful tool for colon screening, although other tools are being also used for this purpose, such as Virtual Colonoscopy, Computed Tomography Colonoscopy, Chromoendoscopy or Wireless Capsule Video Endoscopy, among others. In this chapter we present tools that can be used to build intelligent systems for colonoscopy. The idea is, by using methods based on computer vision and artificial intelligence, add significant value to the colonoscopy procedure. Intelligent systems are being used to assist in other medical interventions. For instance, we can build systems that can be used to develop the knowledge bases used by expert systems, such as KARDIO (Bratko et al. (1990), which was developed to interpret electrocardiograms. Another example can consist of developing a system that, in the context of anesthesia, provides a robust/reliable control system that could determine the optimal infusion rate of the drugs (muscle relaxant, anesthetic, and analgesic) simultaneously, and titrate each drug in accordance to its effects and interactions. Such a system would be a valuable assistant to the anesthetist in the operating theater. An example of such a system can be found in the work of Nunes et al. (2005). More close to our topic of interest, colonoscopy, we can find many examples of intelligent systems build to assist in cancer detection. Such is the case of breast cancer detection (Wei et al. (2011)) or prostate cancer detection (Viswanath et al. (2011)). The question that arises now is: how can intelligent systems help in colonoscopy? What kind of applications these systems can be built for? In Figure 1 we depict some of the potential areas related to colonoscopy where an intelligent system can play a key role. As shown in Figure 1, we foresee four different areas where an intelligent system can be introduced and add significant value to the colonoscopy procedure:

[1]  Gerard Lacey,et al.  Indistinct Frame Detection in Colonoscopy Videos , 2009, 2009 13th International Machine Vision and Image Processing Conference.

[2]  Shankar M. Krishnan,et al.  Automated diagnosis for segmentation of colonoscopic images using chromatic features , 2002, IEEE CCECE2002. Canadian Conference on Electrical and Computer Engineering. Conference Proceedings (Cat. No.02CH37373).

[3]  N. Segnan,et al.  European guidelines for quality assurance in colorectal cancer screening and diagnosis. First Edition – Principles of evidence assessment and methods for reaching recommendations , 2012, Endoscopy.

[4]  Vitoantonio Bevilacqua,et al.  Image Processing Framework for Virtual Colonoscopy , 2009, ICIC.

[5]  A. Hasman Kardio. A study in deep and qualitative knowledge for expert systems , 1991 .

[6]  Miguel Tavares Coimbra,et al.  MPEG-7 Visual Descriptors—Contributions for Automated Feature Extraction in Capsule Endoscopy , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Lubomir M. Hadjiiski,et al.  Computer-aided detection of breast masses: four-view strategy for screening mammography. , 2011, Medical physics.

[8]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Robert R Cima,et al.  Effectiveness of a Multimedia-Based Educational Intervention for Improving Colon Cancer Literacy in Screening Colonoscopy Patients , 2010, Diseases of the colon and rectum.

[10]  H. Tian,et al.  Automatic segmentation algorithm for the extraction of lumen region and boundary from endoscopic images , 2006, Medical and Biological Engineering and Computing.

[11]  Jung-Hwan Oh,et al.  Polyp Detection in Colonoscopy Video using Elliptical Shape Feature , 2007, 2007 IEEE International Conference on Image Processing.

[12]  Gerard Lacey,et al.  Quality Improvement of Endoscopy Videos , 2010, BioMed 2010.

[13]  Fernando Vilariño,et al.  Automatic Labeling of Colonoscopy Video for Cancer Detection , 2007, IbPRIA.

[14]  M. P. Tjoa,et al.  Feature extraction for the analysis of colon status from the endoscopic images , 2003, Biomedical engineering online.

[15]  Fernando Vilariño,et al.  A Region Segmentation Method for Colonoscopy Images Using a Model of Polyp Appearance , 2011, IbPRIA.

[16]  C.S. Nunes,et al.  Comparison of Neural Networks, Fuzzy and Stochastic Prediction Models for return of consciousness after general anesthesia , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[17]  Fernando Luis,et al.  A Machine Learning Approach for Intestinal Motility Assessment with Capsule Endoscopy , 2006 .

[18]  Yu Cao,et al.  Computer-Aided Detection of Diagnostic and Therapeutic Operations in Colonoscopy Videos , 2007, IEEE Transactions on Biomedical Engineering.

[19]  Zhengrong Liang,et al.  Improved Curvature Estimation for Shape Analysis in Computer-Aided Detection of Colonic Polyps , 2010, Virtual Colonoscopy and Abdominal Imaging.

[20]  Dimitris A. Karras,et al.  Computer-aided tumor detection in endoscopic video using color wavelet features , 2003, IEEE Transactions on Information Technology in Biomedicine.

[21]  R. Doraiswami,et al.  Real-time image processing system for endoscopic applications , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[22]  Shankar M. Krishnan,et al.  Intestinal abnormality detection from endoscopic images , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[23]  Fernando Vilariño,et al.  Improving the Quality of Color Colonoscopy Videos , 2008, EURASIP J. Image Video Process..

[24]  Joan Serrat,et al.  Evaluation of Methods for Ridge and Valley Detection , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Wallapak Tavanapong,et al.  Arthemis: Annotation software in an integrated capturing and analysis system for colonoscopy , 2007, Comput. Methods Programs Biomed..

[26]  Frans Vos,et al.  Detection and Segmentation of Colonic Polyps on Implicit Isosurfaces by Second Principal Curvature Flow , 2010, IEEE Transactions on Medical Imaging.

[27]  S. Morán Sánchez,et al.  Colonoscopy quality assessment. , 2009, Revista espanola de enfermedades digestivas : organo oficial de la Sociedad Espanola de Patologia Digestiva.

[28]  Fernando Vilariño,et al.  Eye Tracking Search Patterns in Expert and Trainee Colonoscopists: A Novel Method of Assessing Endoscopic Competency? , 2009 .

[29]  Fernando Vilariño,et al.  Texture-Based Polyp Detection in Colonoscopy , 2009, Bildverarbeitung für die Medizin.

[30]  S. M. Krishnan,et al.  Quantitative parametrization of colonoscopic images by applying fuzzy technique , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[31]  Dimitris A. Karras,et al.  CoLD : a versatile detection system for colorectal lesions in endoscopy video-frames , 2002 .

[32]  Basanna V. Dhandra,et al.  Analysis of Abnormality in Endoscopic images using Combined HSI Color Space and Watershed Segmentation , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[33]  Yu Cao,et al.  Automatic measurement of quality metrics for colonoscopy videos , 2005, MULTIMEDIA '05.

[34]  Yu Cao,et al.  Measuring Objective Quality of Colonoscopy , 2009, IEEE Transactions on Biomedical Engineering.

[35]  O. Debande,et al.  Information and Communication Technologies: A Tool Empowering and Developing the Horizon of the Learner. , 2004 .

[36]  Cenk Sokmensuer,et al.  Automatic segmentation of colon glands using object-graphs , 2010, Medical Image Anal..

[37]  Peng Li,et al.  Learning a multi-size patch-based hybrid kernel machine ensemble for abnormal region detection in colonoscopic images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Avnish Rajbal Malik End of Insertion Detection in Colonoscopy Videos , 2009 .

[39]  Lin Lu,et al.  Virtual eversion and rotation of colon based on outer surface centerline. , 2010, Medical physics.

[40]  Fernando Vilariño,et al.  Current Challenges on Polyp Detection in Colonoscopy Videos: From Region Segmentation to Region Classification. a Pattern Recognition-based Approach , 2018, MIAD.

[41]  Jung-Hwan Oh,et al.  Blurry-frame detection and shot segmentation in colonoscopy videos , 2003, IS&T/SPIE Electronic Imaging.