Utilizing Mask R-CNN for Detection and Segmentation of Oral Diseases

In this paper, we demonstrate the application of Mask-RCNN, the state-of-the-art convolutional neural network algorithm for object detection and segmentation to the oral pathology domain. Mask-RCNN was originally developed for object detection, and object instance segmentation of natural images. With this experiment, we show that Mask-RCNN can also be used in a very specialized area such as oral pathology. While the number of oral diseases are numerous and varied in the form of Thrush, Leukoplakia, Lichenplanus, etc., we limited our scope to the detection and instance segmentation of two of the most commonly occurring conditions, herpes labialis (commonly referred to as “cold sore“ and aphthous ulcer (commonly referred to as “canker sore“ This paper aims at detecting and segmenting cold sores and canker sores only. As always, no computer based detection system can be 100% reliable. An accurate diagnosis by a trained health care professional is necessary since several conditions of the mouth including oral cancer may mimic canker sores.

[1]  Neeraj Sharma,et al.  Automated medical image segmentation techniques , 2010, Journal of medical physics.

[2]  Hamid Soltanian-Zadeh,et al.  Medical Image Segmentation Using Artificial Neural Networks , 2011 .

[3]  Abdolvahab Ehsani Rad,et al.  Digital Dental X-Ray Image Segmentation and Feature Extraction , 2013 .

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  Anna Fabijanska,et al.  Segmentation of corneal endothelium images using a U-Net-based convolutional neural network , 2018, Artif. Intell. Medicine.

[6]  Sébastien Ourselin,et al.  Automatic Brain Tumor Segmentation Using Cascaded Anisotropic Convolutional Neural Networks , 2017, BrainLes@MICCAI.

[7]  Yugyung Lee,et al.  Oro Vision: Deep Learning for Classifying Orofacial Diseases , 2017, 2017 IEEE International Conference on Healthcare Informatics (ICHI).

[8]  R. Nagaraj,et al.  Classification of dental diseases using CNN and transfer learning , 2017, 2017 5th International Symposium on Computational and Business Intelligence (ISCBI).

[9]  Otkrist Gupta,et al.  Automated segmentation of gingival diseases from oral images , 2017, 2017 IEEE Healthcare Innovations and Point of Care Technologies (HI-POCT).

[10]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[11]  Jeremiah W. Johnson,et al.  Adapting Mask-RCNN for Automatic Nucleus Segmentation , 2018, ArXiv.

[12]  D. Mollura,et al.  Segmentation and Image Analysis of Abnormal Lungs at CT: Current Approaches, Challenges, and Future Trends. , 2015, Radiographics : a review publication of the Radiological Society of North America, Inc.

[13]  M. Alcañiz,et al.  Computer-aided periodontal disease diagnosis using computer vision. , 1999, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[14]  M. Kuriakose.  Contemporary Oral Oncology: Rehabilitation and Supportive Care , 2017 .

[15]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[16]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[17]  Ngai-Man Cheung,et al.  Accessible Melanoma Detection Using Smartphones and Mobile Image Analysis , 2017, IEEE Transactions on Multimedia.

[18]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[19]  Wilfried Philips,et al.  MRI Segmentation of the Human Brain: Challenges, Methods, and Applications , 2015, Comput. Math. Methods Medicine.

[20]  Anne E Carpenter,et al.  Opportunities and obstacles for deep learning in biology and medicine , 2017, bioRxiv.