Tympanic membrane segmentation in otoscopic images based on fully convolutional network with active contour loss

This paper presents a method to automatically segment tympanic membranes (TMs) from video-otoscopic images based on the deep learning approach. The paper introduces a hybrid loss function combining the Dice loss and active contour loss to the fully convolutional network. By this way, the proposed model takes into account the Dice similarity and the desired boundary contour information including the contour length as well as regions inside and outside the contour during learning. The proposed loss function is then applied to the fully convolutional network for tympanic membrane segmentation. We evaluate the proposed approach on TMs data set which includes 1139 otoscopic images from patients diagnosed with and without otitis media. Experimental results show that the proposed deep learning model achieves an average Dice similarity coefficient of 0.895, a mean Hausdorff distance of 19.189, and average perpendicular distance of 6.429, that outperforms other state-of-the-art methods.

[1]  Majid Mirmehdi,et al.  Detecting Abnormalities in Tympanic Membrane Images , 2005 .

[2]  Phi Vu Tran,et al.  A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI , 2016, ArXiv.

[3]  Daniel Rueckert,et al.  Deep nested level sets: Fully automated segmentation of cardiac MR images in patients with pulmonary hypertension , 2018, MICCAI.

[4]  Ravi Bansal,et al.  Segmentation of Dynamic N-D Data Sets via Graph Cuts Using Markov Models , 2001, MICCAI.

[5]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[6]  You-Ju Chen,et al.  Pediatric otitis media in Fiji: Survey findings 2015. , 2016, International journal of pediatric otorhinolaryngology.

[7]  Tony F. Chan,et al.  Active Contours without Edges for Vector-Valued Images , 2000, J. Vis. Commun. Image Represent..

[8]  Kuo-Kai Shyu,et al.  Zernike moment and local distribution fitting fuzzy energy-based active contours for image segmentation , 2014, Signal Image Video Process..

[9]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Hamid Jafarkhani,et al.  A combined deep-learning and deformable-model approach to fully automatic segmentation of the left ventricle in cardiac MRI , 2015, Medical Image Anal..

[12]  Bayram Akdemir,et al.  Cell‐type based semantic segmentation of histopathological images using deep convolutional neural networks , 2019, Int. J. Imaging Syst. Technol..

[13]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[14]  L. Hunter,et al.  Quantitative Analysis of Tympanic Membrane Disease Using Video‐Otoscopy , 2000, The Laryngoscope.

[15]  Bryan M. Williams,et al.  Learning Active Contour Models for Medical Image Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Eros Comunello,et al.  A computational method for the semi-automated quantitative analysis of tympanic membrane perforations and tympanosclerosis , 2009, Comput. Biol. Medicine.

[17]  Guodong Wang,et al.  Some fast projection methods based on Chan-Vese model for image segmentation , 2014, EURASIP Journal on Image and Video Processing.

[18]  Lin Huang,et al.  Skin lesion segmentation using object scale-oriented fully convolutional neural networks , 2019, Signal Image Video Process..

[19]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[20]  Wei Lu,et al.  Deep learning for variational multimodality tumor segmentation in PET/CT , 2020, Neurocomputing.

[21]  Bayram Akdemir,et al.  A convolutional neural network model for semantic segmentation of mitotic events in microscopy images , 2018, Neural Computing and Applications.

[22]  R. Rosenfeld,et al.  The diagnosis and management of acute otitis media. , 2013, Pediatrics.

[23]  M. Lo,et al.  Development of an Automatic Diagnostic Algorithm for Pediatric Otitis Media. , 2018, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[24]  Xun Wang,et al.  A comparative study of deformable contour methods on medical image segmentation , 2008, Image Vis. Comput..

[25]  Pa-Chun Wang,et al.  A hybrid feature-based segmentation and classification system for the computer aided self-diagnosis of otitis media , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Jussi Tohka,et al.  Surface Extraction from Volumetric Images Using Deformable Meshes: A Comparative Study , 2002, ECCV.

[27]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[28]  Şaban Öztürk,et al.  Convolution Kernel Size Effect on Convolutional Neural Network in Histopathological Image Processing Applications , 2018, 2018 International Symposium on Fundamentals of Electrical Engineering (ISFEE).

[29]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[30]  Aaron E. Carroll,et al.  The Diagnosis and Management of Acute Otitis Media , 2013, Pediatrics.

[31]  Boudewijn P. F. Lelieveldt,et al.  A multiresolution image segmentation technique based on pyramidal segmentation and fuzzy clustering , 2000, IEEE Trans. Image Process..

[32]  C-Y Hsu,et al.  A computer program to calculate the size of tympanic membrane perforations. , 2004, Clinical otolaryngology and allied sciences.

[33]  Tal Marom,et al.  Decrease in Pneumococcal Otitis Media Cultures With Concomitant Increased Antibiotic Susceptibility in the Pneumococcal Conjugate Vaccines Era. , 2017, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[34]  Martin D. Fox,et al.  Erratum: Distance regularized level set evolution and its application to image segmentation (IEEE Transactions on Image Processingvol (2010) 19:12 (3243-3254)) , 2011 .

[35]  T S Ibekwe,et al.  Quantitative analysis of tympanic membrane perforation: a simple and reliable method. , 2009, The Journal of laryngology and otology.

[36]  Xavier Bresson,et al.  Fast Global Minimization of the Active Contour/Snake Model , 2007, Journal of Mathematical Imaging and Vision.

[37]  Pa-Chun Wang,et al.  Incidence and recurrence of acute otitis media in Taiwan's pediatric population , 2011, Clinics.