Eigenloss: Combined PCA-Based Loss Function for Polyp Segmentation

Colorectal cancer is one of the leading cancer death causes worldwide, but its early diagnosis highly improves the survival rates. The success of deep learning has also benefited this clinical field. When training a deep learning model, it is optimized based on the selected loss function. In this work, we consider two networks (U-Net and LinkNet) and two backbones (VGG-16 and Densnet121). We analyzed the influence of seven loss functions and used a principal component analysis (PCA) to determine whether the PCA-based decomposition allows for the defining of the coefficients of a non-redundant primal loss function that can outperform the individual loss functions and different linear combinations. The eigenloss is defined as a linear combination of the individual losses using the elements of the eigenvector as coefficients. Empirical results show that the proposed eigenloss improves the general performance of individual loss functions and outperforms other linear combinations when Linknet is used, showing potential for its application in polyp segmentation problems.

[1]  Dimitrios K. Iakovidis,et al.  An intelligent system for automatic detection of gastrointestinal adenomas in video endoscopy , 2006, Comput. Biol. Medicine.

[2]  Eugenio Culurciello,et al.  LinkNet: Exploiting encoder representations for efficient semantic segmentation , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[3]  Klaus H. Maier-Hein,et al.  Abstract: nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation , 2019, Bildverarbeitung für die Medizin.

[4]  Eyal Klang,et al.  Deep learning for wireless capsule endoscopy: a systematic review and meta-analysis. , 2020, Gastrointestinal endoscopy.

[5]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  J. M. García-Gómez,et al.  Definition of loss functions for learning from imbalanced data to minimize evaluation metrics. , 2015, Methods in molecular biology.

[7]  Wenjia Bai,et al.  High-quality segmentation of low quality cardiac MR images using k-space artefact correction , 2018, MIDL.

[8]  A. Jemal,et al.  Cancer statistics, 2020 , 2020, CA: a cancer journal for clinicians.

[9]  Marius Pedersen,et al.  Y-Net: A deep Convolutional Neural Network for Polyp Detection , 2018, BMVC.

[10]  Aymeric Histace,et al.  Comparative Validation of Polyp Detection Methods in Video Colonoscopy: Results From the MICCAI 2015 Endoscopic Vision Challenge , 2017, IEEE Transactions on Medical Imaging.

[11]  Septimiu E. Salcudean,et al.  Reducing the Hausdorff Distance in Medical Image Segmentation With Convolutional Neural Networks , 2019, IEEE Transactions on Medical Imaging.

[12]  Ritu Maheshwari,et al.  Comparative Analysis of Different Loss Functions for Deep Face Recognition , 2019, ACAI 2019.

[13]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[14]  Begoña García Zapirain,et al.  Automatized colon polyp segmentation via contour region analysis , 2018, Comput. Biol. Medicine.

[15]  Matthew B. Blaschko,et al.  The Lovasz-Softmax Loss: A Tractable Surrogate for the Optimization of the Intersection-Over-Union Measure in Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[16]  Joan Bruna,et al.  Training Convolutional Networks with Noisy Labels , 2014, ICLR 2014.

[17]  Russell C. Hardie,et al.  A Computationally Efficient U-Net Architecture for Lung Segmentation in Chest Radiographs , 2019, 2019 IEEE National Aerospace and Electronics Conference (NAECON).

[18]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[20]  M. Kholiavchenko,et al.  Contour-aware multi-label chest X-ray organ segmentation , 2020, International Journal of Computer Assisted Radiology and Surgery.

[21]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Consuelo Gonzalo-Martín,et al.  Convolutional neural networks for segmenting xylem vessels in stained cross-sectional images , 2019, Neural Computing and Applications.

[23]  Vahide Babaiyan,et al.  Combination of loss functions for robust breast cancer prediction , 2020, Comput. Electr. Eng..

[24]  Antonio J. Plaza,et al.  Image Segmentation Using Deep Learning: A Survey , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Wei Zheng,et al.  Near-infrared autofluorescence spectroscopy for in vivo identification of hyperplastic and adenomatous polyps in the colon. , 2011, Biosensors & bioelectronics.

[26]  Aaron Carass,et al.  Why rankings of biomedical image analysis competitions should be interpreted with care , 2018, Nature Communications.

[27]  Yuji Iwahori,et al.  Automatic Polyp Detection from Endoscope Image using Likelihood Map based on Edge Information , 2017, ICPRAM.

[28]  H. Bartsch,et al.  International Agency for Research on Cancer. , 1969, WHO chronicle.

[29]  Jun Guo,et al.  Making Deep Neural Networks Robust to Label Noise: Cross-Training With a Novel Loss Function , 2019, IEEE Access.

[30]  Juan de Lara,et al.  Supporting user-oriented analysis for multi-view domain-specific visual languages , 2009, Inf. Softw. Technol..

[31]  Alexey Shvets,et al.  TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation , 2018, Computer-Aided Analysis of Gastrointestinal Videos.

[32]  Priyam Garg,et al.  Lung tuberculosis detection using anti-aliased convolutional networks , 2020 .

[33]  M. Byrne,et al.  Will Computer-Aided Detection and Diagnosis Revolutionize Colonoscopy? , 2017, Gastroenterology.

[34]  Peerapon Vateekul,et al.  Real-Time Polyps Segmentation for Colonoscopy Video Frames Using Compressed Fully Convolutional Network , 2018, MMM.

[35]  Barbara Villarini,et al.  Advancing Pancreas Segmentation in Multi-protocol MRI Volumes Using Hausdorff-Sine Loss Function , 2019, MLMI@MICCAI.

[36]  Ho-Jin Choi,et al.  Clinical opinions generation from general blood test results using deep neural network with principle component analysis and regularization , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[37]  Julien Cohen-Adad,et al.  Deep semantic segmentation of natural and medical images: a review , 2019, Artificial Intelligence Review.

[38]  C. la Vecchia,et al.  European cancer mortality predictions for the year 2020 with a focus on prostate cancer. , 2020, Annals of oncology : official journal of the European Society for Medical Oncology.

[39]  Deniz Erdogmus,et al.  Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks , 2017, MLMI@MICCAI.

[40]  Naimul Mefraz Khan,et al.  A Novel Focal Tversky Loss Function With Improved Attention U-Net for Lesion Segmentation , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[41]  Hongliang Ren,et al.  Ultrasound needle segmentation and trajectory prediction using excitation network , 2020, International Journal of Computer Assisted Radiology and Surgery.

[42]  P. Jaccard THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.1 , 1912 .

[43]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[44]  Luis Bote-Curiel,et al.  Deep learning to find colorectal polyps in colonoscopy: A systematic literature review , 2020, Artif. Intell. Medicine.

[45]  Yang Wang,et al.  Optimizing Intersection-Over-Union in Deep Neural Networks for Image Segmentation , 2016, ISVC.

[46]  J. Ioannidis,et al.  Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies , 2020, BMJ.

[47]  A. Tversky Features of Similarity , 1977 .

[48]  W. G. Gonçalves,et al.  Deep learning in gastric tissue diseases: a systematic review , 2020, BMJ open gastroenterology.

[49]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[50]  Fernando Vilariño,et al.  WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians , 2015, Comput. Medical Imaging Graph..

[51]  Klaus H. Maier-Hein,et al.  nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation , 2018, Bildverarbeitung für die Medizin.

[52]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Björn Schuller,et al.  Analysis of loss functions for fast single-class classification , 2019, Knowledge and Information Systems.

[54]  Jose Dolz,et al.  Boundary loss for highly unbalanced segmentation , 2018, MIDL.

[55]  Yunchao Wei,et al.  CCNet: Criss-Cross Attention for Semantic Segmentation , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[56]  Nader Karimi,et al.  Deep Neural Network based Polyp Segmentation in Colonoscopy Images using a Combination of Color Spaces , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[57]  Nima Tajbakhsh,et al.  Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation , 2019, Medical Image Anal..

[58]  Tian Liu,et al.  Deeply supervised 3D fully convolutional networks with group dilated convolution for automatic MRI prostate segmentation , 2019, Medical physics.

[59]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[60]  Vijayan K. Asari,et al.  Nuclei Segmentation with Recurrent Residual Convolutional Neural Networks based U-Net (R2U-Net) , 2018, NAECON 2018 - IEEE National Aerospace and Electronics Conference.

[61]  Alexander Rakhlin,et al.  Automatic Instrument Segmentation in Robot-Assisted Surgery Using Deep Learning , 2018, bioRxiv.

[62]  J. A. López del Val,et al.  Principal Components Analysis , 2018, Applied Univariate, Bivariate, and Multivariate Statistics Using Python.

[63]  Ning Li,et al.  Random Drop Loss for Tiny Object Segmentation: Application to Lesion Segmentation in Fundus Images , 2019, ICANN.

[64]  Shervin Minaee,et al.  An ADMM Approach to Masked Signal Decomposition Using Subspace Representation , 2017, IEEE Transactions on Image Processing.

[65]  Michael Kampffmeyer,et al.  UNCERTAINTY MODELING AND INTERPRETABILITY IN CONVOLUTIONAL NEURAL NETWORKS FOR POLYP SEGMENTATION , 2018, 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP).

[66]  Fernando Vilariño,et al.  Texture-Based Polyp Detection in Colonoscopy , 2009, Bildverarbeitung für die Medizin.

[67]  Abeer Alsadoon,et al.  A novel enhanced softmax loss function for brain tumour detection using deep learning , 2019, Journal of Neuroscience Methods.

[68]  E. Topol,et al.  A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. , 2019, The Lancet. Digital health.

[69]  Michael K.L. Ko,et al.  New insights on missed colonic lesions during colonoscopy through artificial intelligence-assisted real-time detection (with video). , 2020, Gastrointestinal endoscopy.

[70]  Shadrokh Samavi,et al.  Gland Segmentation in Histopathology Images Using Deep Networks and Handcrafted Features , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[71]  Fernando Vilariño,et al.  Towards automatic polyp detection with a polyp appearance model , 2012, Pattern Recognit..

[72]  Youngsam Kim,et al.  A Performance Comparison of Loss Functions , 2019, 2019 International Conference on Information and Communication Technology Convergence (ICTC).

[73]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[74]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[75]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[76]  Vahid Ghodrati,et al.  MR image reconstruction using deep learning: evaluation of network structure and loss functions. , 2019, Quantitative imaging in medicine and surgery.

[77]  Norman Cliff,et al.  The eigenvalues-greater-than-one rule and the reliability of components. , 1988 .

[78]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[79]  Antonio M. López,et al.  A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images , 2016, Journal of healthcare engineering.