Medical image segmentation algorithm based on positive scaling invariant-self encoding CCA

Abstract The quality of medical image segmentation results directly affect disease analysis and diagnosis. Although traditional medical image segmentation methods have achieved certain results, this type of method is not only computationally inefficient, but also difficult to achieve fully automatic segmentation. Deep learning has a good generalization ability, which provides a new technical approach to solve the above problems. However, the following problems exist in the application of deep learning in medical image segmentation: (1) Optimization of deep learning models. The parameters of the existing deep learning model have not been well optimized; it is easy to cause wrong medical image segmentation. (2) Overfitting problem. As the number of deep learning model layers increases, it makes the deep model fit the training data easily, but its generalization performance on the test set will be poor. In view of this, in order to solve the problem of deep learning model optimization, this paper first reveals that the weight space of deep learning is not equivalent to its parameter space, and explains in detail how to optimize the deep learning model in a positive scaling invariant space. The method of mapping the derivative of the base path back to the weight, and analyzed the stochastic optimization algorithm in F space. In addition, to solve the overfitting problem of deep learning models, this paper first gives a method of self-encoding Canonical Correlation Analysis (Self-encoding CCA) to optimize both self-coding loss and correlation loss in the fine-tuning stage. Based on the above ideas, this paper proposes a medical image segmentation algorithm based on positive scaling invariant-self encoding CCA. The experimental results show that the index obtained by the method proposed in this paper is not only improved by a large margin compared with traditional machine learning methods, but also improved to a certain extent compared with other deep learning methods.

[1]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Tao Xu,et al.  SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation , 2017, Neuroinformatics.

[3]  Frédo Durand,et al.  Data augmentation using learned transforms for one-shot medical image segmentation , 2019, ArXiv.

[4]  Shuxu Guo,et al.  Liver lesion segmentation in CT images with MK-FCN , 2017, 2017 IEEE 2nd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC).

[5]  Polina Golland,et al.  Contour-Driven Regression for Label Inference in Atlas-Based Segmentation , 2013, MICCAI.

[6]  Hojjat Adeli,et al.  Imaging and machine learning techniques for diagnosis of Alzheimer’s disease , 2016, Reviews in the neurosciences.

[7]  Hedva Spitzer,et al.  Multi-scale texture-based level-set segmentation of breast B-mode images , 2016, Comput. Biol. Medicine.

[8]  D. Rathburn.  5 Ways to Shave Test Time , 2000 .

[9]  Lorenzo Bruzzone,et al.  Cross-Domain Collaborative Learning via Cluster Canonical Correlation Analysis and Random Walker for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Frank Lindseth,et al.  Medical image segmentation on GPUs - A comprehensive review , 2015, Medical Image Anal..

[11]  K. Ashok Kumar,et al.  A neural network based deep learning approach for efficient segmentation of brain tumor medical image data , 2019, J. Intell. Fuzzy Syst..

[12]  Julien Rabin,et al.  Detecting Overfitting of Deep Generative Networks via Latent Recovery , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Christopher Joseph Pal,et al.  Learning normalized inputs for iterative estimation in medical image segmentation , 2017, Medical Image Anal..

[14]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[15]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[16]  Jian Yang,et al.  Feature Learning Based Random Walk for Liver Segmentation , 2016, PloS one.

[17]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Jin Young Kim,et al.  White Matter, Gray Matter and Cerebrospinal Fluid Segmentation from Brain 3D MRI Using B-UNET , 2019, VipIMAGE 2019.

[19]  Chen Sun,et al.  Revisiting Unreasonable Effectiveness of Data in Deep Learning Era , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Soumik Sarkar,et al.  LLNet: A deep autoencoder approach to natural low-light image enhancement , 2015, Pattern Recognit..

[21]  Manoj Kumar Tiwari,et al.  An efficient recommendation generation using relevant Jaccard similarity , 2019, Inf. Sci..

[22]  Hao Chen,et al.  3D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumes , 2016, MICCAI.

[23]  Michael Brady,et al.  Segmentation of ultrasound B-mode images with intensity inhomogeneity correction , 2002, IEEE Transactions on Medical Imaging.

[24]  Polina Golland,et al.  Contour-Driven Atlas-Based Segmentation. , 2015, IEEE transactions on medical imaging.

[25]  Bulat Ibragimov,et al.  Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks , 2017, Medical physics.

[26]  Liang Chen,et al.  DRINet for Medical Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[27]  A Horsman,et al.  Tumour volume determination from MR images by morphological segmentation , 1996, Physics in medicine and biology.

[28]  Wei Hu,et al.  Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced , 2018, NeurIPS.

[29]  James M. Brown,et al.  High-resolution medical image synthesis using progressively grown generative adversarial networks , 2018, ArXiv.

[30]  Jan J. Gerbrands,et al.  Transition region determination based thresholding , 1991, Pattern Recognit. Lett..

[31]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[32]  Ronald M. Summers,et al.  Automated segmentation of thyroid gland on CT images with multi-atlas label fusion and random classification forest , 2015, Medical Imaging.

[33]  Raymond Y Huang,et al.  Artificial intelligence in cancer imaging: Clinical challenges and applications , 2019, CA: a cancer journal for clinicians.

[34]  Ting-Yu Chen,et al.  Remoteness index-based Pythagorean fuzzy VIKOR methods with a generalized distance measure for multiple criteria decision analysis , 2018, Inf. Fusion.

[35]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[36]  David Dagan Feng,et al.  Atlas registration and ensemble deep convolutional neural network-based prostate segmentation using magnetic resonance imaging , 2018, Neurocomputing.

[37]  Lingling Qiao,et al.  A new image segmentation method based on partial adaptive thresholds , 2016, International Conference on Digital Image Processing.

[38]  Vinod Kumar,et al.  A novel content-based active contour model for brain tumor segmentation. , 2012, Magnetic resonance imaging.

[39]  Ruslan Salakhutdinov,et al.  Path-Normalized Optimization of Recurrent Neural Networks with ReLU Activations , 2016, NIPS.

[40]  Fan Tang,et al.  Deep-learning-based detection and segmentation of organs at risk in nasopharyngeal carcinoma computed tomographic images for radiotherapy planning , 2018, European Radiology.

[41]  Lijuan Qin,et al.  Study on MRI Medical Image Segmentation Technology Based on CNN-CRF Model , 2020, IEEE Access.

[42]  Xiang Li,et al.  Deep Learning-Based Image Segmentation on Multimodal Medical Imaging , 2019, IEEE Transactions on Radiation and Plasma Medical Sciences.

[43]  David Zhang,et al.  Robust single-object image segmentation based on salient transition region , 2016, Pattern Recognit..

[44]  Lian-Wen Jin,et al.  A robust graph-based segmentation method for breast tumors in ultrasound images. , 2012, Ultrasonics.

[45]  Nuo Tong,et al.  Fully automatic multi‐organ segmentation for head and neck cancer radiotherapy using shape representation model constrained fully convolutional neural networks , 2018, Medical physics.

[46]  C. A. Rodriguez,et al.  Adaptive thresholding by region of interest applied to quality control of gas electron multiplier foils , 2016, 2016 XXI Symposium on Signal Processing, Images and Artificial Vision (STSIVA).

[47]  X. Jiang,et al.  Automated delineation of organs-at-risk in head and neck CT images using multi-output support vector regression , 2018, Medical Imaging.

[48]  Wei Zhang,et al.  Adaptive threshold selection for background removal in fringe projection profilometry , 2017 .

[49]  Anders L. Madsen,et al.  Operationalising ecosystem service assessment in Bayesian Belief Networks: experiences within the OpenNESS project , 2017 .

[50]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[51]  Yaoqin Xie,et al.  Efficient Segmentation of a Breast in B-Mode Ultrasound Tomography Using Three-Dimensional GrabCut (GC3D) , 2017, Sensors.

[52]  Max A. Little,et al.  Machine learning for large‐scale wearable sensor data in Parkinson's disease: Concepts, promises, pitfalls, and futures , 2016, Movement disorders : official journal of the Movement Disorder Society.

[53]  Fagui Liu,et al.  An Ensemble Model Based on Adaptive Noise Reducer and Over-Fitting Prevention LSTM for Multivariate Time Series Forecasting , 2019, IEEE Access.

[54]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[55]  Karl Rohr,et al.  Multi-channel Deep Transfer Learning for Nuclei Segmentation in Glioblastoma Cell Tissue Images , 2018, Bildverarbeitung für die Medizin.

[56]  Ewout W. Steyerberg,et al.  Overfitting and optimism in prediction models , 2009 .

[57]  Dinggang Shen,et al.  Interleaved 3D-CNNs for joint segmentation of small-volume structures in head and neck CT images. , 2018, Medical physics.

[58]  Ming Zhang,et al.  Overfitting remedy by sparsifying regularization on fully-connected layers of CNNs , 2019, Neurocomputing.