Meta Ordinal Regression Forest for Medical Image Classification With Ordinal Labels

The performance of medical image classification has been enhanced by deep convolutional neural networks (CNNs), which are typically trained with cross-entropy (CE) loss. However, when the label presents an intrinsic ordinal property in nature, e.g., the development from benign to malignant tumor, CE loss cannot take into account such ordinal information to allow for better generalization. To improve model generalization with ordinal information, we propose a novel meta ordinal regression forest (MORF) method for medical image classification with ordinal labels, which learns the ordinal relationship through the combination of convolutional neural network and differential forest in a meta-learning framework. The merits of the proposed MORF come from the following two components: A tree-wise weighting net (TWW-Net) and a grouped feature selection (GFS) module. First, the TWW-Net assigns each tree in the forest with a specific weight that is mapped from the classification loss of the corresponding tree. Hence, all the trees possess varying weights, which is helpful for alleviating the tree-wise prediction variance. Second, the GFS module enables a dynamic forest rather than a fixed one that was previously used, allowing for random feature perturbation. During training, we alternatively optimize the parameters of the CNN backbone and TWW-Net in the meta-learning framework through calculating the Hessian matrix. Experimental results on two medical image classification datasets with ordinal labels, i.e., LIDC-IDRI and Breast Ultrasound datasets, demonstrate the superior performances of our MORF method over existing state-of-the-art methods.

[1]  Guanjun Liu,et al.  CEModule: A Computation Efficient Module for Lightweight Convolutional Neural Networks , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Junping Zhang,et al.  Strided Self-Supervised Low-Dose CT Denoising for Lung Nodule Classification , 2021, Phenomics.

[3]  Li Hou,et al.  CurveNet: Curvature-Based Multitask Learning Deep Networks for 3D Object Recognition , 2021, IEEE/CAA Journal of Automatica Sinica.

[4]  Guanjun Liu,et al.  Pneumothorax Segmentation in Routine Computed Tomography Based on Deep Neural Networks , 2021, 2021 4th International Conference on Intelligent Autonomous Systems (ICoIAS).

[5]  Jianbo Shi,et al.  Convolutional Ordinal Regression Forest for Image Ordinal Estimation , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Hongming Shan,et al.  Meta Ordinal Regression Forest For Learning with Unsure Lung Nodules , 2020, 2020 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[7]  Chungang Yan,et al.  Pairwise Gaussian Loss for Convolutional Neural Networks , 2020, IEEE Transactions on Industrial Informatics.

[8]  Shuo Li,et al.  3D shape reconstruction of lumbar vertebra from two X-ray images and a CT model , 2020, IEEE/CAA Journal of Automatica Sinica.

[9]  Maryellen L. Giger,et al.  A deep learning methodology for improved breast cancer diagnosis using multiparametric MRI , 2020, Scientific Reports.

[10]  Lanfen Lin,et al.  UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Yi Wang,et al.  Breast Cancer Classification in Automated Breast Ultrasound Using Multiview Convolutional Neural Network with Transfer Learning. , 2020, Ultrasound in medicine & biology.

[12]  Yuanshen Zhao,et al.  Deep Learning vs. Radiomics for Predicting Axillary Lymph Node Metastasis of Breast Cancer Using Ultrasound Images: Don't Forget the Peritumoral Region , 2020, Frontiers in Oncology.

[13]  Yanwei Pang,et al.  CGNet: cross-guidance network for semantic segmentation , 2020, Science China Information Sciences.

[14]  Haojie Li,et al.  Multi-attention based cross-domain beauty product image retrieval , 2020, Science China Information Sciences.

[15]  Walid Al-Dhabyani,et al.  Dataset of breast ultrasound images , 2019, Data in brief.

[16]  Hanzi Wang,et al.  Large margin deep embedding for aesthetic image classification , 2019, Science China Information Sciences.

[17]  Yizhou Wang,et al.  Learning With Unsure Data for Medical Image Diagnosis , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[18]  Roie Melamed,et al.  Predicting Breast Cancer by Applying Deep Learning to Linked Health Records and Mammograms. , 2019, Radiology.

[19]  Amit Marathe,et al.  Soft Labels for Ordinal Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Hongming Shan,et al.  Ordinal distribution regression for gait-based age estimation , 2019, Science China Information Sciences.

[21]  Qi Wu,et al.  Medical image classification using synergic deep learning , 2019, Medical Image Anal..

[22]  Geoffrey G. Zhang,et al.  Detection and classification the breast tumors using mask R-CNN on sonograms , 2019, Medicine.

[23]  A. Boss,et al.  Automatic classification of ultrasound breast lesions using a deep convolutional neural network mimicking human decision-making , 2019, European Radiology.

[24]  Nan Wu,et al.  Deep Neural Networks Improve Radiologists’ Performance in Breast Cancer Screening , 2019, IEEE Transactions on Medical Imaging.

[25]  Qi Xie,et al.  Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting , 2019, NeurIPS.

[26]  Mohammad Sohel Rahman,et al.  MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation , 2019, Neural Networks.

[27]  Andrew J. Davison,et al.  Self-Supervised Generalisation with Meta Auxiliary Learning , 2019, NeurIPS.

[28]  Guanjun Liu,et al.  Refined Weighted Random Forest and Its Application to Credit Card Fraud Detection , 2018, CSoNet.

[29]  Peng Liu,et al.  3D Convolutional Neural Networks Fusion Model for Lung Nodule Detection onClinical CT Scans , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[30]  M. Kalra,et al.  Shape and margin-aware lung nodule classification in low-dose CT images via soft activation mapping , 2018, Medical Image Anal..

[31]  Chao Yang,et al.  Ordinal Regression with Neuron Stick-Breaking for Medical Diagnosis , 2018, ECCV Workshops.

[32]  Albert Gubern-Mérida,et al.  Improving Breast Cancer Detection using Symmetry Information with Deep Learning , 2018, RAMBO+BIA+TIA@MICCAI.

[33]  Mubarak Shah,et al.  Task Agnostic Meta-Learning for Few-Shot Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Uwe Kruger,et al.  3-D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning From a 2-D Trained Network , 2018, IEEE Transactions on Medical Imaging.

[35]  Bo Wang,et al.  Deep Regression Forests for Age Estimation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[36]  Emanuele Pesce,et al.  Learning to detect chest radiographs containing pulmonary lesions using visual attention networks , 2017, Medical Image Anal..

[37]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[38]  Xiaohui Xie,et al.  DeepLung: 3D Deep Convolutional Nets for Automated Pulmonary Nodule Detection and Classification , 2017, bioRxiv.

[39]  Li Shen,et al.  Deep Learning to Improve Breast Cancer Detection on Screening Mammography , 2017, Scientific Reports.

[40]  Christopher Joseph Pal,et al.  Unimodal Probability Distributions for Deep Ordinal Classification , 2017, ICML.

[41]  Aimin Hao,et al.  A CADe system for nodule detection in thoracic CT images based on artificial neural network , 2017, Science China Information Sciences.

[42]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[43]  Ulas Bagci,et al.  TumorNet: Lung nodule characterization using multi-view Convolutional Neural Network with Gaussian Process , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[44]  Kai Zhao,et al.  Label Distribution Learning Forests , 2017, NIPS.

[45]  Wojciech Czarnecki,et al.  On Loss Functions for Deep Neural Networks in Classification , 2017, ArXiv.

[46]  Gustavo Carneiro,et al.  The Automated Learning of Deep Features for Breast Mass Classification from Mammograms , 2016, MICCAI.

[47]  Wagner Coelho de Albuquerque Pereira,et al.  Breast tumor classification in ultrasound images using support vector machines and neural networks , 2016 .

[48]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[49]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Peter Kontschieder,et al.  Deep Neural Decision Forests , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[51]  Wei Shen,et al.  Multi-scale Convolutional Neural Networks for Lung Nodule Classification , 2015, IPMI.

[52]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[53]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[54]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[55]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[56]  Eibe Frank,et al.  A Simple Approach to Ordinal Classification , 2001, ECML.

[57]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[58]  Hongming Shan,et al.  Enhancing Transferability of Features from Pretrained Deep Neural Networks for Lung Nodule Classification , 2017 .

[59]  Qi Dou Multi-level Contextual 3D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017 .

[60]  Pedro Antonio Gutiérrez,et al.  Ordinal Regression Methods: Survey and Experimental Study , 2016, IEEE Transactions on Knowledge and Data Engineering.

[61]  L. Breiman Random Forests , 2001, Machine Learning.