Multi-scale Ensemble of ResNet Variants

Residual learning has become a staple in the deep learning community due to its simple yet effective design. ResNets have been successfully employed for a variety of problems (Tan et al. 2018; Chen et al. 2018; Habibzadeh et al. 2018; Putten et al. 2019). Additionally, we incorporate multi-scale information in our approach by training models with different input image resolutions. This approach is taken since multi-scale approaches have been shown to be effective for many medical image analysis problems (Litjens et al. 2017). Finally, ensembling is a good way to boost performance and ensembles have been used to win many AI competitions. These methods are especially effective when the models are diverse (Brown et al. 2005). We achieve this diversity by using different ResNet models and by employing the multi-scale approach.

[1]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.

[2]  Leslie N. Smith,et al.  Cyclical Learning Rates for Training Neural Networks , 2015, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[3]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[4]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[6]  Hossein Baharvand,et al.  Automatic white blood cell classification using pre-trained deep learning models: ResNet and Inception , 2018, International Conference on Machine Vision.

[7]  Joost van der Putten,et al.  Pseudo-labeled Bootstrapping and Multi-stage Transfer Learning for the Classification and Localization of Dysplasia in Barrett's Esophagus , 2019, MLMI@MICCAI.

[8]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Chao Yang,et al.  A Survey on Deep Transfer Learning , 2018, ICANN.

[10]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..