The assessment of small bowel motility with attentive deformable neural network

Abstract The small bowel is the longest part of the gastrointestinal tract and quick assessment of its motility using Cine-MRI is conducive to the diagnosis of gastroenteric diseases. Because of the complex shape changes that occur frequently in the small bowel, approaches involving human designed features and simple convolutional neural network (CNN) methods fail to achieve satisfactory performance on massive datasets. To meet the challenge of assessing small bowel motility automatically, we propose the integration of deformable convolutional networks into attentive encoder–decoder. With the help of deformable convolution, a tailored CNN can track small bowel segments in different shapes from each MR image of a Cine-MRI sequence. The proposed attentive encoder–decoder performed significantly better than conventional recurrent neural network (RNN) in the assessment of small bowel motility. Experimental results demonstrate that the proposed method not only automatically assesses small bowel motility correctly, but also outperforms state-of-the-art methods. Furthermore, it provides useful information about the physiology of small bowel motility patterns, which can be used in the diagnosis of gastroenteric diseases.

[1]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[2]  Le Zhang,et al.  A survey of randomized algorithms for training neural networks , 2016, Inf. Sci..

[3]  Yen-Wei Chen,et al.  Quantitative Assessment of Small Bowel Motility Using Cine MR Sequence Images and Superpixels , 2017 .

[4]  Quan Pan,et al.  A Generative Model for category text generation , 2018, Inf. Sci..

[5]  Ronald M. Summers,et al.  Holistic classification of CT attenuation patterns for interstitial lung diseases via deep convolutional neural networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[6]  Anjan Gudigar,et al.  Deep convolution neural network for accurate diagnosis of glaucoma using digital fundus images , 2018, Inf. Sci..

[7]  Hermann Ney,et al.  Segmental Encoder-Decoder Models for Large Vocabulary Automatic Speech Recognition , 2018, INTERSPEECH.

[8]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[9]  B. Rosen,et al.  Lower Gastrointestinal Tract Applications of PET/Computed Tomography and PET/MR Imaging. , 2018, Radiologic clinics of North America.

[10]  Lei Guo,et al.  Exploring Hierarchical Convolutional Features for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[12]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[13]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[14]  Srikrishna Varadarajan,et al.  RADnet: Radiologist level accuracy using deep learning for hemorrhage detection in CT scans , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[15]  J. Stoker,et al.  Evaluation of gastrointestinal motility with MRI: Advances, challenges and opportunities , 2018, Neurogastroenterology and motility : the official journal of the European Gastrointestinal Motility Society.

[16]  D. Atkinson,et al.  Dynamic MRI for bowel motility imaging—how fast and how long? , 2018, The British journal of radiology.

[17]  S. Bickelhaupt,et al.  Automated small bowel motility measurements in MRI using 2D coronal slices - does the intrasegmental location matter? A pilot study. , 2015, Clinical imaging.

[18]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[19]  Thomas J. Fuchs,et al.  DeepPET: A deep encoder–decoder network for directly solving the PET image reconstruction inverse problem , 2018, Medical Image Anal..

[20]  Hayit Greenspan,et al.  Chest pathology identification using deep feature selection with non-medical training , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[21]  Tuan D. Pham,et al.  DUNet: A deformable network for retinal vessel segmentation , 2018, Knowl. Based Syst..

[22]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[23]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Johannes M Froehlich,et al.  Small bowel motility assessment with magnetic resonance imaging , 2005, Journal of magnetic resonance imaging : JMRI.

[26]  David Atkinson,et al.  Quantitative assessment of small bowel motility by nonrigid registration of dynamic MR images , 2012, Magnetic resonance in medicine.

[27]  Yike Guo,et al.  Small bowel motility assessment based on fully convolutional networks and long short-term memory , 2017, Knowl. Based Syst..

[28]  K. Murata,et al.  Assessment of small bowel motility function With cine‐MRI using balanced steady‐state free precession sequence , 2011, Journal of magnetic resonance imaging : JMRI.

[29]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[30]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[31]  Hongfei Lin,et al.  A Normalized Encoder-Decoder Model for Abstractive Summarization Using Focal Loss , 2018, NLPCC.

[32]  Yen-Wei Chen,et al.  Automated assessment of small bowel motility function based on simple linear iterative clustering (SLIC) , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[33]  Xiaogang Wang,et al.  DeepID-Net: Deformable deep convolutional neural networks for object detection , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Carolyn Kaut,et al.  MRI in Practice , 1993 .

[35]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[36]  Johannes M Froehlich,et al.  Non-invasive measurement of small-bowel motility by MRI after abdominal surgery , 2007, Gut.

[37]  Wu Zhang,et al.  Automatic Quantitative Assessment of the Small Bowel Motility with Cine-MRI Sequence Analysis , 2013, ISVC.