Framelet pooling aided deep learning network: the method to process high dimensional medical data

Machine learning-based analysis of medical images often faces several hurdles, such as the lack of training data, the curse of dimensionality problem, and the generalization issues. One of the main difficulties is that there exists computational cost problem in dealing with input data of large size matrices which represent medical images. The purpose of this paper is to introduce a framelet-pooling aided deep learning method for mitigating computational bundle, caused by large dimensionality. By transforming high dimensional data into low dimensional components by filter banks with preserving detailed information, the proposed method aims to reduce the complexity of the neural network and computational costs significantly during the learning process. Various experiments show that our method is comparable to the standard unreduced learning method, while reducing computational burdens by decomposing large-sized learning tasks into several small-scale learning tasks.

[1]  Zuowei Shen,et al.  On B-Spline Framelets Derived from the Unitary Extension Principle , 2013, SIAM J. Math. Anal..

[2]  A. Barron Approximation and Estimation Bounds for Artificial Neural Networks , 1991, COLT '91.

[3]  T. Poggio,et al.  Deep vs. shallow networks : An approximation theory perspective , 2016, ArXiv.

[4]  Bin Dong,et al.  Image Restoration: A General Wavelet Frame Based Model and Its Asymptotic Analysis , 2016, SIAM J. Math. Anal..

[5]  Stéphane Mallat,et al.  Understanding deep convolutional networks , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Jin Keun Seo,et al.  Deep learning for undersampled MRI reconstruction , 2017, Physics in medicine and biology.

[8]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[9]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[10]  Bin Dong,et al.  MRA-based wavelet frames and applications: image segmentation and surface reconstruction , 2012, Defense + Commercial Sensing.

[11]  Jong Chul Ye,et al.  Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems , 2017, SIAM J. Imaging Sci..

[12]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[13]  Dwight G. Nishimura,et al.  Principles of magnetic resonance imaging , 2010 .

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Marios S. Pattichis,et al.  Multiscale Amplitude-Modulation Frequency-Modulation (AM–FM) Texture Analysis of Multiple Sclerosis in Brain MRI Images , 2011, IEEE Transactions on Information Technology in Biomedicine.

[16]  Stéphane Mallat,et al.  Invariant Scattering Convolution Networks , 2012, IEEE transactions on pattern analysis and machine intelligence.

[17]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[18]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[19]  Jian-Feng Cai,et al.  Data-driven tight frame construction and image denoising , 2014 .

[20]  Jin Keun Seo,et al.  Characterization of Metal Artifacts in X‐Ray Computed Tomography , 2014, 1406.0318.

[21]  Zuowei Shen Affine systems in L 2 ( IR d ) : the analysis of the analysis operator , 1995 .

[22]  Razvan Pascanu,et al.  On the number of response regions of deep feed forward networks with piece-wise linear activations , 2013, 1312.6098.