A cerebral microbleed diagnosis method via FeatureNet and ensembled randomized neural networks

Abstract Cerebral microbleed (CMB) is a type of biomarker, which is related to cerebrovascular diseases. In this paper, a novel computer aided diagnosis method for CMB detection was presented. Firstly, sliding neighborhood algorithm was used to generate CMB and non-CMB samples from brain susceptibility weighted images. Then, a 15-layer proposed FeatureNet was trained for extracting features from the input samples. Afterwards, structure after the first fully connected layer in FeatureNet was replaced by three randomized neural networks for classification: Schmidt neural network, random vector functional-link net, and extreme learning machine, and the weights and biases in early layers of FeatureNet were frozen during the training of those three classifiers. Finally, the output of the three classifiers was ensemble by majority voting mechanism to get better classification performance. In our experiment, five-fold cross validation was employed for evaluation. Results revealed that our FeatureNet-SNN, FeatureNet-RVFL and FeatureNet-ELM yielded accuracy of 98.22%, 98.23%, and 97.54%, respectively, and the ensembled FeatureNet-EN improved the accuracy to 98.60%, which outperformed several existing state-of-the-art approaches. The proposed FeatureNet-EN model could provide accurate CMB detection, and thus reduce death tolls. Impact Statement — We propose a 15-layer FeatureNet to detect cerebral microbleed (CMB). We propose three FeatureNet variants: FeatureNet-SNN, FeatureNet-RVFL and FeatureNet-ELM. We use ensemble learning to combine three FeatureNet variants, and generate a FeatureNet-EN. The proposed FeatureNet-SNN, FeatureNet-RVFL and FeatureNet-ELM yielded accuracy of 98.22%, 98.23%, and 97.54%, respectively, and the ensembled FeatureNet-EN improved the accuracy to 98.60%, better than state-of-the-art methods. This method could provide accurate CMB detection, and thus reduce death tolls.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Saifeng Liu,et al.  Cerebral microbleed detection using Susceptibility Weighted Imaging and deep learning , 2019, NeuroImage.

[3]  Lalit M. Patnaik,et al.  Classification of magnetic resonance brain images using wavelets as input to support vector machine and neural network , 2006, Biomed. Signal Process. Control..

[4]  Ranjeeta Bisoi,et al.  Modes decomposition method in fusion with robust random vector functional link network for crude oil price forecasting , 2019, Appl. Soft Comput..

[5]  Dejan J. Sobajic,et al.  Learning and generalization characteristics of the random vector Functional-link net , 1994, Neurocomputing.

[6]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  P. N. Suganthan,et al.  A comprehensive evaluation of random vector functional link networks , 2016, Inf. Sci..

[8]  Ponnuthurai N. Suganthan,et al.  Letter: On non-iterative learning algorithms with closed-form solution , 2018, Appl. Soft Comput..

[9]  Ponnuthurai N. Suganthan,et al.  Random vector functional link network for short-term electricity load demand forecasting , 2016, Inf. Sci..

[10]  Robert P. W. Duin,et al.  Feedforward neural networks with random weights , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[11]  Kenneth Revett,et al.  Computer-aided diagnosis of human brain tumor through MRI: A survey and a new algorithm , 2014, Expert Syst. Appl..

[12]  Hong Chen,et al.  Voxelwise detection of cerebral microbleed in CADASIL patients by leaky rectified linear unit and early stopping , 2017, Multimedia Tools and Applications.

[13]  Dawid Połap,et al.  An adaptive genetic algorithm as a supporting mechanism for microscopy image analysis in a cascade of convolution neural networks , 2020, Appl. Soft Comput..

[14]  Susan M. Chang,et al.  Computer-aided detection of radiation-induced cerebral microbleeds on susceptibility-weighted MR images☆ , 2013, NeuroImage: Clinical.

[15]  P. N. Suganthan,et al.  Random Vector Functional Link Neural Network based Ensemble Deep Learning , 2019, Pattern Recognit..

[16]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[17]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[18]  E Mark Haacke,et al.  Semiautomated detection of cerebral microbleeds in magnetic resonance images. , 2011, Magnetic resonance imaging.

[19]  Eam Khwang Teoh,et al.  Pattern recognition by graph matching using the Potts MFT neural networks , 1995, Pattern Recognit..

[20]  Jie Liu,et al.  Detecting cerebral microbleeds with transfer learning , 2019, Machine Vision and Applications.

[21]  Janine M. Lupo,et al.  Toward Automatic Detection of Radiation-Induced Cerebral Microbleeds Using a 3D Deep Residual Network , 2018, Journal of Digital Imaging.

[22]  Najdan Vukovic,et al.  A comprehensive experimental evaluation of orthogonal polynomial expanded random vector functional link neural networks for regression , 2017, Appl. Soft Comput..

[23]  Fang Liu,et al.  SAR Image segmentation based on convolutional-wavelet neural network and markov random field , 2017, Pattern Recognit..

[24]  Max A. Viergever,et al.  Efficient detection of cerebral microbleeds on 7.0T MR images using the radial symmetry transform , 2012, NeuroImage.

[25]  Hong Chen,et al.  Seven-layer deep neural network based on sparse autoencoder for voxelwise detection of cerebral microbleed , 2017, Multimedia Tools and Applications.

[26]  Manuel Graña,et al.  Extreme Learning Machines for Feature Selection and Classification of Cocaine Dependent Patients on Structural MRI Data , 2013, Neural Processing Letters.

[27]  Le Zhang,et al.  Visual Tracking With Convolutional Random Vector Functional Link Network , 2017, IEEE Transactions on Cybernetics.

[28]  Olivier Salvado,et al.  Computer-aided detection of cerebral microbleeds in susceptibility-weighted imaging , 2015, Comput. Medical Imaging Graph..

[29]  Ponnuthurai N. Suganthan Shape indexing using self-organizing maps , 2002, IEEE Trans. Neural Networks.

[30]  Ponnuthurai N. Suganthan,et al.  On the origins of randomization-based feedforward neural networks , 2021, Appl. Soft Comput..

[31]  Snehashis Roy,et al.  Cerebral microbleed segmentation from susceptibility weighted images , 2015, Medical Imaging.

[32]  Peter L. Bartlett,et al.  The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network , 1998, IEEE Trans. Inf. Theory.

[33]  Jie Liu,et al.  Classification of cerebral microbleeds based on fully-optimized convolutional neural network , 2018, Multimedia Tools and Applications.

[34]  Yanika Kongsorot,et al.  Parallelized Metaheuristic-Ensemble of Heterogeneous Feedforward Neural Networks for Regression Problems , 2019, IEEE Access.

[35]  Hao Chen,et al.  Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[36]  B. M. ter Haar Romeny,et al.  Automated detection of cerebral microbleeds in patients with Traumatic Brain Injury , 2016, NeuroImage: Clinical.

[37]  Hong Chen,et al.  Sparse Autoencoder Based Deep Neural Network for Voxelwise Detection of Cerebral Microbleed , 2016, 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS).

[38]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[39]  Philip S. Yu,et al.  An unsupervised parameter learning model for RVFL neural network , 2019, Neural Networks.