MRI-based brain tumor segmentation using FPGA-accelerated neural network

Background Brain tumor segmentation is a challenging problem in medical image processing and analysis. It is a very time-consuming and error-prone task. In order to reduce the burden on physicians and improve the segmentation accuracy, the computer-aided detection (CAD) systems need to be developed. Due to the powerful feature learning ability of the deep learning technology, many deep learning-based methods have been applied to the brain tumor segmentation CAD systems and achieved satisfactory accuracy. However, deep learning neural networks have high computational complexity, and the brain tumor segmentation process consumes significant time. Therefore, in order to achieve the high segmentation accuracy of brain tumors and obtain the segmentation results efficiently, it is very demanding to speed up the segmentation process of brain tumors. Results Compared with traditional computing platforms, the proposed FPGA accelerator has greatly improved the speed and the power consumption. Based on the BraTS19 and BraTS20 dataset, our FPGA-based brain tumor segmentation accelerator is 5.21 and 44.47 times faster than the TITAN V GPU and the Xeon CPU. In addition, by comparing energy efficiency, our design can achieve 11.22 and 82.33 times energy efficiency than GPU and CPU, respectively. Conclusion We quantize and retrain the neural network for brain tumor segmentation and merge batch normalization layers to reduce the parameter size and computational complexity. The FPGA-based brain tumor segmentation accelerator is designed to map the quantized neural network model. The accelerator can increase the segmentation speed and reduce the power consumption on the basis of ensuring high accuracy which provides a new direction for the automatic segmentation and remote diagnosis of brain tumors.

[1]  Tanzila Saba,et al.  Brain tumor detection using statistical and machine learning method , 2019, Comput. Methods Programs Biomed..

[2]  S.M. Krishnan,et al.  Extraction of Brain Tumor from MR Images Using One-Class Support Vector Machine , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[3]  J Toriwaki,et al.  Automatic segmentation of head MRI images by knowledge guided thresholding. , 1991, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[4]  Jason D. Bakos,et al.  Extending the BEAGLE library to a multi-FPGA platform , 2012, BMC Bioinformatics.

[5]  Changxing Ding,et al.  Dual-force convolutional neural networks for accurate brain tumor segmentation , 2019, Pattern Recognit..

[6]  C. Vijayakumar,et al.  Development of image-processing software for automatic segmentation of brain tumors in MR images , 2011, Journal of medical physics.

[7]  et al.,et al.  Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge , 2018, ArXiv.

[8]  Wei Cao,et al.  RNA: An Accurate Residual Network Accelerator for Quantized and Reconstructed Deep Neural Networks , 2019, IEICE Transactions on Information and Systems.

[9]  Mark D Cicero,et al.  Training and Validating a Deep Convolutional Neural Network for Computer-Aided Detection and Classification of Abnormalities on Frontal Chest Radiographs , 2017, Investigative radiology.

[10]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[11]  Sara Sedlar,et al.  Brain Tumor Segmentation Using a Multi-path CNN Based Method , 2017, BrainLes@MICCAI.

[12]  Muhammad Nazeer,et al.  A unified patch based method for brain tumor detection using features fusion , 2020, Cognitive Systems Research.

[13]  Leonid Oliker,et al.  ADEPT: a domain independent sequence alignment strategy for gpu architectures , 2020, BMC Bioinformatics.

[14]  Christos Davatzikos,et al.  Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features , 2017, Scientific Data.

[15]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[16]  Lawrence O. Hall,et al.  Automatic segmentation of non-enhancing brain tumors in magnetic resonance images , 2001, Artif. Intell. Medicine.

[17]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[18]  A.M. Badawi,et al.  Validation Techniques for Quantitative Brain Tumors Measurements , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[19]  Muhammad Sharif,et al.  Brain tumor detection based on extreme learning , 2020, Neural Computing and Applications.

[20]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[21]  Nelly Gordillo,et al.  State of the art survey on MRI brain tumor segmentation. , 2013, Magnetic resonance imaging.

[22]  Wei Cao,et al.  RNA: An Accurate Residual Network Accelerator for Quantized and Reconstructed Deep Neural Networks , 2018, 2018 28th International Conference on Field Programmable Logic and Applications (FPL).

[23]  Antonio Criminisi,et al.  Segmentation of Brain Tumor Tissues with Convolutional Neural Networks , 2014 .

[24]  Syed Ahmad Chan Bukhari,et al.  Convolutional neural network with batch normalization for glioma and stroke lesion detection using MRI , 2020, Cognitive Systems Research.

[25]  Martin C. Herbordt,et al.  Real-time data analysis for medical diagnosis using FPGA-accelerated neural networks , 2018, BMC Bioinformatics.

[26]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[27]  D. Louis Collins,et al.  Hierarchical Probabilistic Gabor and MRF Segmentation of Brain Tumours in MRI Volumes , 2013, MICCAI.

[28]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[29]  N. Karssemeijer,et al.  Discriminating solitary cysts from soft tissue lesions in mammography using a pretrained deep convolutional neural network , 2017, Medical physics.

[30]  Zaid Al-Ars,et al.  GASAL2: a GPU accelerated sequence alignment library for high-throughput NGS data , 2019, BMC Bioinformatics.

[31]  Muhammad Sharif,et al.  Big data analysis for brain tumor detection: Deep convolutional neural networks , 2018, Future Gener. Comput. Syst..