Automatic Tissue Image Segmentation Based on Image Processing and Deep Learning

Image segmentation plays an important role in multimodality imaging, especially in fusion structural images offered by CT, MRI with functional images collected by optical technologies or other novel imaging technologies. Plus, image segmentation also provides detailed structure description for quantitative visualization of treating light distribution in the human body when incorporated with 3D light transport simulation method. Here we used image enhancement, operators, and morphometry methods to extract the accurate contours of different tissues such as skull, cerebrospinal fluid (CSF), grey matter (GM) and white matter (WM) on 5 fMRI head image datasets. Then we utilized convolutional neural network to realize automatic segmentation of images in a deep learning way. We also introduced parallel computing. Such approaches greatly reduced the processing time compared to manual and semi-automatic segmentation and is of great importance in improving speed and accuracy as more and more samples being learned. Our results can be used as a criteria when diagnosing diseases such as cerebral atrophy, which is caused by pathological changes in gray matter or white matter. We demonstrated the great potential of such image processing and deep leaning combined automatic tissue image segmentation in personalized medicine, especially in monitoring, and treatments.

[1]  Maximilien Vermandel,et al.  Stacking denoising auto-encoders in a deep network to segment the brainstem on MRI in brain cancer patients: A clinical study , 2016, Comput. Medical Imaging Graph..

[2]  Chen Huang Research of Image Denoising Method about Wavelet Transform with Neighborhood Average , 2014, CIT 2014.

[3]  Ting Li,et al.  Effect of Human Brain Edema on Light Propagation: A Monte Carlo Modeling Based on the Visible Chinese Human Dataset , 2017, IEEE Photonics Journal.

[4]  Muhammad Imran Razzak,et al.  Deep Learning for Medical Image Processing: Overview, Challenges and Future , 2017, ArXiv.

[5]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[6]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[7]  Ting Li,et al.  Automatic Tissue Image Segmentation Based on Image Processing and Deep Learning. , 2019, Journal of healthcare engineering.

[8]  SkjellumAnthony,et al.  A high-performance, portable implementation of the MPI message passing interface standard , 1996 .

[9]  K. Hasuo,et al.  Late Infantile Krabbe Leukodystrophy: MRI and Evoked Potentials in a Japanese Girl , 1987, Neuropediatrics.

[10]  Kai Li,et al.  Effects of wavelength, beam type and size on cerebral low-level laser therapy by a Monte Carlo study on visible Chinese human , 2015 .

[11]  M. Gado,et al.  Interactive segmentation of cerebral gray matter, white matter, and CSF: photographic and MR images. , 1994, Computerized Medical Imaging and Graphics.

[12]  P. Thirumurugan,et al.  Brain tumor detection and diagnosis using ANFIS classifier , 2016, Int. J. Imaging Syst. Technol..

[13]  Chih-Chin Lai,et al.  A Novel Image Segmentation Approach Based on Particle Swarm Optimization , 2006, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[14]  A J Thompson,et al.  Progressive cerebral atrophy in multiple sclerosis. A serial MRI study. , 1996, Brain : a journal of neurology.

[15]  Giovanni Montana,et al.  Deep neural networks for anatomical brain segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  Yan Li,et al.  Photon penetration depth in human brain for light stimulation and treatment: A realistic Monte Carlo simulation study , 2017 .

[17]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[18]  Leonid B. Sokolinsky,et al.  Scalability Evaluation of NSLP Algorithm for Solving Non-Stationary Linear Programming Problems on Cluster Computing Systems , 2017, RuSCDays.

[19]  Sartaj Sahni,et al.  The master-slave paradigm in parallel computer and industrial settings , 1996, J. Glob. Optim..

[20]  Shohreh Kasaei,et al.  Multispectral brain MRI segmentation using genetic fuzzy systems , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[21]  Lin Yang,et al.  Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation , 2017, MICCAI.

[22]  Tara N. Sainath,et al.  Deep Belief Networks using discriminative features for phone recognition , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Dong Yu,et al.  Large vocabulary continuous speech recognition with context-dependent DBN-HMMS , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[25]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[27]  J. Babb,et al.  Age-related total gray matter and white matter changes in normal adult brain. Part I: volumetric MR imaging analysis. , 2002, AJNR. American journal of neuroradiology.

[28]  Yan Li,et al.  Effect of head model on Monte Carlo modeling of spatial sensitivity distribution for functional near-infrared spectroscopy , 2015 .

[29]  Yuan Sen-miao Medical brain MRI images segmentation by improved fuzzy C-Means clustering analysis , 2009 .

[30]  Jake K. Aggarwal,et al.  The Integration of Image Segmentation Maps using Region and Edge Information , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Nick C Fox,et al.  Effects of Aβ immunization (AN1792) on MRI measures of cerebral volume in Alzheimer disease , 2005, Neurology.

[32]  Ting Li,et al.  Visualization of light propagation in visible Chinese human head for functional near-infrared spectroscopy. , 2011, Journal of biomedical optics.

[33]  Zhaoxue Chen,et al.  [Research on K-means clustering segmentation method for MRI brain image based on selecting multi-peaks in gray histogram]. , 2013, Sheng wu yi xue gong cheng xue za zhi = Journal of biomedical engineering = Shengwu yixue gongchengxue zazhi.

[34]  Max A. Viergever,et al.  Automatic neonatal brain tissue segmentation with MRI , 2013, Medical Imaging.

[35]  A. L. Baert,et al.  MR findings in leukodystrophy , 2004, Neuroradiology.

[36]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .

[37]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[38]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.