Patch-Based Semantic Segmentation for Detecting Arterioles and Venules in Epifluorescence Imagery

Segmentation and quantification of microvasculature structures are the main steps toward studying microvasculature remodeling. The proposed patch based semantic architecture enables accurate segmentation for the challenging epifluorescence microscopy images. Our pixel-based fast semantic network trained on random patches from different epifluorescence images to learn how to discriminate between vessels versus non-vessels pixels. The proposed semantic vessel network (SVNet) relies on understanding the morphological structure of the thin vessels in the patches rather than considering the whole image as input to speed up the training process and to maintain the clarity of thin structures. Experimental results on our ovariectomized - ovary removed (OVX) - mice dura mater epifluorescence microscopy images shows promising results in both arteriole and venule part. We compared our results with different segmentation methods such as local, global thresholding, matched based filter approaches and related state of the art deep learning networks. Our overall accuracy (> 98%) outperforms all the methods including our previous work (VNet). [1].

[1]  Vincent Lepetit,et al.  Multiscale Centerline Detection , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Costas Panagiotakis,et al.  Linear Pattern Detection of Geological Faults via a Topology and Shape Optimization Method , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Filiz Bunyak,et al.  Mitochondria segmentation in electron microscopy volumes using deep convolutional neural network , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[4]  Adel Hafiane,et al.  HEp-2 cell classification and segmentation using motif texture patterns and spatial features with random forests , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[5]  Noor M. Al-Shakarji,et al.  Dissecting branchiomotor neuron circuits in zebrafish — toward high-throughput automated analysis of jaw movements , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[6]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[7]  Kullervo Hynynen,et al.  Deep Learning Convolutional Networks for Multiphoton Microscopy Vasculature Segmentation , 2016, ArXiv.

[8]  Yasmin M. Kassim,et al.  Extracting retinal vascular networks using deep learning architecture , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[9]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[10]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[11]  Kotagiri Ramamohanarao,et al.  An effective retinal blood vessel segmentation method using multi-scale line detection , 2013, Pattern Recognit..

[12]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[13]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[14]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[15]  Yasmin M. Kassim,et al.  Confocal vessel structure segmentation with optimized feature bank and random forests , 2016, 2016 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[16]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[17]  Jeffrey Ng,et al.  Microvasculature Segmentation of Co-Registered Retinal Angiogram Sequences , 2012 .

[18]  Yasmin M. Kassim,et al.  Sensitivity of Cross-Trained Deep CNNs for Retinal Vessel Extraction , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  M. Goldbaum,et al.  Detection of blood vessels in retinal images using two-dimensional matched filters. , 1989, IEEE transactions on medical imaging.

[20]  Yasmin M. Kassim,et al.  Microvasculature segmentation of arterioles using deep CNN , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[21]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[22]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.