Multi‐channel multi‐scale fully convolutional network for 3D perivascular spaces segmentation in 7T MR images

HIGHLIGHTSA novel fully convolutional network to segment perivascular spaces in 7T MR images.Multi‐channel inputs to afford tubular structural information and fine image details.Multi‐scale features to characterize associations between PVSs and adjacent tissues.Auto‐context strategy to provide auxiliary guidance for further refining the network.Data rebalancing and cost‐sensitive learning to mitigate the class‐imbalance issue. ABSTRACT Accurate segmentation of perivascular spaces (PVSs) is an important step for quantitative study of PVS morphology. However, since PVSs are the thin tubular structures with relatively low contrast and also the number of PVSs is often large, it is challenging and time‐consuming for manual delineation of PVSs. Although several automatic/semi‐automatic methods, especially the traditional learning‐based approaches, have been proposed for segmentation of 3D PVSs, their performance often depends on the hand‐crafted image features, as well as sophisticated preprocessing operations prior to segmentation (e.g., specially defined regions‐of‐interest (ROIs)). In this paper, a novel fully convolutional neural network (FCN) with no requirement of any specified hand‐crafted features and ROIs is proposed for efficient segmentation of PVSs. Particularly, the original T2‐weighted 7T magnetic resonance (MR) images are first filtered via a non‐local Haar‐transform‐based line singularity representation method to enhance the thin tubular structures. Both the original and enhanced MR images are used as multi‐channel inputs to complementarily provide detailed image information and enhanced tubular structural information for the localization of PVSs. Multi‐scale features are then automatically learned to characterize the spatial associations between PVSs and adjacent brain tissues. Finally, the produced PVS probability maps are recursively loaded into the network as an additional channel of inputs to provide the auxiliary contextual information for further refining the segmentation results. The proposed multi‐channel multi‐scale FCN has been evaluated on the 7T brain MR images scanned from 20 subjects. The experimental results show its superior performance compared with several state‐of‐the‐art methods.