Abdominal, multi-organ, auto-contouring method for online adaptive magnetic resonance guided radiotherapy: An intelligent, multi-level fusion approach

BACKGROUND Manual contouring remains the most laborious task in radiation therapy planning and is a major barrier to implementing routine Magnetic Resonance Imaging (MRI) Guided Adaptive Radiation Therapy (MR-ART). To address this, we propose a new artificial intelligence-based, auto-contouring method for abdominal MR-ART modeled after human brain cognition for manual contouring. METHODS/MATERIALS Our algorithm is based on two types of information flow, i.e. top-down and bottom-up. Top-down information is derived from simulation MR images. It grossly delineates the object based on its high-level information class by transferring the initial planning contours onto daily images. Bottom-up information is derived from pixel data by a supervised, self-adaptive, active learning based support vector machine. It uses low-level pixel features, such as intensity and location, to distinguish each target boundary from the background. The final result is obtained by fusing top-down and bottom-up outputs in a unified framework through artificial intelligence fusion. For evaluation, we used a dataset of four patients with locally advanced pancreatic cancer treated with MR-ART using a clinical system (MRIdian, Viewray, Oakwood Village, OH, USA). Each set included the simulation MRI and onboard T1 MRI corresponding to a randomly selected treatment session. Each MRI had 144 axial slices of 266 × 266 pixels. Using the Dice Similarity Index (DSI) and the Hausdorff Distance Index (HDI), we compared the manual and automated contours for the liver, left and right kidneys, and the spinal cord. RESULTS The average auto-segmentation time was two minutes per set. Visually, the automatic and manual contours were similar. Fused results achieved better accuracy than either the bottom-up or top-down method alone. The DSI values were above 0.86. The spinal canal contours yielded a low HDI value. CONCLUSION With a DSI significantly higher than the usually reported 0.7, our novel algorithm yields a high segmentation accuracy. To our knowledge, this is the first fully automated contouring approach using T1 MRI images for adaptive radiotherapy.

[1]  Daniel Rueckert,et al.  Automated Abdominal Multi-Organ Segmentation With Subject-Specific Atlas Generation , 2013, IEEE Transactions on Medical Imaging.

[2]  G. Sharp,et al.  Vision 20/20: perspectives on automated image segmentation for radiotherapy. , 2014, Medical physics.

[3]  Tianyu Zhao,et al.  Online Magnetic Resonance Image Guided Adaptive Radiation Therapy: First Clinical Applications. , 2016, International journal of radiation oncology, biology, physics.

[4]  Lan-Rong Dung,et al.  Implementation of RANSAC Algorithm for Feature-Based Image Registration , 2013 .

[5]  A. Lomax,et al.  Systematic evaluation of three different commercial software solutions for automatic segmentation for adaptive therapy in head-and-neck, prostate and pleural cancer , 2012, Radiation oncology.

[6]  Günter Rote,et al.  Computing the Minimum Hausdorff Distance Between Two Point Sets on a Line Under Translation , 1991, Inf. Process. Lett..

[7]  P Parikh,et al.  SU-C-BRA-01: Interactive Auto-Segmentation for Bowel in Online Adaptive MRI-Guided Radiation Therapy by Using a Multi-Region Labeling Algorithm. , 2016, Medical physics.

[8]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[9]  Stefan Wesarg,et al.  Region detection in medical images using HOG classifiers and a body landmark network , 2013, Medical Imaging.

[10]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[11]  Li Liu,et al.  Augmenting atlas-based liver segmentation for radiotherapy treatment planning by incorporating image features proximal to the atlas contours. , 2017, Physics in medicine and biology.

[12]  Dimitri Van De Ville,et al.  Three-dimensional solid texture analysis in biomedical imaging: Review and opportunities , 2014, Medical Image Anal..

[13]  Vladimir Pekar,et al.  Automated model-based organ delineation for radiotherapy planning in prostatic region. , 2004, International journal of radiation oncology, biology, physics.

[14]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[15]  Lei Xing,et al.  Image-Guided and Adaptive Radiation Therapy , 2012 .

[16]  J G M Kok,et al.  Integrating a 1.5 T MRI scanner with a 6 MV accelerator: proof of concept , 2009, Physics in medicine and biology.

[17]  Simon K Warfield,et al.  Segmentations of MRI images of the female pelvic floor: A study of inter‐ and intra‐reader reliability , 2011, Journal of magnetic resonance imaging : JMRI.

[18]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[19]  Patrice Y. Simard,et al.  Using GPUs for machine learning algorithms , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[20]  Bruce J. Gerbi,et al.  Treatment Planning in Radiation Oncology , 2011 .

[21]  Vladimir Pekar,et al.  Auto-segmentation of normal and target structures in head and neck CT images: a feature-driven model-based approach. , 2011, Medical physics.

[22]  Parag J. Parikh,et al.  Online Adaptive Magnetic Resonance–Guided (OAMR)-Stereotactic Body Radiation Therapy for Abdominal Malignancies: Prospective Dosimetric Results from a Phase 1 Trial , 2016 .

[23]  Slobodan Devic,et al.  MRI simulation for radiotherapy treatment planning. , 2012, Medical physics.

[24]  Joan S. Weszka,et al.  A survey of threshold selection techniques , 1978 .

[25]  Xiao Han,et al.  Atlas-Based Auto-segmentation of Head and Neck CT Images , 2008, MICCAI.

[26]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[27]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[28]  Min Yao,et al.  Quantitative evaluation of image segmentation incorporating medical consideration functions. , 2015, Medical physics.

[29]  M. Miften,et al.  A region growing method for tumor volume segmentation on PET images for rectal and anal cancer patients. , 2009, Medical physics.

[30]  Sasa Mutic,et al.  The ViewRay system: magnetic resonance-guided and controlled radiotherapy. , 2014, Seminars in radiation oncology.

[31]  Ross T. Whitaker,et al.  Partitioning 3D Surface Meshes Using Watershed Segmentation , 1999, IEEE Trans. Vis. Comput. Graph..

[32]  Ron Kikinis,et al.  Statistical validation of image segmentation quality based on a spatial overlap index. , 2004, Academic radiology.

[33]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.