Heart motion tracking on cine MRI based on a deep Boltzmann machine-driven level set method

Tracking the heart motion during radiation treatment of cancer patients can provide important information for designing strategies to reduce radiation-induced heart toxicity. Recently, in-treatment cine MRI images are used for guiding radiation therapy. However, dynamic changes of heart shape and limited-contrast of cine MRI images make automatic heart motion tracking a very challenging task. This paper proposes a deep generative shape model-driven level set method to address these challenges and automatically track heart motion on 2D cine MRI images. First, we use a three-layered Deep Boltzmann Machine (DBM) to train a heart shape model that can characterize both global and local heart shape variations. Second, the shape priors inferred from the trained heart shape model are incorporated into the distance regularized level set evolution-based segmentation method to guide frame-by-frame heart segmentation on cine MRI images. We demonstrate the superior performance of the proposed method on cine MRI image sequences acquired from seven volunteers and also compare it with four other methods.

[1]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[2]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[3]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[4]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[5]  Koenraad Van Leemput,et al.  A generative model for segmentation of tumor and organs-at-risk for radiation therapy planning of glioblastoma patients , 2016, SPIE Medical Imaging.

[6]  M. Mohammed Thaha,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2019, Journal of Medical Systems.

[7]  Su Ruan,et al.  An integrated model-driven method for in-treatment upper airway motion tracking using cine MRI in head and neck radiation therapy. , 2016, Medical physics.

[8]  Chunming Li,et al.  Distance Regularized Level Set Evolution and Its Application to Image Segmentation , 2010, IEEE Transactions on Image Processing.

[9]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[10]  Nicolas Heess,et al.  The Shape Boltzmann Machine: A strong model of object shape , 2012, CVPR.

[11]  Pierre Kornprobst,et al.  Mathematical problems in image processing - partial differential equations and the calculus of variations , 2010, Applied mathematical sciences.

[12]  Gustavo Carneiro,et al.  Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance , 2017, Medical Image Anal..

[13]  Huimin Yu,et al.  Deep Learning Shape Priors for Object Segmentation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.