Spatial-temporal V-Net for automatic segmentation and quantification of right ventricles in gated myocardial perfusion SPECT images

Background. Functional assessment of right ventricle (RV) using gated myocardial perfusion single-photon emission computed tomography (MPS) heavily relies on the precise extraction of right ventricular contours. In this paper, we present a new deep-learning-based model integrating both the spatial and temporal features in gated MPS images to perform the segmentation of the RV epicardium and endocardium. Methods. By integrating the spatial features from each cardiac frame of the gated MPS and the temporal features from the sequential cardiac frames of the gated MPS, we developed a Spatial-Temporal V-Net (ST-VNet) for automatic extraction of RV endocardial and epicardial contours. In the ST-VNet, a V-Net is employed to hierarchically extract spatial features, and convolutional long-term short-term memory (ConvLSTM) units are added to the skip-connection pathway to extract the temporal features. The input of the ST-VNet is ECG-gated sequential frames of the MPS images and the output is the probability map of the epicardial or endocardial masks. A Dice similarity coefficient (DSC) loss which penalizes the discrepancy between the model prediction and the ground truth was adopted to optimize the segmentation model. Results. Our segmentation model was trained and validated on a retrospective dataset with 45 subjects, and the cardiac cycle of each subject was divided into 8 gates. The proposed ST-VNet achieved a DSC of 0.8914 and 0.8157 for the RV epicardium and endocardium segmentation, respectively. The mean absolute error, the mean squared error, and the Pearson correlation coefficient of the RV ejection fraction (RVEF) between the ground truth and the model prediction were 0.0609, 0.0830, and 0.6985. Conclusion. Our proposed ST-VNet is an effective model for RV segmentation. It has great promise for clinical use in RV functional assessment.

[1]  Zhiguo Gui,et al.  Analysis on SPECT myocardial perfusion imaging with a tool derived from dynamic programming to deep learning , 2021 .

[2]  Cheng Wang,et al.  A learning-based automatic segmentation method on left ventricle in SPECT imaging , 2019, Medical Imaging.

[3]  Yang Lei,et al.  A learning-based automatic segmentation and quantification method on left ventricle in gated myocardial perfusion SPECT imaging: A feasibility study , 2019, Journal of Nuclear Cardiology.

[4]  Ming-Hsuan Yang,et al.  Flow-Grounded Spatial-Temporal Video Prediction from Still Images , 2018, ECCV.

[5]  Yonghong Peng,et al.  A Hybrid Active Contour Segmentation Method for Myocardial D-SPECT Images , 2018, IEEE Access.

[6]  Richard K. G. Do,et al.  Convolutional neural networks: an overview and application in radiology , 2018, Insights into Imaging.

[7]  X. Shang,et al.  Right ventricle performances with echocardiography and 99mTc myocardial perfusion imaging in pulmonary arterial hypertension patients , 2018, Experimental biology and medicine.

[8]  Ernest V. Garcia,et al.  Development and validation of a phase analysis tool to measure interventricular mechanical dyssynchrony from gated SPECT MPI , 2017, Journal of Nuclear Cardiology.

[9]  X. Shang,et al.  Semi-quantitative assessment of pulmonary arterial hypertension associated with congenital heart disease through myocardial perfusion imaging. , 2017, Hellenic journal of nuclear medicine.

[10]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[11]  D. Dey,et al.  Automatic Valve Plane Localization in Myocardial Perfusion SPECT/CT by Machine Learning: Anatomic and Clinical Validation , 2017, The Journal of Nuclear Medicine.

[12]  K. Nichols,et al.  Ventricular asynchrony: A shift to the right? , 2017, Journal of Nuclear Cardiology.

[13]  Ernest V. Garcia,et al.  Right ventricular dyssynchrony in pulmonary hypertension: Phase analysis using FDG-PET imaging , 2017, Journal of Nuclear Cardiology.

[14]  A. Voors,et al.  Right ventricular dysfunction in heart failure with preserved ejection fraction: a systematic review and meta‐analysis , 2016, European journal of heart failure.

[15]  W. Fang,et al.  The characterization and prognostic significance of right ventricular glucose metabolism in non-ischemic dilated cardiomyopathy , 2016, Journal of Nuclear Cardiology.

[16]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[17]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[18]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[19]  Einar Heiberg,et al.  An Improved Method for Automatic Segmentation of the Left Ventricle in Myocardial Perfusion SPECT , 2009, Journal of Nuclear Medicine.

[20]  S. Hunt,et al.  Right Ventricular Function in Cardiovascular Disease, Part I: Anatomy, Physiology, Aging, and Functional Assessment of the Right Ventricle , 2008, Circulation.

[21]  T. Kööbi,et al.  Comparison of methods for cardiac output measurement. , 2001, Critical Care Medicine.

[22]  D. Berman,et al.  A new algorithm for the quantitation of myocardial perfusion SPECT. II: validation and diagnostic yield. , 2000, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[23]  G Germano,et al.  A new algorithm for the quantitation of myocardial perfusion SPECT. I: technical principles and reproducibility. , 2000, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[24]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[25]  D. Mcwilliam,et al.  A comparison of methods of cardiac output measurement. , 1983, Anaesthesia and intensive care.

[26]  Nuclear Cardiology: Basic and Advanced Concepts in Clinical Practice , 2021 .

[27]  Gustavo Carneiro,et al.  Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings , 2018, DLMIA/ML-CDS@MICCAI.

[28]  Jaime S. Cardoso,et al.  Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support , 2017, Lecture Notes in Computer Science.

[29]  L. Tavazzi,et al.  Independent and additive prognostic value of right ventricular systolic function and pulmonary artery pressure in patients with chronic heart failure. , 2001, Journal of the American College of Cardiology.