Real-Time Automatic Ejection Fraction and Foreshortening Detection Using Deep Learning

Volume and ejection fraction (EF) measurements of the left ventricle (LV) in 2-D echocardiography are associated with a high uncertainty not only due to interobserver variability of the manual measurement, but also due to ultrasound acquisition errors such as apical foreshortening. In this work, a real-time and fully automated EF measurement and foreshortening detection method is proposed. The method uses several deep learning components, such as view classification, cardiac cycle timing, segmentation and landmark extraction, to measure the amount of foreshortening, LV volume, and EF. A data set of 500 patients from an outpatient clinic was used to train the deep neural networks, while a separate data set of 100 patients from another clinic was used for evaluation, where LV volume and EF were measured by an expert using clinical protocols and software. A quantitative analysis using 3-D ultrasound showed that EF is considerably affected by apical foreshortening, and that the proposed method can detect and quantify the amount of apical foreshortening. The bias and standard deviation of the automatic EF measurements were −3.6 ± 8.1%, while the mean absolute difference was measured at 7.2% which are all within the interobserver variability and comparable with related studies. The proposed real-time pipeline allows for a continuous acquisition and measurement workflow without user interaction, and has the potential to significantly reduce the time spent on the analysis and measurement error due to foreshortening, while providing quantitative volume measurements in the everyday echo lab.

[1]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[2]  Purang Abolmaesumi,et al.  Automatic Quality Assessment of Echocardiograms Using Convolutional Neural Networks: Feasibility on the Apical Four-Chamber View , 2017, IEEE Transactions on Medical Imaging.

[3]  Shaoting Zhang,et al.  Recognizing End-Diastole and End-Systole Frames via Deep Temporal Regression Network , 2016, MICCAI.

[4]  Lasse Lovstakken,et al.  Fully Automatic Real-Time Ejection Fraction and MAPSE Measurements in 2D Echocardiography Using Deep Neural Networks , 2018, 2018 IEEE International Ultrasonics Symposium (IUS).

[5]  Fredrik Orderud,et al.  Echocardiography without electrocardiogram. , 2011, European journal of echocardiography : the journal of the Working Group on Echocardiography of the European Society of Cardiology.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Frederic Cervenansky,et al.  Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography , 2019, IEEE Transactions on Medical Imaging.

[8]  Stéphanie Bézy,et al.  Impact of apical foreshortening on deformation measurements: a report from the EACVI-ASE Strain Standardization Task Force. , 2019, European heart journal cardiovascular Imaging.

[9]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ruzena Bajcsy,et al.  Fully Automated Echocardiogram Interpretation in Clinical Practice , 2018, Circulation.

[11]  Lasse Lovstakken,et al.  2D left ventricle segmentation using deep learning , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[12]  Sérgio Matos,et al.  Ejection Fraction Classification in Transthoracic Echocardiography Using a Deep Learning Approach , 2018, 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS).

[13]  Purang Abolmaesumi,et al.  Deep Residual Recurrent Neural Networks for Characterisation of Cardiac Cycle Phase from Echocardiograms , 2017, DLMIA/ML-CDS@MICCAI.

[14]  Wei Li,et al.  A fused deep learning architecture for viewpoint classification of echocardiography , 2017, Inf. Fusion.

[15]  Purang Abolmaesumi,et al.  Automatic biplane left ventricular ejection fraction estimation with mobile point-of-care ultrasound using multi-task learning and adversarial training , 2019, International Journal of Computer Assisted Radiology and Surgery.

[16]  H. Behnam,et al.  Automatic detection of end-diastole and end-systole from echocardiography images using manifold learning. , 2010, Physiological measurement.

[17]  Erik Smistad,et al.  High Performance Neural Network Inference, Streaming, and Visualization of Medical Images Using FAST , 2019, IEEE Access.

[18]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[19]  Hans Torp,et al.  Automatic timing of aortic valve closure in apical tissue Doppler images. , 2006, Ultrasound in medicine & biology.

[20]  Frank Lindseth,et al.  FAST: framework for heterogeneous medical image computing and visualization , 2015, International Journal of Computer Assisted Radiology and Surgery.

[21]  Bjørn Olav Haugen,et al.  Real-Time Standard View Classification in Transthoracic Echocardiography Using Convolutional Neural Networks. , 2019, Ultrasound in medicine & biology.

[22]  Hamid Behnam,et al.  Echocardiography without electrocardiogram using nonlinear dimensionality reduction methods , 2015, Journal of Medical Ultrasonics.

[23]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Olivier Bernard,et al.  Detection of Cardiac Events in Echocardiography Using 3D Convolutional Recurrent Neural Networks , 2018, 2018 IEEE International Ultrasonics Symposium (IUS).

[25]  Victor Mor-Avi,et al.  Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. , 2015, European heart journal cardiovascular Imaging.

[26]  Chen Wang,et al.  Standardized Evaluation System for Left Ventricular Segmentation Algorithms in 3D Echocardiography , 2016, IEEE Transactions on Medical Imaging.