Echocardiogram Analysis Using Motion Profile Modeling

Echocardiography is a widely used and cost-effective medical imaging procedure that is used to diagnose cardiac irregularities. To capture the various chambers of the heart, echocardiography videos are captured from different angles called views to generate standard images/videos. Automatic classification of these views allows for faster diagnosis and analysis. In this work, we propose a representation for echo videos which encapsulates the motion profile of various chambers and valves that helps effective view classification. This variety of motion profiles is captured in a large Gaussian mixture model called universal motion profile model (UMPM). In order to extract only the relevant motion profiles for each view, a factor analysis based decomposition is applied to the means of the UMPM. This results in a low-dimensional representation called motion profile vector (MPV) which captures the distinctive motion signature for a particular view. To evaluate MPVs, a dataset called ECHO 1.0 is introduced which contains around 637 video clips of the four major views: a) parasternal long-axis view (PLAX), b) parasternal short-axis (PSAX), c) apical four-chamber view (A4C), and d) apical two-chamber view (A2C). We demonstrate the efficacy of motion profile-vectors over other spatio-temporal representations. Further, motion profile-vectors can classify even poorly captured videos with high accuracy which shows the robustness of the proposed representation.

[1]  H. Torp,et al.  Real-time scan assistant for echocardiography , 2012, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[2]  Dorin Comaniciu,et al.  Image-Based Multiclass Boosting and Echocardiographic View Classification , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[3]  Sachin B. Malik,et al.  Transthoracic Echocardiography: Pitfalls and Limitations as Delineated at Cardiac CT and MR Imaging. , 2017, Radiographics : a review publication of the Radiological Society of North America, Inc.

[4]  Wei Li,et al.  A fused deep learning architecture for viewpoint classification of echocardiography , 2017, Inf. Fusion.

[5]  Hélène Langet,et al.  Handcrafted features vs ConvNets in 2D echocardiographic images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Shamik Sural,et al.  State-Based Modeling and Object Extraction From Echocardiogram Video , 2008, IEEE Transactions on Information Technology in Biomedicine.

[8]  Florent Perronnin,et al.  Universal and Adapted Vocabularies for Generic Visual Categorization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Cordelia Schmid,et al.  Action Recognition with Improved Trajectories , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Shahram Ebadollahi,et al.  Automatic view recognition in echocardiogram videos using parts-based representation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  David Beymer,et al.  Echocardiogram view classification using edge filtered scale-invariant motion features , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  N. Reichek,et al.  Recommendations for quantitation of the left ventricle by two-dimensional echocardiography. American Society of Echocardiography Committee on Standards, Subcommittee on Quantitation of Two-Dimensional Echocardiograms. , 1989, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[13]  Cordelia Schmid,et al.  A Robust and Efficient Video Representation for Action Recognition , 2015, International Journal of Computer Vision.

[14]  Koichi Shinoda,et al.  A Fast and Accurate Video Semantic-Indexing System Using Fast MAP Adaptation and GMM Supervectors , 2012, IEEE Transactions on Multimedia.

[15]  Richard Wheeler,et al.  A minimum dataset for a standard adult transthoracic echocardiogram: a guideline protocol from the British Society of Echocardiography , 2015, Echo research and practice.

[16]  Lasse Lovstakken,et al.  2D left ventricle segmentation using deep learning , 2017, 2017 IEEE International Ultrasonics Symposium (IUS).

[17]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  P. Whincup,et al.  The influence of neighbourhood-level socioeconomic deprivation on cardiovascular disease mortality in older age: longitudinal multilevel analyses from a cohort of older British men , 2015, Journal of Epidemiology & Community Health.

[19]  David Beymer,et al.  Exploiting spatio-temporal information for view recognition in cardiac echo videos , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[20]  Dorin Comaniciu,et al.  Automatic Cardiac View Classification of Echocardiogram , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  Patrick Kenny,et al.  Eigenvoice modeling with sparse training data , 2005, IEEE Transactions on Speech and Audio Processing.

[22]  Ruzena Bajcsy,et al.  An End-to-End Computer Vision Pipeline for Automated Cardiac Function Assessment by Echocardiography , 2017, ArXiv.

[23]  Ramy Arnaout,et al.  Fast and accurate view classification of echocardiograms using deep learning , 2018, npj Digital Medicine.

[24]  Purang Abolmaesumi,et al.  Simultaneous Analysis of 2D Echo Views for Left Atrial Segmentation and Disease Detection , 2017, IEEE Transactions on Medical Imaging.

[25]  Lorenzo Torresani,et al.  C3D: Generic Features for Video Analysis , 2014, ArXiv.

[26]  Wei Li,et al.  An improved classification approach for echocardiograms embedding temporal information , 2016 .

[27]  É. Marijon,et al.  Outcomes of borderline rheumatic heart disease: A prospective cohort study. , 2017, International journal of cardiology.

[28]  Francesca N. Delling,et al.  Heart Disease and Stroke Statistics—2018 Update: A Report From the American Heart Association , 2018, Circulation.

[29]  Navneeth Subramanian,et al.  Automatic view classification of echocardiograms using Histogram of Oriented Gradients , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[30]  Ramy Arnaout,et al.  Fast and accurate classification of echocardiograms using deep learning , 2017, ArXiv.

[31]  Zvi Friedman,et al.  Automatic apical view classification of echocardiograms using a discriminative learning dictionary , 2017, Medical Image Anal..

[32]  J. Alison Noble,et al.  Quantification of cardiac bull's-eye map based on principal strain analysis for myocardial wall motion assessment in stress echocardiography , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[33]  Purang Abolmaesumi,et al.  Automatic quality assessment of apical four-chamber echocardiograms using deep convolutional neural networks , 2017, Medical Imaging.

[34]  Dorin Comaniciu,et al.  Database-guided segmentation of anatomical structures with complex appearance , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).