Direct and simultaneous estimation of cardiac four chamber volumes by multioutput sparse regression

HIGHLIGHTSWe achieve direct and simultaneous four chamber volume estimation, which enables more accurate and convenient whole heart functional analysis.We formulate volume estimation as a multi‐output regression problem, which enables volume estimation to be conducted in a unified framework.We propose direct and simultaneous four chamber volume estimation by multioutput sparse regression.We have conducted extensive experiments on both MR and CT datasets for direct and simultaneous cardiac four‐chamber volume estimation. ABSTRACT Cardiac four‐chamber volume estimation serves as a fundamental and crucial role in clinical quantitative analysis of whole heart functions. It is a challenging task due to the huge complexity of the four chambers including great appearance variations, huge shape deformation and interference between chambers. Direct estimation has recently emerged as an effective and convenient tool for cardiac ventricular volume estimation. However, existing direct estimation methods were specifically developed for one single ventricle, i.e., left ventricle (LV), or bi‐ventricles; they can not be directly used for four chamber volume estimation due to the great combinatorial variability and highly complex anatomical interdependency of the four chambers. In this paper, we propose a new, general framework for direct and simultaneous four chamber volume estimation. We have addressed two key issues, i.e., cardiac image representation and simultaneous four chamber volume estimation, which enables accurate and efficient four‐chamber volume estimation. We generate compact and discriminative image representations by supervised descriptor learning (SDL) which can remove irrelevant information and extract discriminative features. We propose direct and simultaneous four‐chamber volume estimation by the multioutput sparse latent regression (MSLR), which enables jointly modeling nonlinear input‐output relationships and capturing four‐chamber interdependence. The proposed method is highly generalized, independent of imaging modalities, which provides a general regression framework that can be extensively used for clinical data prediction to achieve automated diagnosis. Experiments on both MR and CT images show that our method achieves high performance with a correlation coefficient of up to 0.921 with ground truth obtained manually by human experts, which is clinically significant and enables more accurate, convenient and comprehensive assessment of cardiac functions.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Caroline Petitjean,et al.  A review of segmentation methods in short axis cardiac MR images , 2011, Medical Image Anal..

[3]  Antonio Criminisi,et al.  Regression forests for efficient anatomy detection and localization in computed tomography scans , 2013, Medical Image Anal..

[4]  Dorin Comaniciu,et al.  A boosting regression approach to medical anatomy detection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Rama Chellappa,et al.  Growing Regression Forests by Classification: Applications to Object Pose Estimation , 2013, ECCV.

[6]  Roman Rosipal,et al.  Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space , 2002, J. Mach. Learn. Res..

[7]  P. Thomas Fletcher,et al.  Population Shape Regression from Random Design Data , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Shaoting Zhang,et al.  Recognizing End-Diastole and End-Systole Frames via Deep Temporal Regression Network , 2016, MICCAI.

[9]  Sotirios A. Tsaftaris,et al.  Data-Driven Feature Learning for Myocardial Segmentation of CP-BOLD MRI , 2015, FIMH.

[10]  Terry M. Peters,et al.  Right Ventricle Segmentation with Probability Product Kernel Constraints , 2013, MICCAI.

[11]  S. Li,et al.  Regression Segmentation for $M^{3}$ Spinal Images , 2015, IEEE Transactions on Medical Imaging.

[12]  Feiping Nie,et al.  Efficient and Robust Feature Selection via Joint ℓ2, 1-Norms Minimization , 2010, NIPS.

[13]  Shaohua Kevin Zhou,et al.  Discriminative anatomy detection: Classification vs regression , 2014, Pattern Recognit. Lett..

[14]  Antonio Criminisi,et al.  Regression Forests for Efficient Anatomy Detection and Localization in CT Studies , 2010, MCV.

[15]  Alejandro F. Frangi,et al.  Personalization of a cardiac electromechanical model using reduced order unscented Kalman filtering from regional volumes , 2013, Medical Image Anal..

[16]  Xiantong Zhen,et al.  Supervised descriptor learning for multi-output regression , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Ling Shao,et al.  A local descriptor based on Laplacian pyramid coding for action recognition , 2013, Pattern Recognit. Lett..

[18]  Bin Gu,et al.  Direct Estimation of Cardiac Biventricular Volumes With an Adapted Bayesian Formulation , 2014, IEEE Transactions on Biomedical Engineering.

[19]  Shaohua Kevin Zhou,et al.  Shape regression machine and efficient segmentation of left ventricle endocardium from 2D B-mode echocardiogram , 2010, Medical Image Anal..

[20]  Vincent Lepetit,et al.  You Should Use Regression to Detect Cells , 2015, MICCAI.

[21]  Polina Golland,et al.  Interactive Whole-Heart Segmentation in Congenital Heart Disease , 2015, MICCAI.

[22]  Hüseyin Tek,et al.  Comprehensive Cardiovascular Image Analysis Using MR and CT at Siemens Corporate Research , 2006, International Journal of Computer Vision.

[23]  Ghassan Hamarneh,et al.  Segmentation-Free Estimation of Kidney Volumes in CT with Dual Regression Forests , 2016, MLMI@MICCAI.

[24]  B. S. Manjunath,et al.  Anatomical parts-based regression using non-negative matrix factorization , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[26]  Antonio Criminisi,et al.  Decision Forests for Computer Vision and Medical Image Analysis , 2013, Advances in Computer Vision and Pattern Recognition.

[27]  Yilong Yin,et al.  Multi-task Shape Regression for Medical Image Segmentation , 2016, MICCAI.

[28]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[29]  Dorin Comaniciu,et al.  Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features , 2008, IEEE Transactions on Medical Imaging.

[30]  Christian Szegedy,et al.  DeepPose: Human Pose Estimation via Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[32]  Anant Madabhushi,et al.  Simultaneous segmentation of prostatic zones using Active Appearance Models with multiple coupled levelsets , 2013, Comput. Vis. Image Underst..

[33]  Jieping Ye,et al.  GPCA: an efficient dimension reduction scheme for image compression and retrieval , 2004, KDD.

[34]  Ahmed M. Elgammal,et al.  Regression from local features for viewpoint and pose estimation , 2011, 2011 International Conference on Computer Vision.

[35]  Andrew W. Fitzgibbon,et al.  Multi-output Learning for Camera Relocalization , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Nicholas Ayache,et al.  A collaborative resource to build consensus for automated left ventricular segmentation of cardiac MR images , 2014, Medical Image Anal..

[37]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Xiantong Zhen,et al.  Multi-scale deep networks and regression forests for direct bi-ventricular volume estimation , 2016, Medical Image Anal..

[39]  L. Xia,et al.  A hybrid model of Maximum Margin Clustering method and support vector regression for solving the inverse ECG problem , 2011, 2011 Computing in Cardiology.

[40]  Bernhard Schölkopf,et al.  The representer theorem for Hilbert spaces: a necessary and sufficient condition , 2012, NIPS.

[41]  Hervé Delingette,et al.  Cardiac Electrophysiological Activation Pattern Estimation From Images Using a Patient-Specific Database of Synthetic Image Sequences , 2014, IEEE Transactions on Biomedical Engineering.

[42]  Stefan Klein,et al.  Regression-Based Cardiac Motion Prediction From Single-Phase CTA , 2012, IEEE Transactions on Medical Imaging.

[43]  Xiantong Zhen,et al.  Descriptor Learning via Supervised Manifold Regularization for Multioutput Regression , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Shuo Li,et al.  Regional heart motion abnormality detection: An information theoretic approach , 2013, Medical Image Anal..

[45]  Trevor Hastie,et al.  The elements of statistical learning. 2001 , 2001 .

[46]  Johan Montagnat,et al.  A Virtual Imaging Platform for Multi-Modality Medical Image Simulation , 2013, IEEE Transactions on Medical Imaging.

[47]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[48]  Mahmoud R. El-Sakka,et al.  Estimating Ejection Fraction and Left Ventricle Volume Using Deep Convolutional Networks , 2016, ICIAR.

[49]  Nassir Navab,et al.  Data-driven estimation of cardiac electrical diffusivity from 12-lead ECG signals , 2014, Medical Image Anal..

[50]  Jieping Ye,et al.  Generalized Low Rank Approximations of Matrices , 2004, Machine Learning.

[51]  Ying Wang,et al.  High-dimensional Pattern Regression Using Machine Learning: from Medical Images to Continuous Clinical Variables However, Support Vector Regression Has Some Disadvantages That Become Especially , 2022 .

[52]  Terry M. Peters,et al.  Global Assessment of Cardiac Function Using Image Statistics in MRI , 2012, MICCAI.

[53]  Alistair A. Young,et al.  The Cardiac Atlas Project—an imaging database for computational modeling and statistical atlases of the heart , 2011, Bioinform..

[54]  Xiantong Zhen,et al.  Direct and Simultaneous Four-Chamber Volume Estimation by Multi-Output Regression , 2015, MICCAI.

[55]  B. Wintersperger,et al.  Complementary Role of Cardiac CT and MRI , 2009 .

[56]  Jürgen Weese,et al.  Benchmark for Algorithms Segmenting the Left Atrium From 3D CT and MRI Datasets , 2015, IEEE Transactions on Medical Imaging.

[57]  Antonio Criminisi,et al.  Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes , 2009 .

[58]  L. Baur,et al.  Right atrial function: still underestimated in clinical cardiology , 2008, The International Journal of Cardiovascular Imaging.

[59]  Zhong Jin,et al.  Locality Preserving Projections Based on L1 Graph , 2010, 2010 Chinese Conference on Pattern Recognition (CCPR).

[60]  Fernando Pérez-Cruz,et al.  SVM multiregression for nonlinear channel estimation in multiple-input multiple-output systems , 2004, IEEE Transactions on Signal Processing.

[61]  Zhenyue Zhang,et al.  Low-Rank Matrix Approximation with Manifold Regularization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[62]  Marie-Pierre Jolly,et al.  Automatic Segmentation of the Left Ventricle in Cardiac MR and CT Images , 2006, International Journal of Computer Vision.

[63]  Ling Shao,et al.  Local Feature Discriminant Projection , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[64]  H. Alkadhi,et al.  MRI and CT in the diagnosis of coronary artery disease: indications and applications , 2010, Insights into imaging.

[65]  Alistair A. Young,et al.  Modelling passive diastolic mechanics with quantitative MRI of cardiac structure and function , 2009, Medical Image Anal..

[66]  P. Thomas Fletcher,et al.  Geodesic Regression and the Theory of Least Squares on Riemannian Manifolds , 2012, International Journal of Computer Vision.

[67]  G. Wahba,et al.  A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines , 1970 .

[68]  Olivier Ecabert,et al.  Automatic Model-Based Segmentation of the Heart in CT Images , 2008, IEEE Transactions on Medical Imaging.

[69]  John Ashburner,et al.  Kernel regression for fMRI pattern prediction , 2011, NeuroImage.

[70]  Ronald M. Summers,et al.  Machine learning and radiology , 2012, Medical Image Anal..

[71]  Daniel Rueckert,et al.  Right ventricle segmentation from cardiac MRI: A collation study , 2015, Medical Image Anal..

[72]  Xiantong Zhen,et al.  Direct Estimation of Cardiac Bi-ventricular Volumes with Regression Forests , 2014, MICCAI.

[73]  Jieping Ye,et al.  Generalized Low Rank Approximations of Matrices , 2005, Machine Learning.