Computing group cardinality constraint solutions for logistic regression problems

&NA; We derive an algorithm to directly solve logistic regression based on cardinality constraint, group sparsity and use it to classify intra‐subject MRI sequences (e.g. cine MRIs) of healthy from diseased subjects. Group cardinality constraint models are often applied to medical images in order to avoid overfitting of the classifier to the training data. Solutions within these models are generally determined by relaxing the cardinality constraint to a weighted feature selection scheme. However, these solutions relate to the original sparse problem only under specific assumptions, which generally do not hold for medical image applications. In addition, inferring clinical meaning from features weighted by a classifier is an ongoing topic of discussion. Avoiding weighing features, we propose to directly solve the group cardinality constraint logistic regression problem by generalizing the Penalty Decomposition method. To do so, we assume that an intra‐subject series of images represents repeated samples of the same disease patterns. We model this assumption by combining series of measurements created by a feature across time into a single group. Our algorithm then derives a solution within that model by decoupling the minimization of the logistic regression function from enforcing the group sparsity constraint. The minimum to the smooth and convex logistic regression problem is determined via gradient descent while we derive a closed form solution for finding a sparse approximation of that minimum. We apply our method to cine MRI of 38 healthy controls and 44 adult patients that received reconstructive surgery of Tetralogy of Fallot (TOF) during infancy. Our method correctly identifies regions impacted by TOF and generally obtains statistically significant higher classification accuracy than alternative solutions to this model, i.e., ones relaxing group cardinality constraints. HighlightsModel concurrent disease classification and temporal‐consistent pattern selection.Minimize model by directly solving logistic regression confined by group cardinality.Correctly identify ROIs differentiating the cine MRs of 44 TOF from 38 controls.Generally significantly more accurate than approaches relaxing group sparsity. Graphical abstract Figure. No caption available.

[1]  R. Anderson Tetralogy of Fallot. , 1991, The Annals of thoracic surgery.

[2]  Hui Wang,et al.  Cardiac Motion and Deformation Recovery From MRI: A Review , 2012, IEEE Transactions on Medical Imaging.

[3]  Yusuf Yaslan,et al.  Ensemble based classifiers using dictionary learning , 2016, 2016 International Conference on Systems, Signals and Image Processing (IWSSIP).

[4]  Ben Glocker,et al.  4D Ventricular Segmentation and Wall Motion Estimation Using Efficient Discrete Optimization , 2007, ISVC.

[5]  Jian Huang,et al.  Penalized feature selection and classification in bioinformatics , 2008, Briefings Bioinform..

[6]  Yang Yu,et al.  Deformable models with sparsity constraints for cardiac motion analysis , 2014, Medical Image Anal..

[7]  Yueting Zhuang,et al.  Heterogeneous feature selection by group lasso with logistic regression , 2010, ACM Multimedia.

[8]  Terry M. Peters,et al.  Regional Assessment of Cardiac Left Ventricular Myocardial Function via MRI Statistical Features , 2014, IEEE Transactions on Medical Imaging.

[9]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[10]  Robert H. Anderson,et al.  Tetralogy of Fallot , 2009, Orphanet journal of rare diseases.

[11]  Daniel Rueckert,et al.  Hierarchical Manifold Learning for Regional Image Analysis , 2014, IEEE Transactions on Medical Imaging.

[12]  Kilian M. Pohl,et al.  Regional Manifold Learning for Disease Classification , 2014, IEEE Transactions on Medical Imaging.

[13]  P. Schellhammer,et al.  Data Reduction Using a Discrete Wavelet Transform in Discriminant Analysis of Very High Dimensionality Data , 2003, Biometrics.

[14]  William M. Wells,et al.  A Feature-Based Developmental Model of the Infant Brain in Structural MRI , 2012, MICCAI.

[15]  Shutao Li,et al.  Group-Sparse Representation With Dictionary Learning for Medical Image Denoising and Fusion , 2012, IEEE Transactions on Biomedical Engineering.

[16]  A. Ravishankar Rao,et al.  Prediction and interpretation of distributed neural activity with sparse models , 2009, NeuroImage.

[17]  Paul M. Thompson,et al.  Sparse reduced-rank regression detects genetic associations with voxel-wise longitudinal phenotypes in Alzheimer's disease , 2012, NeuroImage.

[18]  Hervé Delingette,et al.  Deformable biomechanical models: Application to 4D cardiac image analysis , 2003, Medical Image Anal..

[19]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[20]  Yong Zhang,et al.  Sparse Approximation via Penalty Decomposition Methods , 2012, SIAM J. Optim..

[21]  Nicholas Ayache,et al.  Layered Spatio-temporal Forests for Left Ventricle Segmentation from 4D Cardiac MRI Data , 2011, STACOM.

[22]  Ghassan Hamarneh,et al.  Generalized Sparse Classifiers for Decoding Cognitive States in fMRI , 2010, MLMI.

[23]  E. Jacquemin,et al.  Progressive familial intrahepatic cholestasis , 2009, Orphanet journal of rare diseases.

[24]  Daniel Rueckert,et al.  A Combined Manifold Learning Analysis of Shape and Appearance to Characterize Neonatal Brain Development , 2011, IEEE Transactions on Medical Imaging.

[25]  Daoqiang Zhang,et al.  Ensemble sparse classification of Alzheimer's disease , 2012, NeuroImage.

[26]  Qingshan Liu,et al.  Identifying Regional Cardiac Abnormalities From Myocardial Strains Using Nontracking-Based Strain Estimation and Spatio-Temporal Tensor Analysis , 2011, IEEE Transactions on Medical Imaging.

[27]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[28]  G. Langs,et al.  Fetal MRI detects early alterations of brain development in Tetralogy of Fallot. , 2015, American journal of obstetrics and gynecology.

[29]  Anil Rao,et al.  Classification of Alzheimer's Disease from structural MRI using sparse logistic regression with optional spatial regularization , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Daniel Rueckert,et al.  Analysis of 3-D myocardial motion in tagged MR images using nonrigid image registration , 2004, IEEE Transactions on Medical Imaging.

[31]  Daniel Rueckert,et al.  Unsupervised Learning of Shape Complexity: Application to Brain Development , 2012, STIA.

[32]  Jerry L Prince,et al.  Cardiac motion tracking using CINE harmonic phase (HARP) magnetic resonance imaging , 1999, Magnetic resonance in medicine.

[33]  Maxime Sermesant,et al.  Statistical Shape Analysis of Surfaces in Medical Images Applied to the Tetralogy of Fallot Heart , 2013 .

[34]  Heng Huang,et al.  Sparse representation of whole-brain fMRI signals for identification of functional networks , 2015, Medical Image Anal..

[35]  Shuiwang Ji,et al.  SLEP: Sparse Learning with Efficient Projections , 2011 .

[36]  Daniel Rueckert,et al.  Learning a Global Descriptor of Cardiac Motion from a Large Cohort of 1000+ Normal Subjects , 2015, FIMH.

[37]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[38]  Mert R. Sabuncu,et al.  Spatiotemporal Linear Mixed Effects Modeling for the Mass-univariate Analysis of Longitudinal Neuroimage Data ⁎ for the Alzheimer's Disease Neuroimaging Initiative 1 , 2022 .

[39]  Michael I. Miller,et al.  Longitudinal characterization of brain atrophy of a Huntington's disease mouse model by automated morphological analyses of magnetic resonance images , 2010, NeuroImage.

[40]  Daoqiang Zhang,et al.  Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer's disease , 2012, NeuroImage.

[41]  Milan Sonka,et al.  4-D Cardiac MR Image Analysis: Left and Right Ventricular Morphology and Function , 2010, IEEE Transactions on Medical Imaging.

[42]  Dimitris N. Metaxas,et al.  Deformable segmentation via sparse representation and dictionary learning , 2012, Medical Image Anal..

[43]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[44]  Mert R. Sabuncu A Universal and Efficient Method to Compute Maps from Image-Based Prediction Models , 2014, MICCAI.

[45]  Christian Barillot,et al.  Detection of Multiple Sclerosis Lesions using Sparse Representations and Dictionary Learning , 2014 .

[46]  Brigitte Landeau,et al.  Using voxel-based morphometry to map the structural changes associated with rapid conversion in MCI: A longitudinal MRI study , 2005, NeuroImage.

[47]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[48]  Kilian M. Pohl,et al.  Solving Logistic Regression with Group Cardinality Constraints for Time Series Analysis , 2015, MICCAI.

[49]  Kaustubh Supekar,et al.  Sparse logistic regression for whole-brain classification of fMRI data , 2010, NeuroImage.

[50]  Mohan S. Kankanhalli,et al.  Multimodal fusion for multimedia analysis: a survey , 2010, Multimedia Systems.

[51]  R. Tibshirani,et al.  A note on the group lasso and a sparse group lasso , 2010, 1001.0736.

[52]  Dinggang Shen,et al.  Estimating myocardial motion by 4D image warping , 2009, Pattern Recognit..

[53]  Andrew Blake,et al.  Random Forest Classification for Automatic Delineation of Myocardium in Real-Time 3D Echocardiography , 2009, FIMH.

[54]  Masa-aki Sato,et al.  Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns , 2008, NeuroImage.

[55]  Fillia Makedon,et al.  A Prediction Framework for Cardiac Resynchronization Therapy Via 4D Cardiac Motion Analysis , 2005, MICCAI.

[56]  Idith Haber,et al.  Effects of Regional Dysfunction and Late Gadolinium Enhancement on Global Right Ventricular Function and Exercise Capacity in Patients With Repaired Tetralogy of Fallot , 2009, Circulation.

[57]  P. Bühlmann,et al.  The group lasso for logistic regression , 2008 .