The role of diversity in data‐driven analysis of multi‐subject fMRI data: Comparison of approaches based on independence and sparsity using global performance metrics

Data‐driven methods have been widely used in functional magnetic resonance imaging (fMRI) data analysis. They extract latent factors, generally, through the use of a simple generative model. Independent component analysis (ICA) and dictionary learning (DL) are two popular data‐driven methods that are based on two different forms of diversity—statistical properties of the data—statistical independence for ICA and sparsity for DL. Despite their popularity, the comparative advantage of emphasizing one property over another in the decomposition of fMRI data is not well understood. Such a comparison is made harder due to the differences in the modeling assumptions between ICA and DL, as well as within different ICA algorithms where each algorithm exploits a different form of diversity. In this paper, we propose the use of objective global measures, such as time course frequency power ratio, network connection summary, and graph theoretical metrics, to gain insight into the role that different types of diversity have on the analysis of fMRI data. Four ICA algorithms that account for different types of diversity and one DL algorithm are studied. We apply these algorithms to real fMRI data collected from patients with schizophrenia and healthy controls. Our results suggest that no one particular method has the best performance using all metrics, implying that the optimal method will change depending on the goal of the analysis. However, we note that in none of the scenarios we test the highly popular Infomax provides the best performance, demonstrating the cost of exploiting limited form of diversity.

[1]  Karl J. Friston,et al.  Dysconnection in Schizophrenia: From Abnormal Synaptic Plasticity to Failures of Self-monitoring , 2009, Schizophrenia bulletin.

[2]  A. Belger,et al.  Dynamic functional connectivity analysis reveals transient states of dysconnectivity in schizophrenia , 2014, NeuroImage: Clinical.

[3]  Sotirios A. Tsaftaris,et al.  Medical Image Computing and Computer Assisted Intervention , 2017 .

[4]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[5]  Xiangyu Long,et al.  Functional segmentation of the brain cortex using high model order group PICA , 2009, Human brain mapping.

[6]  J. Minei,et al.  Alcohol intoxication. , 1998, Journal of accident & emergency medicine.

[7]  Edward T. Bullmore,et al.  Network-based statistic: Identifying differences in brain networks , 2010, NeuroImage.

[8]  J. Pekar,et al.  A method for making group inferences from functional MRI data using independent component analysis , 2001, Human brain mapping.

[9]  Saeid Sanei,et al.  Fast and incoherent dictionary learning algorithms with application to fMRI , 2015, Signal Image Video Process..

[10]  V. Calhoun,et al.  Multisubject Independent Component Analysis of fMRI: A Decade of Intrinsic Networks, Default Mode, and Neurodiagnostic Discovery , 2012, IEEE Reviews in Biomedical Engineering.

[11]  Vince D. Calhoun,et al.  A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data , 2009, NeuroImage.

[12]  Bernard Ng,et al.  Optimization of rs-fMRI Pre-processing for Enhanced Signal-Noise Separation, Test-Retest Reliability, and Group Discrimination , 2015, NeuroImage.

[13]  Jean-Francois Mangin,et al.  What is the best similarity measure for motion correction in fMRI time series? , 2002, IEEE Transactions on Medical Imaging.

[14]  Vince D. Calhoun,et al.  A graph theoretical approach for performance comparison of ICA for fMRI analysis , 2017, 2017 51st Annual Conference on Information Sciences and Systems (CISS).

[15]  Tülay Adali,et al.  Comparison of multi‐subject ICA methods for analysis of fMRI data , 2010, Human brain mapping.

[16]  M. V. D. Heuvel,et al.  Exploring the brain network: A review on resting-state fMRI functional connectivity , 2010, European Neuropsychopharmacology.

[17]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[18]  Vince D. Calhoun,et al.  Sparsity and Independence: Balancing Two Objectives in Optimization for Source Separation with Application to fMRI Analysis , 2017, J. Frankl. Inst..

[19]  S Makeig,et al.  Analysis of fMRI data by blind separation into independent spatial components , 1998, Human brain mapping.

[20]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[21]  John Suckling,et al.  Global, voxel, and cluster tests, by theory and permutation, for a difference between two groups of structural MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[22]  Xiaoping Hu,et al.  Correction for the T1 effect incorporating flip angle estimated by Kalman filter in cardiac‐gated functional MRI , 2013, Magnetic resonance in medicine.

[23]  Vince D. Calhoun,et al.  Performance of blind source separation algorithms for fMRI analysis using a group ICA method. , 2007, Magnetic resonance imaging.

[24]  Frank Nielsen,et al.  A closed-form expression for the Sharma–Mittal entropy of exponential families , 2011, ArXiv.

[25]  Tülay Adalı,et al.  Diversity in Independent Component and Vector Analyses: Identifiability, algorithms, and applications in medical imaging , 2014, IEEE Signal Processing Magazine.

[26]  Tülay Adali,et al.  Estimating the number of independent components for functional magnetic resonance imaging data , 2007, Human brain mapping.

[27]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[28]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[29]  Vince D. Calhoun,et al.  Modulations of functional connectivity in the healthy and schizophrenia groups during task and rest , 2012, NeuroImage.

[30]  Dimitris Samaras,et al.  Extracting Brain Regions from Rest fMRI with Total-Variation Constrained Dictionary Learning , 2013, MICCAI.

[31]  Paul J. Laurienti,et al.  An exploration of graph metric reproducibility in complex brain networks , 2013, Front. Neurosci..

[32]  Ranu Jung,et al.  Computational Neuroscience (CNS*2007) , 2007, BMC Neuroscience.

[33]  Sungho Tak,et al.  A Data-Driven Sparse GLM for fMRI Analysis Using Sparse Dictionary Learning With MDL Criterion , 2011, IEEE Transactions on Medical Imaging.

[34]  Bryon A. Mueller,et al.  Altered resting state complexity in schizophrenia , 2012, NeuroImage.

[35]  V. Haughton,et al.  Frequencies contributing to functional connectivity in the cerebral cortex in "resting-state" data. , 2001, AJNR. American journal of neuroradiology.

[36]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Scott T. Rickard,et al.  Comparing Measures of Sparsity , 2008, IEEE Transactions on Information Theory.

[38]  Wei Du,et al.  The role of diversity in complex ICA algorithms for fMRI analysis , 2016, Journal of Neuroscience Methods.

[39]  Vinod Menon,et al.  Functional connectivity in the resting brain: A network analysis of the default mode hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Gaël Varoquaux,et al.  Multi-subject Dictionary Learning to Segment an Atlas of Brain Spontaneous Activity , 2011, IPMI.

[41]  Rex E. Jung,et al.  Multimodal Neuroimaging in Schizophrenia: Description and Dissemination , 2017, Neuroinformatics.

[42]  R. Murray,et al.  The dysplastic net hypothesis: an integration of developmental and dysconnectivity theories of schizophrenia , 1997, Schizophrenia Research.

[43]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[44]  Rex E. Jung,et al.  A Baseline for the Multivariate Comparison of Resting-State Networks , 2011, Front. Syst. Neurosci..

[45]  David Bull,et al.  International Conference on Acoustics, Speech and Signal Processing (ICASSP'02) , 2002 .

[46]  J. Rapoport,et al.  Simple models of human brain functional networks , 2012, Proceedings of the National Academy of Sciences.

[47]  Vince D. Calhoun,et al.  Comparison of IVA and GIG-ICA in Brain Functional Network Estimation Using fMRI Data , 2017, Front. Neurosci..

[48]  I Daubechies,et al.  Independent component analysis for brain fMRI does not select for independence , 2009 .

[49]  Vince D. Calhoun,et al.  ICA of fMRI data: Performance of three ICA algorithms and the importance of taking correlation information into account , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[50]  Phillip Bonacich,et al.  Some unique properties of eigenvector centrality , 2007, Soc. Networks.

[51]  M. N. Goria,et al.  A new class of random vector entropy estimators and its applications in testing statistical hypotheses , 2005 .

[52]  Vince D. Calhoun,et al.  Joint Blind Source Separation by Multiset Canonical Correlation Analysis , 2009, IEEE Transactions on Signal Processing.

[53]  Eswar Damaraju,et al.  Tracking whole-brain connectivity dynamics in the resting state. , 2014, Cerebral cortex.

[54]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[55]  J. Pekar,et al.  Alcohol Intoxication Effects on Simulated Driving: Exploring Alcohol-Dose Effects on Brain Activation Using Functional MRI , 2004, Neuropsychopharmacology.

[56]  Danielle S Bassett,et al.  Brain graphs: graphical models of the human brain connectome. , 2011, Annual review of clinical psychology.

[57]  Tülay Adali,et al.  Likelihood Estimators for Dependent Samples and Their Application to Order Detection , 2014, IEEE Transactions on Signal Processing.

[58]  O. Tervonen,et al.  The effect of model order selection in group PICA , 2010, Human brain mapping.

[59]  Honglak Lee,et al.  Efficient L1 Regularized Logistic Regression , 2006, AAAI.

[60]  Edward T. Bullmore,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[61]  Dinggang Shen,et al.  Machine Learning in Medical Imaging , 2012, Lecture Notes in Computer Science.

[62]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[63]  Tülay Adali,et al.  Blind spatiotemporal separation of second and/or higher-order correlated sources by entropy rate minimization , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[64]  Barak A. Pearlmutter,et al.  Independent Component Analysis for Brain fMRI Does Indeed Select for Maximal Independence , 2013, PLoS ONE.

[65]  Tülay Adali,et al.  Independent Component Analysis by Entropy Bound Minimization , 2010, IEEE Transactions on Signal Processing.

[66]  Tülay Adali,et al.  Enhancing ICA performance by exploiting sparsity: Application to FMRI analysis , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[67]  Kaiming Li,et al.  Review of methods for functional brain connectivity detection using fMRI , 2009, Comput. Medical Imaging Graph..

[68]  Vince D. Calhoun,et al.  Investigation of relationships between fMRI brain networks in the spectral domain using ICA and Granger causality reveals distinct differences between schizophrenia patients and healthy controls , 2009, NeuroImage.

[69]  Assia Jaillard,et al.  Reliability of graph analysis of resting state fMRI using test-retest dataset from the Human Connectome Project , 2016, NeuroImage.

[70]  U. Sailer,et al.  A resting state network in the motor control circuit of the basal ganglia , 2009, BMC Neuroscience.

[71]  Jessica A. Turner,et al.  COINS: An Innovative Informatics and Neuroimaging Tool Suite Built for Large Heterogeneous Datasets , 2011, Front. Neuroinform..

[72]  Vince D. Calhoun,et al.  Order detection for fMRI analysis: Joint estimation of downsampling depth and order by information theoretic criteria , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[73]  Vince D. Calhoun,et al.  Thalamus and posterior temporal lobe show greater inter-network connectivity at rest and across sensory paradigms in schizophrenia , 2014, NeuroImage.

[74]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[75]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[76]  E. Bullmore,et al.  Behavioral / Systems / Cognitive Functional Connectivity and Brain Networks in Schizophrenia , 2010 .

[77]  N. Filippini,et al.  Group comparison of resting-state FMRI data using multi-subject ICA and dual regression , 2009, NeuroImage.

[78]  P. Bonacich Power and Centrality: A Family of Measures , 1987, American Journal of Sociology.

[79]  Hao He,et al.  Assessing dynamic brain graphs of time-varying connectivity in fMRI data: Application to healthy controls and patients with schizophrenia , 2015, NeuroImage.