Variational Autoencoder with Truncated Mixture of Gaussians for Functional Connectivity Analysis

Resting-state functional connectivity states are often identified as clusters of dynamic connectivity patterns. However, existing clustering approaches do not distinguish major states from rarely occurring minor states and hence are sensitive to noise. To address this issue, we propose to model major states using a non-linear generative process guided by a Gaussian-mixture distribution in a low-dimensional latent space, while separately modeling the connectivity patterns of minor states by a non-informative uniform distribution. We embed this truncated Gaussian-Mixture model in a Variational Autoencoder framework to obtain a general joint clustering and outlier detection approach, tGM-VAE. When applied to synthetic data with known ground-truth, tGM-VAE is more accurate in clustering connectivity patterns than existing approaches. On the rs-fMRI of 593 healthy adolescents, tGM-VAE identifies meaningful major connectivity states. The dwell time of these states significantly correlates with age.

[1]  Adolf Pfefferbaum,et al.  Altered Brain Developmental Trajectories in Adolescents After Initiating Drinking. , 2017, The American journal of psychiatry.

[2]  Bhiksha Raj,et al.  Hidden Markov Model Variational Autoencoder for Acoustic Unit Discovery , 2017, INTERSPEECH.

[3]  Adolf Pfefferbaum,et al.  The SRI24 multichannel atlas of normal adult human brain structure , 2009, Human brain mapping.

[4]  Anton van den Hengel,et al.  Infinite Variational Autoencoder for Semi-Supervised Learning , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  A. Belger,et al.  Dynamic functional connectivity analysis reveals transient states of dysconnectivity in schizophrenia , 2014, NeuroImage: Clinical.

[6]  Alfred O. Hero,et al.  Shrinkage Algorithms for MMSE Covariance Estimation , 2009, IEEE Transactions on Signal Processing.

[7]  Jalil Taghia,et al.  Bayesian switching factor analysis for estimating time-varying functional connectivity in fMRI , 2017, NeuroImage.

[8]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[9]  Eswar Damaraju,et al.  Tracking whole-brain connectivity dynamics in the resting state. , 2014, Cerebral cortex.

[10]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[11]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[12]  Yuanyuan Chen,et al.  Age-Related Decline in the Variation of Dynamic Functional Connectivity: A Resting State Analysis , 2017, Front. Aging Neurosci..

[13]  Murray Shanahan,et al.  Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders , 2016, ArXiv.

[14]  Fenna M. Krienen,et al.  Opportunities and limitations of intrinsic functional connectivity MRI , 2013, Nature Neuroscience.

[15]  Mikkel N. Schmidt,et al.  Nonparametric Modeling of Dynamic Functional Connectivity in fMRI Data , 2016, NIPS 2015.

[16]  Torsten Rohlfing,et al.  Influences of Age, Sex, and Moderate Alcohol Drinking on the Intrinsic Functional Architecture of Adolescent Brains , 2018, Cerebral cortex.

[17]  Leonardo L. Gollo,et al.  Time-resolved resting-state brain networks , 2014, Proceedings of the National Academy of Sciences.

[18]  Hao He,et al.  Assessing dynamic brain graphs of time-varying connectivity in fMRI data: Application to healthy controls and patients with schizophrenia , 2015, NeuroImage.

[19]  Padhraic Smyth,et al.  Stick-Breaking Variational Autoencoders , 2016, ICLR.

[20]  Huachun Tan,et al.  Variational Deep Embedding: An Unsupervised and Generative Approach to Clustering , 2016, IJCAI.

[21]  Kilian M. Pohl,et al.  A Riemannian Framework for Longitudinal Analysis of Resting-State Functional Connectivity , 2018, MICCAI.

[22]  Christopher Burgess,et al.  beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework , 2016, ICLR 2016.