fMRI analysis on the GPU - Possibilities and challenges

Functional magnetic resonance imaging (fMRI) makes it possible to non-invasively measure brain activity with high spatial resolution. There are however a number of issues that have to be addressed. One is the large amount of spatio-temporal data that needs to be processed. In addition to the statistical analysis itself, several preprocessing steps, such as slice timing correction and motion compensation, are normally applied. The high computational power of modern graphic cards has already successfully been used for MRI and fMRI. Going beyond the first published demonstration of GPU-based analysis of fMRI data, all the preprocessing steps and two statistical approaches, the general linear model (GLM) and canonical correlation analysis (CCA), have been implemented on a GPU. For an fMRI dataset of typical size (80 volumes with 64×64×22voxels), all the preprocessing takes about 0.5s on the GPU, compared to 5s with an optimized CPU implementation and 120s with the commonly used statistical parametric mapping (SPM) software. A random permutation test with 10,000 permutations, with smoothing in each permutation, takes about 50s if three GPUs are used, compared to 0.5-2.5h with an optimized CPU implementation. The presented work will save time for researchers and clinicians in their daily work and enables the use of more advanced analysis, such as non-parametric statistics, both for conventional fMRI and for real-time fMRI.

[1]  Barbara Chapman,et al.  Using OpenMP - portable shared memory parallel programming , 2007, Scientific and engineering computation.

[2]  R W Cox,et al.  Real‐time 3D image registration for functional MRI , 1999, Magnetic resonance in medicine.

[3]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[4]  Tomoya Yamada,et al.  On the permutation test in canonical correlation analysis , 2006, Comput. Stat. Data Anal..

[5]  Adelino R. Ferreira da Silva,et al.  A Bayesian multilevel model for fMRI data analysis , 2011, Comput. Methods Programs Biomed..

[6]  Dietmar Cordes,et al.  Novel ROC‐type method for testing the efficiency of multivariate statistical methods in fMRI , 2003, Magnetic resonance in medicine.

[7]  Julie A. Dickerson,et al.  Monte Carlo randomization tests for large-scale abundance datasets on the GPU , 2011, Comput. Methods Programs Biomed..

[8]  Werner M. Jainek,et al.  Illustrative Hybrid Visualization and Exploration of Anatomical and Functional Brain Data , 2008, Comput. Graph. Forum.

[9]  Roberto Viviani,et al.  Non-normality and transformations of random fields, with an application to voxel-based morphometry , 2007, NeuroImage.

[10]  Tim McGraw,et al.  Stochastic DT-MRI Connectivity Mapping on the GPU , 2007, IEEE Transactions on Visualization and Computer Graphics.

[11]  Markus Gipp,et al.  Correlation analysis on GPU systems using NVIDIA’s CUDA , 2011, Journal of Real-Time Image Processing.

[12]  Ian T. Foster,et al.  Accelerating Medical Research using the Swift Workflow System , 2007, HealthGrid.

[13]  Carl-Fredrik Westin,et al.  Resampling fMRI time series , 2005, NeuroImage.

[14]  Richard J. Davidson,et al.  Comparison of fMRI motion correction software tools , 2005, NeuroImage.

[15]  P. Sen,et al.  Restricted canonical correlations , 1994 .

[16]  Hans Knutsson,et al.  Phase-based multidimensional volume registration , 2000, IEEE Transactions on Medical Imaging.

[17]  Matthew K. Belmonte,et al.  Permutation testing made practical for functional magnetic resonance image analysis , 2001, IEEE Transactions on Medical Imaging.

[18]  John D E Gabrieli,et al.  Control over brain activation and pain learned by using real-time functional MRI. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[20]  R W Cox,et al.  Real‐Time Functional Magnetic Resonance Imaging , 1995, Magnetic resonance in medicine.

[21]  Thomas E. Nichols,et al.  Nonparametric permutation tests for functional neuroimaging: A primer with examples , 2002, Human brain mapping.

[22]  Yi-Ching Lynn Ho,et al.  Parallel Imaging Techniques in Functional MRI , 2004, Topics in magnetic resonance imaging : TMRI.

[23]  Douglas C. Noll,et al.  Online Analysis of Functional MRI Datasets on Parallel Platforms , 1997, The Journal of Supercomputing.

[24]  Karl J. Friston,et al.  The slice-timing problem in event-related fMRI , 1999 .

[25]  R. DeCharms Applications of real-time fMRI , 2008, Nature Reviews Neuroscience.

[26]  Huiyang Zhou,et al.  Accelerating MATLAB Image Processing Toolbox functions on GPUs , 2010, GPGPU-3.

[27]  Toshiharu Nakai,et al.  Real‐time functional MRI using a PC cluster , 2003 .

[28]  Dietmar Cordes,et al.  Novel nonparametric approach to canonical correlation analysis with applications to low CNR functional MRI data , 2003, Magnetic resonance in medicine.

[29]  Mark W. Woolrich,et al.  Fully Bayesian spatio-temporal modeling of FMRI data , 2004, IEEE Transactions on Medical Imaging.

[30]  Barbara Chapman,et al.  Using OpenMP: Portable Shared Memory Parallel Programming (Scientific and Engineering Computation) , 2007 .

[31]  Henrik Ohlsson,et al.  Concurrent Volume Visualization of Real-Time fMRI , 2010, VG@Eurographics.

[32]  S C Williams,et al.  Generic brain activation mapping in functional magnetic resonance imaging: a nonparametric approach. , 1997, Magnetic resonance imaging.

[33]  Ravi S. Menon,et al.  Intrinsic signal changes accompanying sensory stimulation: functional brain mapping with magnetic resonance imaging. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Daniel Gembris,et al.  Functional Magnetic Resonance Imaging in Real-Time (FIRE) , 2000 .

[35]  P. Basser,et al.  MR diffusion tensor spectroscopy and imaging. , 1994, Biophysical journal.

[36]  S Posse,et al.  Functional magnetic resonance imaging in real time (FIRE): Sliding‐window correlation analysis and reference‐vector optimization , 2000, Magnetic resonance in medicine.

[37]  Xiaoping P. Hu,et al.  Real‐time fMRI using brain‐state classification , 2007, Human brain mapping.

[38]  Wei Liu,et al.  Spatial Regularization of Functional Connectivity Using High-Dimensional Markov Random Fields , 2010, MICCAI.

[39]  Satoshi Matsuoka,et al.  Bandwidth intensive 3-D FFT kernel for GPUs using CUDA , 2008, 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis.

[40]  Hans Knutsson,et al.  Fast Random Permutation Tests Enable Objective Evaluation of Methods for Single-Subject fMRI Analysis , 2011, Int. J. Biomed. Imaging.

[41]  J. Hennig,et al.  Three‐dimensional MR‐encephalography: Fast volumetric brain imaging using rosette trajectories , 2011, Magnetic resonance in medicine.

[42]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[43]  Josef Pfeuffer,et al.  Isotropic sub-millimeter fMRI in humans at 7T , 2010 .

[44]  Hans Knutsson,et al.  Phase based volume registration using cuda , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[45]  Henrik Ohlsson,et al.  Using Real-Time fMRI to Control a Dynamical System by Brain Activity Classification , 2009, MICCAI.

[46]  Hans Knutsson,et al.  Detection and detrending in fMRI data analysis , 2004, NeuroImage.

[47]  P. J. Jennings,et al.  Time series analysis in the time domain and resampling methods for studies of functional magnetic resonance brain imaging , 1997, Human brain mapping.

[48]  Thomas Ertl,et al.  GPU-based Multi-Volume Rendering for the Visualization of Functional Brain Images , 2006, SimVis.

[49]  Johan Wessberg,et al.  An Evolutionary Approach to the Identification of Informative Voxel Clusters for Brain State Discrimination , 2008, IEEE Journal of Selected Topics in Signal Processing.

[50]  Hans Knutsson,et al.  Signal processing for computer vision , 1994 .

[51]  S.C. Strother,et al.  Evaluating fMRI preprocessing pipelines , 2006, IEEE Engineering in Medicine and Biology Magazine.

[52]  Kouros Owzar,et al.  permGPU: Using graphics processing units in RNA microarray association studies , 2010, BMC Bioinformatics.

[53]  B. Biswal,et al.  Functional connectivity in the motor cortex of resting human brain using echo‐planar mri , 1995, Magnetic resonance in medicine.

[54]  Adelino Ferreira da Silva,et al.  cudaBayesreg: Bayesian Computation in CUDA , 2010, R J..

[55]  Hans Knutsson,et al.  Adaptive analysis of fMRI data , 2003, NeuroImage.

[56]  Jie Cheng,et al.  Programming Massively Parallel Processors. A Hands-on Approach , 2010, Scalable Comput. Pract. Exp..

[57]  Henrik Ohlsson,et al.  A Brain Computer Interface for Communication Using Real-Time fMRI , 2010, 2010 20th International Conference on Pattern Recognition.

[58]  Kurt Keutzer,et al.  Fast support vector machine training and classification on graphics processors , 2008, ICML '08.

[59]  Hans Knutsson,et al.  Phase-based multidimensional volume registration , 2002 .

[60]  Michael Brady,et al.  Phase mutual information as a similarity measure for registration , 2005, Medical Image Anal..

[61]  Rodney A. Kennedy,et al.  A Survey of Medical Image Registration on Multicore and the GPU , 2010, IEEE Signal Processing Magazine.

[62]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[63]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[64]  H. Knutsson,et al.  Detection of neural activity in functional MRI using canonical correlation analysis , 2001, Magnetic resonance in medicine.

[65]  D. Cordes,et al.  Constrained CCA with Different Novel Linear Constraints and a Nonlinear Constraint in fMRI , 2009 .

[66]  Hans Knutsson,et al.  On rotational invariance in adaptive spatial filtering of fMRI data , 2006, NeuroImage.

[67]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[68]  Hans Knutsson,et al.  A GPU accelerated interactive interface for exploratory functional connectivity analysis of FMRI data , 2011, 2011 18th IEEE International Conference on Image Processing.

[69]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[70]  Justin P. Haldar,et al.  Accelerating advanced mri reconstructions on gpus , 2008, CF '08.