Applying independent component analysis to detect silent speech in magnetic resonance imaging signals

Independent component analysis (ICA) can be usefully applied to functional imaging studies to evaluate the spatial extent and temporal profile of task‐related brain activity. It requires no a priori assumptions about the anatomical areas that are activated or the temporal profile of the activity. We applied spatial ICA to detect a voluntary but hidden response of silent speech. To validate the method against a standard model‐based approach, we used the silent speech of a tongue twister as a ‘Yes’ response to single questions that were delivered at given times. In the first task, we attempted to estimate one number that was chosen by a participant from 10 possibilities. In the second task, we increased the possibilities to 1000. In both tasks, spatial ICA was as effective as the model‐based method for determining the number in the subject’s mind (80–90% correct per digit), but spatial ICA outperformed the model‐based method in terms of time, especially in the 1000‐possibility task. In the model‐based method, calculation time increased by 30‐fold, to 15 h, because of the necessity of testing 1000 possibilities. In contrast, the calculation time for spatial ICA remained as short as 30 min. In addition, spatial ICA detected an unexpected response that occurred by mistake. This advantage was validated in a third task, with 13 500 possibilities, in which participants had the freedom to choose when to make one of four responses. We conclude that spatial ICA is effective for detecting the onset of silent speech, especially when it occurs unexpectedly.

[1]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[2]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[3]  S. Takashima,et al.  Journal of Cerebral Blood Flow and Metabolism Human Visual Cortical Function during Photic Stimulation Monitoring by Means of Near-infrared Spectroscopy Subjects and Methods , 2022 .

[4]  G. Rees,et al.  Predicting the Stream of Consciousness from Activity in Human Visual Cortex , 2005, Current Biology.

[5]  K Ugurbil,et al.  Functional magnetic resonance imaging of Broca's area during internal speech. , 1993, Neuroreport.

[6]  Charles Fernyhough,et al.  Neural correlates of inner speech and auditory verbal hallucinations: a critical review and theoretical integration. , 2007, Clinical psychology review.

[7]  Huafu Chen,et al.  Localization of Latent Epileptic Activities Using Spatio-Temporal Independent Component Analysis of fMRI Data , 2006, Brain Topography.

[8]  M. Tamura,et al.  Detection of dynamic changes in cerebral oxygenation coupled to neuronal function during mental work in man , 1993, Neuroscience Letters.

[9]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[10]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[11]  Paul Allen,et al.  Inner speech models of auditory verbal hallucinations: Evidence from behavioural and neuroimaging studies , 2007, International review of psychiatry.

[12]  F. Jöbsis Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. , 1977, Science.

[13]  P Hagoort,et al.  A neural correlate of syntactic encoding during speech production , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[14]  V D Calhoun,et al.  Spatial and temporal independent component analysis of functional MRI data containing a pair of task‐related waveforms , 2001, Human brain mapping.

[15]  Renaud Jardri,et al.  A case of fMRI-guided rTMS treatment of coenesthetic hallucinations. , 2008, The American journal of psychiatry.

[16]  Shigeru Muraki,et al.  Cortical activity in multiple motor areas during sequential finger movements: An application of independent component analysis , 2005, NeuroImage.

[17]  Stephen M. Smith,et al.  Probabilistic independent component analysis for functional magnetic resonance imaging , 2004, IEEE Transactions on Medical Imaging.

[18]  John D. Carew,et al.  Independent component analysis applied to self-paced functional MR imaging paradigms , 2005, NeuroImage.

[19]  B. Chance,et al.  Cognition-activated low-frequency modulation of light absorption in human brain. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Aapo Hyvärinen,et al.  Independent component analysis of fMRI group studies by self-organizing clustering , 2005, NeuroImage.

[21]  James V. Stone,et al.  Spatiotemporal Independent Component Analysis of Event-Related fMRI Data Using Skewed Probability Density Functions , 2002, NeuroImage.

[22]  R. Gur,et al.  Telling truth from lie in individual subjects with fast event‐related fMRI , 2005, Human brain mapping.

[23]  E. Skinhøj,et al.  Variations in regional cortical blood flow in the right and left hemispheres during automatic speech. , 1978, Brain : a journal of neurology.

[24]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[25]  S. Zeki,et al.  The chronoarchitecture of the cerebral cortex , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[26]  Aapo Hyvärinen,et al.  Validating the independent components of neuroimaging time series via clustering and visualization , 2004, NeuroImage.

[27]  A. Lindell In Your Right Mind: Right Hemisphere Contributions to Language Processing and Production , 2006, Neuropsychology Review.

[28]  Thomas Dierks,et al.  The spatiotemporal pattern of auditory cortical responses during verbal hallucinations , 2005, NeuroImage.

[29]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[30]  J. Haynes Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[31]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[32]  Lang Tong,et al.  Indeterminacy and identifiability of blind identification , 1991 .

[33]  T. Sejnowski,et al.  Independent component analysis at the neural cocktail party , 2001, Trends in Neurosciences.

[34]  E Ryding,et al.  Changes of regional cerebral blood flow measured simultaneously in the right and left hemisphere during automatic speech and humming. , 1987, Brain : a journal of neurology.

[35]  M. Just,et al.  From the Selectedworks of Marcel Adam Just Brain Imaging of Tongue-twister Sentence Comprehension: Twisting the Tongue and the Brain Brain Imaging of Tongue-twister Sentence Comprehension: Twisting the Tongue and the Brain , 2022 .

[36]  R. Passingham,et al.  Reading Hidden Intentions in the Human Brain , 2007, Current Biology.

[37]  Dinggang Shen,et al.  Classifying spatial patterns of brain activity with machine learning methods: Application to lie detection , 2005, NeuroImage.

[38]  C. Segebarth,et al.  fMRI assessment of hemispheric language dominance using a simple inner speech paradigm , 1999, NMR in biomedicine.

[39]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[40]  T. Sejnowski,et al.  Independent component analysis of fMRI data: Examining the assumptions , 1998, Human brain mapping.

[41]  Fabrizio Esposito,et al.  How does spatial extent of fMRI datasets affect independent component analysis decomposition? , 2006, Human brain mapping.

[42]  S. Platek,et al.  Brain mapping of deception and truth telling about an ecologically valid situation: functional MR imaging and polygraph investigation--initial experience. , 2006, Radiology.

[43]  Matthew Brett,et al.  An Evaluation of the Use of Magnetic Field Maps to Undistort Echo-Planar Images , 2003, NeuroImage.

[44]  Vince D. Calhoun,et al.  Alterations in Memory Networks in Mild Cognitive Impairment and Alzheimer's Disease: An Independent Component Analysis , 2006, The Journal of Neuroscience.

[45]  Vincent Schmithorst,et al.  Cognitive modules utilized for narrative comprehension in children: a functional magnetic resonance imaging study , 2006, NeuroImage.

[46]  Philip K. McGuire,et al.  Modulation of activity in temporal cortex during generation of inner speech , 2002, Human brain mapping.

[47]  Kevin A. Johnson,et al.  Detecting Deception Using Functional Magnetic Resonance Imaging , 2005, Biological Psychiatry.

[48]  Stephen M. Smith,et al.  Investigations into resting-state connectivity using independent component analysis , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[49]  Reiko Kawagoe,et al.  Influence of skin blood flow on near-infrared spectroscopy signals measured on the forehead during a verbal fluency task , 2011, NeuroImage.

[50]  Masashi Kiguchi,et al.  A Communication Means for Totally Locked-in ALS Patients Based on Changes in Cerebral Blood Volume Measured with Near-Infrared Light , 2007, IEICE Trans. Inf. Syst..

[51]  F. Tong,et al.  Decoding Seen and Attended Motion Directions from Activity in the Human Visual Cortex , 2006, Current Biology.

[52]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[53]  T. Carr,et al.  Comparing cortical activations for silent and overt speech using event‐related fMRI , 2002, Human brain mapping.

[54]  John G. Neuhoff,et al.  Spatiotemporal Pattern of Neural Processing in the Human Auditory Cortex , 2002, Science.