Psychophysiology-informed (multimodal) imaging.

Electroencephalography (EEG) and magnetic resonance imaging are two popular methodologies for brain research. While EEG has a high temporal resolution, yet a low spatial resolution, MRI has the complete opposite, a high spatial resolution, yet a low temporal resolution. Obviously therefore, researchers have been searching for ways combining the two methodologies, for more than two decades. However, there are many issues that have to be solved before the methodologies can be successfully and, more importantly reliably, combined. Here, we give an overview of these issues, and present strategies that have been used over the past two decades to overcome them. We start with a general description of EEG and (f)MRI methodology, then present the difficulties involved in combining both methodologies, and lastly present and discuss the most popular strategies that have been used over the past two decades to solve these problems. We conclude that in spite of the many issues, the two methodologies can be combined successfully, provided that the correct procedures are followed.

[1]  R Jung,et al.  [Fiftieth anniversary of Hans Berger's publication of the electroencephalogram. His first records in 1924--1931 (author's transl)]. , 1979, Archiv fur Psychiatrie und Nervenkrankheiten.

[2]  Cristiane Fregonesi Dutra Garcia,et al.  Brainstem auditory evoked potentials in smokers , 2016 .

[3]  Monte S. Buchsbaum,et al.  Frontal–striatal–thalamic mediodorsal nucleus dysfunction in schizophrenia-spectrum patients during sensorimotor gating , 2008, NeuroImage.

[4]  S. Debener,et al.  Mining EEG-fMRI using independent component analysis. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[5]  A. Villringer,et al.  Simultaneous EEG–fMRI , 2006, Neuroscience & Biobehavioral Reviews.

[6]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[7]  H. Berger,et al.  Über das Elektrenkephalogramm des Menschen , 1937, Archiv für Psychiatrie und Nervenkrankheiten.

[8]  A Pfefferbaum,et al.  Event-related potentials in the study of psychiatric disorders. , 1995, Archives of general psychiatry.

[9]  Egill Rostrup,et al.  Source localization of sensory gating: A combined EEG and fMRI study in healthy volunteers , 2011, NeuroImage.

[10]  R. Barry,et al.  A review of electrophysiology in attention-deficit/hyperactivity disorder: II. Event-related potentials , 2003, Clinical Neurophysiology.

[11]  Cheuk Y. Tang,et al.  Thalamic activation during an attention-to-prepulse startle modification paradigm: a functional MRI study , 2001, Biological Psychiatry.

[12]  N. Jon Shah,et al.  Nicotine effects on anterior cingulate cortex in schizophrenia and healthy smokers as revealed by EEG-informed fMRI , 2012, Psychiatry Research: Neuroimaging.

[13]  S. Debener,et al.  Simultaneous recording of EEG and BOLD responses: a historical perspective. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  B. Glenthøj,et al.  P50 suppression and its neural generators in antipsychotic-naive first-episode schizophrenia before and after 6 months of quetiapine treatment. , 2013, Schizophrenia bulletin.

[15]  Aureliu Lavric,et al.  ERP differences with vs. without concurrent fMRI. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  Egill Rostrup,et al.  Concurrent functional magnetic resonance imaging and electroencephalography assessment of sensory gating in schizophrenia , 2013, Human brain mapping.

[17]  P. Teale,et al.  Reduced hippocampal volume in association with p50 nonsuppression following traumatic brain injury. , 2001, The Journal of neuropsychiatry and clinical neurosciences.

[18]  U Hegerl,et al.  Event-related potentials: Do they reflect central serotonergic neurotransmission and do they predict clinical response to serotonin agonists? , 2001 .

[19]  Vincent P. Clark,et al.  The neural networks underlying auditory sensory gating , 2009, NeuroImage.

[20]  O. Markand,et al.  Brainstem Auditory Evoked Potentials , 1994, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[21]  M. Geyer,et al.  Cortical grey matter volume and sensorimotor gating in schizophrenia , 2008, Cortex.

[22]  D. Kupfer,et al.  Electroencephalographic sleep in schizophrenia: a critical review. , 1990, Comprehensive psychiatry.

[23]  C. C. Duncan,et al.  Event-related potential abnormalities correlate with structural brain alterations and clinical features in patients with chronic schizophrenia , 1994, Schizophrenia Research.

[24]  Louis Lemieux,et al.  Identification of EEG Events in the MR Scanner: The Problem of Pulse Artifact and a Method for Its Subtraction , 1998, NeuroImage.

[25]  Egill Rostrup,et al.  Correlation between single‐trial visual evoked potentials and the blood oxygenation level dependent response in simultaneously recorded electroencephalography–functional magnetic resonance imaging , 2012, Magnetic resonance in medicine.

[26]  O. Mecarelli,et al.  Clinical Electroencephalography , 2019 .

[27]  D. Tank,et al.  Brain magnetic resonance imaging with contrast dependent on blood oxygenation. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Patrick Berg,et al.  Advanced Tools for Digital EEG Review:: Virtual Source Montages, Whole-head Mapping, Correlation, and Phase Analysis , 2002, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[29]  Hae-Jeong Park,et al.  LORETA imaging of P300 in schizophrenia with individual MRI and 128-channel EEG , 2003, NeuroImage.

[30]  René J. Huster,et al.  Methods for Simultaneous EEG-fMRI: An Introductory Review , 2012, The Journal of Neuroscience.

[31]  Bin He,et al.  Functional cortical source imaging from simultaneously recorded ERP and fMRI , 2006, Journal of Neuroscience Methods.

[32]  Kara D. Federmeier,et al.  Event-related brain potentials. , 1990 .

[33]  P. Thompson,et al.  Gray matter deficits, mismatch negativity, and outcomes in schizophrenia. , 2011, Schizophrenia bulletin.

[34]  S. Debener,et al.  Effects of simultaneous EEG recording on MRI data quality at 1.5, 3 and 7 tesla. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[35]  Ron Kikinis,et al.  Association between smaller left posterior superior temporal gyrus volume on magnetic resonance imaging and smaller left temporal P300 amplitude in first-episode schizophrenia. , 2002, Archives of general psychiatry.

[36]  W. Baaré,et al.  Structural brain correlates of sensorimotor gating in antipsychotic-naive men with first-episode schizophrenia. , 2013, Journal of psychiatry & neuroscience : JPN.

[37]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[38]  J. Leon Kenemans,et al.  Prepulse inhibition and P50 suppression: Commonalities and dissociations , 2006, Psychiatry Research.

[39]  M. Scherg.  Fundamentals if dipole source potential analysis , 1990 .

[40]  T W Picton,et al.  Separation and identification of event-related potential components by brain electric source analysis. , 1991, Electroencephalography and clinical neurophysiology. Supplement.

[41]  Karl J. Friston,et al.  Functional MRI , 1997 .

[42]  E Borg,et al.  MRI acoustic noise: Sound pressure and frequency analysis , 1997, Journal of magnetic resonance imaging : JMRI.

[43]  O. Josephs,et al.  EEG recording during fMRI experiments: Image quality , 2000, Human brain mapping.

[44]  Robert Turner,et al.  A Method for Removing Imaging Artifact from Continuous EEG Recorded during Functional MRI , 2000, NeuroImage.

[45]  A. Walker.  Electroencephalography, Basic Principles, Clinical Applications and Related Fields , 1982 .

[46]  M. Roth,et al.  Single‐trial analysis of oddball event‐related potentials in simultaneous EEG‐fMRI , 2007, Human brain mapping.

[47]  M. Mintun,et al.  Brain work and brain imaging. , 2006, Annual review of neuroscience.

[48]  E. Bramon,et al.  White matter alterations related to P300 abnormalities in individuals at high risk for psychosis: an MRI-EEG study. , 2011, Journal of psychiatry & neuroscience : JPN.

[49]  J. Coull.  Neural correlates of attention and arousal: insights from electrophysiology, functional neuroimaging and psychopharmacology , 1998, Progress in Neurobiology.

[50]  S. Ogawa.  Brain magnetic resonance imaging with contrast-dependent oxygenation , 1990 .

[51]  S. Shergill,et al.  Neuromagnetic oscillations and hemodynamic correlates of P50 suppression in schizophrenia , 2011, Psychiatry Research: Neuroimaging.

[52]  A. Engel,et al.  Single-trial EEG–fMRI reveals the dynamics of cognitive function , 2006, Trends in Cognitive Sciences.

[53]  Nikos K Logothetis,et al.  Interpreting the BOLD signal. , 2004, Annual review of physiology.

[54]  Fernando Lopes da Silva,et al.  Comprar Niedermeyer's Electroencephalography, 6/e (Basic Principles, Clinical Applications, and Related Fields ) | Fernando Lopes Da Silva | 9780781789424 | Lippincott Williams & Wilkins , 2010 .

[55]  B. Oranje,et al.  Increased Prepulse Inhibition and Sensitization of the Startle Reflex in Autistic Children , 2014, Autism research : official journal of the International Society for Autism Research.

[56]  H. Lublin,et al.  Sensorimotor gating and habituation in antipsychotic-naive, first-episode schizophrenia patients before and after 6 months' treatment with quetiapine. , 2010, The international journal of neuropsychopharmacology.

[57]  Ulrich Ettinger,et al.  Structural brain correlates of prepulse inhibition of the acoustic startle response in healthy humans , 2005, NeuroImage.

[58]  E. Gordon,et al.  Abnormal asymmetry of N200 and P300 event-related potentials in subclinical depression. , 2006, Journal of affective disorders.

[59]  R. Näätänen.  The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function , 1990, Behavioral and Brain Sciences.

[60]  Robert Schmitt,et al.  Integration of fMRI and simultaneous EEG: towards a comprehensive understanding of localization and time-course of brain activity in target detection , 2004, NeuroImage.

[61]  Robert Freedman,et al.  Increased hemodynamic response in the hippocampus, thalamus and prefrontal cortex during abnormal sensory gating in schizophrenia , 2007, Schizophrenia Research.

[62]  Andrew Simmons,et al.  Neural correlates of tactile prepulse inhibition: a functional MRI study in normal and schizophrenic subjects , 2003, Psychiatry Research: Neuroimaging.

[63]  R. Barry,et al.  A review of electrophysiology in attention-deficit/hyperactivity disorder: I. Qualitative and quantitative electroencephalography , 2003, Clinical Neurophysiology.